Glove - 6B - 300d. original. - 50 epochs Using TensorFlow backend.
2018-06-15 11:31:16.144179: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-15 11:31:16.476981: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-15 11:31:16.487927: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-15 11:31:17.257602: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-15 11:31:17.264482: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-15 11:31:17.269593: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-15 11:31:17.274232: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 300), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 300, 300), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 90000) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 90000) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 360004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 10,895,404
Trainable params: 10,895,404
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.5609 - acc: 0.6938 - val_loss: 0.4507 - val_acc: 0.7971
Epoch 2/50
67349/67349 [==============================] - 978s 15ms/step - loss: 0.3519 - acc: 0.8553 - val_loss: 0.4588 - val_acc: 0.8221
Epoch 3/50
67349/67349 [==============================] - 980s 15ms/step - loss: 0.3066 - acc: 0.8773 - val_loss: 0.4781 - val_acc: 0.8182
Epoch 4/50
67349/67349 [==============================] - 980s 15ms/step - loss: 0.2885 - acc: 0.8860 - val_loss: 0.4874 - val_acc: 0.8191
Epoch 5/50
67349/67349 [==============================] - 978s 15ms/step - loss: 0.2783 - acc: 0.8909 - val_loss: 0.4904 - val_acc: 0.8171
Epoch 6/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2725 - acc: 0.8936 - val_loss: 0.4915 - val_acc: 0.8166
Epoch 7/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2686 - acc: 0.8956 - val_loss: 0.4929 - val_acc: 0.8202
Epoch 8/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2661 - acc: 0.8973 - val_loss: 0.4956 - val_acc: 0.8204
Epoch 9/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2644 - acc: 0.8978 - val_loss: 0.4966 - val_acc: 0.8218
Epoch 10/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2629 - acc: 0.8983 - val_loss: 0.4989 - val_acc: 0.8174
Epoch 11/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2616 - acc: 0.8993 - val_loss: 0.4990 - val_acc: 0.8182
Epoch 12/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2606 - acc: 0.9001 - val_loss: 0.5008 - val_acc: 0.8147
Epoch 13/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2594 - acc: 0.9006 - val_loss: 0.5095 - val_acc: 0.8174
Epoch 14/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2592 - acc: 0.9005 - val_loss: 0.5034 - val_acc: 0.8169
Epoch 15/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2586 - acc: 0.9010 - val_loss: 0.5078 - val_acc: 0.8149
Epoch 16/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2583 - acc: 0.9013 - val_loss: 0.5040 - val_acc: 0.8158
Epoch 17/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2579 - acc: 0.9011 - val_loss: 0.5109 - val_acc: 0.8193
Epoch 18/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2574 - acc: 0.9014 - val_loss: 0.5028 - val_acc: 0.8204
Epoch 19/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2572 - acc: 0.9022 - val_loss: 0.5052 - val_acc: 0.8136
Epoch 20/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2568 - acc: 0.9020 - val_loss: 0.5104 - val_acc: 0.8182
Epoch 21/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2564 - acc: 0.9023 - val_loss: 0.5106 - val_acc: 0.8202
Epoch 22/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2564 - acc: 0.9018 - val_loss: 0.5081 - val_acc: 0.8210
Epoch 23/50
67349/67349 [==============================] - 979s 15ms/step - loss: 0.2561 - acc: 0.9028 - val_loss: 0.5071 - val_acc: 0.8169
Epoch 24/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2557 - acc: 0.9026 - val_loss: 0.5140 - val_acc: 0.8160
Epoch 25/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2557 - acc: 0.9022 - val_loss: 0.5056 - val_acc: 0.8180
Epoch 26/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2555 - acc: 0.9028 - val_loss: 0.5079 - val_acc: 0.8226
Epoch 27/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2555 - acc: 0.9024 - val_loss: 0.5047 - val_acc: 0.8171
Epoch 28/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2553 - acc: 0.9029 - val_loss: 0.5017 - val_acc: 0.8207
Epoch 29/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2553 - acc: 0.9024 - val_loss: 0.5052 - val_acc: 0.8193
Epoch 30/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2551 - acc: 0.9026 - val_loss: 0.5046 - val_acc: 0.8193
Epoch 31/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2551 - acc: 0.9023 - val_loss: 0.5056 - val_acc: 0.8204
Epoch 32/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2551 - acc: 0.9027 - val_loss: 0.5073 - val_acc: 0.8234
Epoch 33/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2551 - acc: 0.9024 - val_loss: 0.5068 - val_acc: 0.8226
Epoch 34/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2547 - acc: 0.9029 - val_loss: 0.5062 - val_acc: 0.8213
Epoch 35/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2550 - acc: 0.9023 - val_loss: 0.5092 - val_acc: 0.8232
Epoch 36/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2546 - acc: 0.9025 - val_loss: 0.5158 - val_acc: 0.8248
Epoch 37/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2550 - acc: 0.9028 - val_loss: 0.5116 - val_acc: 0.8243
Epoch 38/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2548 - acc: 0.9027 - val_loss: 0.5100 - val_acc: 0.8207
Epoch 39/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2548 - acc: 0.9027 - val_loss: 0.5074 - val_acc: 0.8218
Epoch 40/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2548 - acc: 0.9025 - val_loss: 0.5035 - val_acc: 0.8213
Epoch 41/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2547 - acc: 0.9027 - val_loss: 0.5070 - val_acc: 0.8226
Epoch 42/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2546 - acc: 0.9030 - val_loss: 0.5080 - val_acc: 0.8221
Epoch 43/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2546 - acc: 0.9030 - val_loss: 0.5148 - val_acc: 0.8256
Epoch 44/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2546 - acc: 0.9030 - val_loss: 0.5152 - val_acc: 0.8254
Epoch 45/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2545 - acc: 0.9028 - val_loss: 0.5107 - val_acc: 0.8204
Epoch 46/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2545 - acc: 0.9029 - val_loss: 0.5015 - val_acc: 0.8215
Epoch 47/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2543 - acc: 0.9028 - val_loss: 0.5039 - val_acc: 0.8210
Epoch 48/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2543 - acc: 0.9032 - val_loss: 0.5069 - val_acc: 0.8210
Epoch 49/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2541 - acc: 0.9034 - val_loss: 0.5157 - val_acc: 0.8226
Epoch 50/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2542 - acc: 0.9032 - val_loss: 0.5051 - val_acc: 0.8210
1821/1821 [==============================] - 7s 4ms/step
Crawl - 2M - 300d Original. - 50 epochs Using TensorFlow backend.
2018-06-13 14:04:59.497592: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-13 14:04:59.824899: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-13 14:04:59.835731: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-13 14:05:00.608634: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-13 14:05:00.615067: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-13 14:05:00.619824: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-13 14:05:00.623939: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 300), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 300, 300), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 90000) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 90000) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 360004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 10,895,404
Trainable params: 10,895,404
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.5635 - acc: 0.6924 - val_loss: 0.4518 - val_acc: 0.8015
Epoch 2/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.3556 - acc: 0.8543 - val_loss: 0.4580 - val_acc: 0.8177
Epoch 3/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.3077 - acc: 0.8774 - val_loss: 0.4783 - val_acc: 0.8207
Epoch 4/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2875 - acc: 0.8868 - val_loss: 0.4899 - val_acc: 0.8171
Epoch 5/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2770 - acc: 0.8920 - val_loss: 0.4981 - val_acc: 0.8180
Epoch 6/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2705 - acc: 0.8958 - val_loss: 0.4987 - val_acc: 0.8171
Epoch 7/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2669 - acc: 0.8986 - val_loss: 0.4996 - val_acc: 0.8136
Epoch 8/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2641 - acc: 0.8994 - val_loss: 0.4981 - val_acc: 0.8185
Epoch 9/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2624 - acc: 0.9007 - val_loss: 0.4968 - val_acc: 0.8171
Epoch 10/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2607 - acc: 0.9007 - val_loss: 0.4984 - val_acc: 0.8185
Epoch 11/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2595 - acc: 0.9016 - val_loss: 0.4990 - val_acc: 0.8147
Epoch 12/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2585 - acc: 0.9023 - val_loss: 0.5035 - val_acc: 0.8125
Epoch 13/50
67349/67349 [==============================] - 986s 15ms/step - loss: 0.2578 - acc: 0.9027 - val_loss: 0.5017 - val_acc: 0.8155
Epoch 14/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2571 - acc: 0.9037 - val_loss: 0.5015 - val_acc: 0.8136
Epoch 15/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2564 - acc: 0.9034 - val_loss: 0.5066 - val_acc: 0.8138
Epoch 16/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2563 - acc: 0.9035 - val_loss: 0.5043 - val_acc: 0.8136
Epoch 17/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2558 - acc: 0.9040 - val_loss: 0.5018 - val_acc: 0.8163
Epoch 18/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2553 - acc: 0.9042 - val_loss: 0.5061 - val_acc: 0.8155
Epoch 19/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2548 - acc: 0.9039 - val_loss: 0.5032 - val_acc: 0.8166
Epoch 20/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2546 - acc: 0.9045 - val_loss: 0.5100 - val_acc: 0.8141
Epoch 21/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2545 - acc: 0.9040 - val_loss: 0.5065 - val_acc: 0.8116
Epoch 22/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2543 - acc: 0.9044 - val_loss: 0.5094 - val_acc: 0.8144
Epoch 23/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2541 - acc: 0.9045 - val_loss: 0.5046 - val_acc: 0.8152
Epoch 24/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2540 - acc: 0.9045 - val_loss: 0.5045 - val_acc: 0.8152
Epoch 25/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2536 - acc: 0.9051 - val_loss: 0.5169 - val_acc: 0.8100
Epoch 26/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2537 - acc: 0.9045 - val_loss: 0.5103 - val_acc: 0.8152
Epoch 27/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2538 - acc: 0.9048 - val_loss: 0.5115 - val_acc: 0.8149
Epoch 28/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2536 - acc: 0.9050 - val_loss: 0.5111 - val_acc: 0.8119
Epoch 29/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2533 - acc: 0.9052 - val_loss: 0.5085 - val_acc: 0.8144
Epoch 30/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2533 - acc: 0.9053 - val_loss: 0.5102 - val_acc: 0.8155
Epoch 31/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2533 - acc: 0.9050 - val_loss: 0.5126 - val_acc: 0.8171
Epoch 32/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2533 - acc: 0.9049 - val_loss: 0.5093 - val_acc: 0.8125
Epoch 33/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2530 - acc: 0.9053 - val_loss: 0.5094 - val_acc: 0.8141
Epoch 34/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2533 - acc: 0.9051 - val_loss: 0.5129 - val_acc: 0.8160
Epoch 35/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2532 - acc: 0.9050 - val_loss: 0.5092 - val_acc: 0.8188
Epoch 36/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2531 - acc: 0.9048 - val_loss: 0.5222 - val_acc: 0.8147
Epoch 37/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2531 - acc: 0.9054 - val_loss: 0.5129 - val_acc: 0.8155
Epoch 38/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2529 - acc: 0.9051 - val_loss: 0.5258 - val_acc: 0.8160
Epoch 39/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2532 - acc: 0.9052 - val_loss: 0.5141 - val_acc: 0.8193
Epoch 40/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2531 - acc: 0.9048 - val_loss: 0.5183 - val_acc: 0.8136
Epoch 41/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2531 - acc: 0.9045 - val_loss: 0.5071 - val_acc: 0.8188
Epoch 42/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2526 - acc: 0.9043 - val_loss: 0.5105 - val_acc: 0.8138
Epoch 43/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2528 - acc: 0.9050 - val_loss: 0.5087 - val_acc: 0.8152
Epoch 44/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2529 - acc: 0.9048 - val_loss: 0.5115 - val_acc: 0.8155
Epoch 45/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2528 - acc: 0.9047 - val_loss: 0.5128 - val_acc: 0.8185
Epoch 46/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2528 - acc: 0.9055 - val_loss: 0.5130 - val_acc: 0.8169
Epoch 47/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2528 - acc: 0.9049 - val_loss: 0.5147 - val_acc: 0.8185
Epoch 48/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2528 - acc: 0.9047 - val_loss: 0.5105 - val_acc: 0.8174
Epoch 49/50
67349/67349 [==============================] - 970s 14ms/step - loss: 0.2525 - acc: 0.9052 - val_loss: 0.5166 - val_acc: 0.8160
Epoch 50/50
67349/67349 [==============================] - 970s 14ms/step - loss: 0.2523 - acc: 0.9047 - val_loss: 0.5136 - val_acc: 0.8177
1821/1821 [==============================] - 7s 4ms/step
Glove - 840B - 150d Transformed. - 50 epochs Using TensorFlow backend.
2018-06-13 09:11:58.265317: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-13 09:11:58.599160: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-13 09:11:58.610482: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-13 09:11:59.385156: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-13 09:11:59.391395: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-13 09:11:59.396138: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-13 09:11:59.400330: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 150) 2633850 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 150) 2633850 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 150), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 150, 150), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 22500) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 22500) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 90004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 5,357,704
Trainable params: 5,357,704
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.6117 - acc: 0.6529 - val_loss: 0.4693 - val_acc: 0.7941
Epoch 2/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.3964 - acc: 0.8362 - val_loss: 0.4506 - val_acc: 0.8144
Epoch 3/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.3297 - acc: 0.8666 - val_loss: 0.4675 - val_acc: 0.8224
Epoch 4/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.3030 - acc: 0.8806 - val_loss: 0.4776 - val_acc: 0.8185
Epoch 5/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2886 - acc: 0.8870 - val_loss: 0.4927 - val_acc: 0.8158
Epoch 6/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2799 - acc: 0.8920 - val_loss: 0.4926 - val_acc: 0.8191
Epoch 7/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2734 - acc: 0.8945 - val_loss: 0.4995 - val_acc: 0.8199
Epoch 8/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2697 - acc: 0.8964 - val_loss: 0.4971 - val_acc: 0.8204
Epoch 9/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2661 - acc: 0.8979 - val_loss: 0.4964 - val_acc: 0.8207
Epoch 10/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2639 - acc: 0.8995 - val_loss: 0.5053 - val_acc: 0.8196
Epoch 11/50
67349/67349 [==============================] - 329s 5ms/step - loss: 0.2621 - acc: 0.9006 - val_loss: 0.5012 - val_acc: 0.8188
Epoch 12/50
67349/67349 [==============================] - 329s 5ms/step - loss: 0.2607 - acc: 0.9013 - val_loss: 0.5052 - val_acc: 0.8182
Epoch 13/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2596 - acc: 0.9021 - val_loss: 0.5019 - val_acc: 0.8193
Epoch 14/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2588 - acc: 0.9029 - val_loss: 0.5035 - val_acc: 0.8221
Epoch 15/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2579 - acc: 0.9032 - val_loss: 0.5061 - val_acc: 0.8185
Epoch 16/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2572 - acc: 0.9034 - val_loss: 0.5114 - val_acc: 0.8202
Epoch 17/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2568 - acc: 0.9035 - val_loss: 0.5081 - val_acc: 0.8196
Epoch 18/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2561 - acc: 0.9037 - val_loss: 0.5070 - val_acc: 0.8215
Epoch 19/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2557 - acc: 0.9040 - val_loss: 0.5070 - val_acc: 0.8196
Epoch 20/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2550 - acc: 0.9042 - val_loss: 0.5124 - val_acc: 0.8199
Epoch 21/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2547 - acc: 0.9046 - val_loss: 0.5097 - val_acc: 0.8204
Epoch 22/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2545 - acc: 0.9042 - val_loss: 0.5025 - val_acc: 0.8226
Epoch 23/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2541 - acc: 0.9043 - val_loss: 0.5040 - val_acc: 0.8215
Epoch 24/50
67349/67349 [==============================] - 333s 5ms/step - loss: 0.2538 - acc: 0.9045 - val_loss: 0.5058 - val_acc: 0.8237
Epoch 25/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2538 - acc: 0.9043 - val_loss: 0.5052 - val_acc: 0.8229
Epoch 26/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2537 - acc: 0.9047 - val_loss: 0.5081 - val_acc: 0.8188
Epoch 27/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2529 - acc: 0.9047 - val_loss: 0.5131 - val_acc: 0.8171
Epoch 28/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2531 - acc: 0.9050 - val_loss: 0.5095 - val_acc: 0.8196
Epoch 29/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2531 - acc: 0.9050 - val_loss: 0.5071 - val_acc: 0.8207
Epoch 30/50
67349/67349 [==============================] - 337s 5ms/step - loss: 0.2528 - acc: 0.9055 - val_loss: 0.5097 - val_acc: 0.8202
Epoch 31/50
67349/67349 [==============================] - 335s 5ms/step - loss: 0.2525 - acc: 0.9047 - val_loss: 0.5086 - val_acc: 0.8232
Epoch 32/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2528 - acc: 0.9051 - val_loss: 0.5094 - val_acc: 0.8237
Epoch 33/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2525 - acc: 0.9051 - val_loss: 0.5104 - val_acc: 0.8204
Epoch 34/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2525 - acc: 0.9052 - val_loss: 0.5066 - val_acc: 0.8251
Epoch 35/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2524 - acc: 0.9053 - val_loss: 0.5081 - val_acc: 0.8224
Epoch 36/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2525 - acc: 0.9055 - val_loss: 0.5040 - val_acc: 0.8224
Epoch 37/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2523 - acc: 0.9054 - val_loss: 0.5090 - val_acc: 0.8224
Epoch 38/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2525 - acc: 0.9049 - val_loss: 0.5074 - val_acc: 0.8210
Epoch 39/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2522 - acc: 0.9052 - val_loss: 0.5107 - val_acc: 0.8199
Epoch 40/50
67349/67349 [==============================] - 333s 5ms/step - loss: 0.2523 - acc: 0.9055 - val_loss: 0.5095 - val_acc: 0.8199
Epoch 41/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2522 - acc: 0.9060 - val_loss: 0.5072 - val_acc: 0.8199
Epoch 42/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2523 - acc: 0.9056 - val_loss: 0.5075 - val_acc: 0.8196
Epoch 43/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2521 - acc: 0.9053 - val_loss: 0.5111 - val_acc: 0.8169
Epoch 44/50
67349/67349 [==============================] - 333s 5ms/step - loss: 0.2523 - acc: 0.9054 - val_loss: 0.5106 - val_acc: 0.8182
Epoch 45/50
67349/67349 [==============================] - 333s 5ms/step - loss: 0.2523 - acc: 0.9053 - val_loss: 0.5073 - val_acc: 0.8226
Epoch 46/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2523 - acc: 0.9054 - val_loss: 0.5051 - val_acc: 0.8191
Epoch 47/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2521 - acc: 0.9056 - val_loss: 0.5070 - val_acc: 0.8185
Epoch 48/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2522 - acc: 0.9054 - val_loss: 0.5128 - val_acc: 0.8210
Epoch 49/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2523 - acc: 0.9052 - val_loss: 0.5087 - val_acc: 0.8210
Epoch 50/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2518 - acc: 0.9056 - val_loss: 0.5084 - val_acc: 0.8221
1821/1821 [==============================] - 2s 1ms/step
Glove - 840B - 300d. - 50 epochs Using TensorFlow backend.
2018-06-12 15:57:25.759098: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-12 15:57:26.116863: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-12 15:57:26.127055: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-12 15:57:26.881199: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-12 15:57:26.887468: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-12 15:57:26.892095: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-12 15:57:26.897347: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 300) 5267700 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 300), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 300, 300), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 90000) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 90000) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 360004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 10,895,404
Trainable params: 10,895,404
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.5578 - acc: 0.6981 - val_loss: 0.4428 - val_acc: 0.8108
Epoch 2/50
67349/67349 [==============================] - 978s 15ms/step - loss: 0.3509 - acc: 0.8564 - val_loss: 0.4658 - val_acc: 0.8224
Epoch 3/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.3053 - acc: 0.8784 - val_loss: 0.4777 - val_acc: 0.8267
Epoch 4/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2860 - acc: 0.8883 - val_loss: 0.4859 - val_acc: 0.8259
Epoch 5/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2752 - acc: 0.8940 - val_loss: 0.4926 - val_acc: 0.8226
Epoch 6/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2694 - acc: 0.8968 - val_loss: 0.4838 - val_acc: 0.8251
Epoch 7/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2649 - acc: 0.8994 - val_loss: 0.4923 - val_acc: 0.8204
Epoch 8/50
67349/67349 [==============================] - 974s 14ms/step - loss: 0.2620 - acc: 0.9008 - val_loss: 0.4981 - val_acc: 0.8199
Epoch 9/50
67349/67349 [==============================] - 975s 14ms/step - loss: 0.2601 - acc: 0.9017 - val_loss: 0.5004 - val_acc: 0.8196
Epoch 10/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2588 - acc: 0.9029 - val_loss: 0.4960 - val_acc: 0.8204
Epoch 11/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2572 - acc: 0.9034 - val_loss: 0.5003 - val_acc: 0.8210
Epoch 12/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2565 - acc: 0.9040 - val_loss: 0.4979 - val_acc: 0.8202
Epoch 13/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2555 - acc: 0.9041 - val_loss: 0.4972 - val_acc: 0.8232
Epoch 14/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2546 - acc: 0.9041 - val_loss: 0.4989 - val_acc: 0.8177
Epoch 15/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2542 - acc: 0.9052 - val_loss: 0.5013 - val_acc: 0.8207
Epoch 16/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2537 - acc: 0.9050 - val_loss: 0.5030 - val_acc: 0.8191
Epoch 17/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2534 - acc: 0.9053 - val_loss: 0.4998 - val_acc: 0.8210
Epoch 18/50
67349/67349 [==============================] - 976s 14ms/step - loss: 0.2531 - acc: 0.9057 - val_loss: 0.5028 - val_acc: 0.8193
Epoch 19/50
67349/67349 [==============================] - 972s 14ms/step - loss: 0.2527 - acc: 0.9055 - val_loss: 0.5016 - val_acc: 0.8182
Epoch 20/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2524 - acc: 0.9055 - val_loss: 0.5022 - val_acc: 0.8193
Epoch 21/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2523 - acc: 0.9060 - val_loss: 0.4982 - val_acc: 0.8226
Epoch 22/50
67349/67349 [==============================] - 979s 15ms/step - loss: 0.2519 - acc: 0.9051 - val_loss: 0.5095 - val_acc: 0.8191
Epoch 23/50
67349/67349 [==============================] - 973s 14ms/step - loss: 0.2518 - acc: 0.9061 - val_loss: 0.4995 - val_acc: 0.8248
Epoch 24/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2516 - acc: 0.9058 - val_loss: 0.5122 - val_acc: 0.8171
Epoch 25/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2513 - acc: 0.9062 - val_loss: 0.5118 - val_acc: 0.8254
Epoch 26/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2513 - acc: 0.9064 - val_loss: 0.5019 - val_acc: 0.8234
Epoch 27/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2512 - acc: 0.9061 - val_loss: 0.5047 - val_acc: 0.8226
Epoch 28/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2511 - acc: 0.9064 - val_loss: 0.5066 - val_acc: 0.8254
Epoch 29/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2511 - acc: 0.9060 - val_loss: 0.5090 - val_acc: 0.8221
Epoch 30/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2509 - acc: 0.9059 - val_loss: 0.5062 - val_acc: 0.8207
Epoch 31/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2507 - acc: 0.9063 - val_loss: 0.5093 - val_acc: 0.8202
Epoch 32/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2508 - acc: 0.9063 - val_loss: 0.5023 - val_acc: 0.8237
Epoch 33/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2505 - acc: 0.9064 - val_loss: 0.5076 - val_acc: 0.8237
Epoch 34/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2507 - acc: 0.9062 - val_loss: 0.5095 - val_acc: 0.8237
Epoch 35/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2508 - acc: 0.9067 - val_loss: 0.5107 - val_acc: 0.8221
Epoch 36/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2508 - acc: 0.9063 - val_loss: 0.5095 - val_acc: 0.8224
Epoch 37/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2506 - acc: 0.9063 - val_loss: 0.5140 - val_acc: 0.8215
Epoch 38/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2506 - acc: 0.9067 - val_loss: 0.5107 - val_acc: 0.8237
Epoch 39/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2505 - acc: 0.9063 - val_loss: 0.5111 - val_acc: 0.8265
Epoch 40/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2503 - acc: 0.9065 - val_loss: 0.5231 - val_acc: 0.8237
Epoch 41/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2505 - acc: 0.9062 - val_loss: 0.5004 - val_acc: 0.8213
Epoch 42/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2503 - acc: 0.9062 - val_loss: 0.5124 - val_acc: 0.8243
Epoch 43/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2504 - acc: 0.9062 - val_loss: 0.5055 - val_acc: 0.8232
Epoch 44/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2505 - acc: 0.9064 - val_loss: 0.5113 - val_acc: 0.8226
Epoch 45/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2503 - acc: 0.9062 - val_loss: 0.5089 - val_acc: 0.8243
Epoch 46/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2500 - acc: 0.9065 - val_loss: 0.5157 - val_acc: 0.8267
Epoch 47/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2502 - acc: 0.9064 - val_loss: 0.5137 - val_acc: 0.8240
Epoch 48/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2503 - acc: 0.9063 - val_loss: 0.5102 - val_acc: 0.8232
Epoch 49/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2502 - acc: 0.9062 - val_loss: 0.5099 - val_acc: 0.8234
Epoch 50/50
67349/67349 [==============================] - 971s 14ms/step - loss: 0.2502 - acc: 0.9061 - val_loss: 0.5087 - val_acc: 0.8237
1821/1821 [==============================] - 7s 4ms/step
Crawl - 2M - 150d Transformed. - 50 epochs Using TensorFlow backend.
2018-06-11 17:54:30.507455: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-11 17:54:30.867611: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-11 17:54:30.877573: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-11 17:54:31.633186: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-11 17:54:31.639126: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-11 17:54:31.643992: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-11 17:54:31.647744: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 150) 2633850 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 150) 2633850 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 150), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 150, 150), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 22500) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 22500) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 90004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 5,357,704
Trainable params: 5,357,704
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.6134 - acc: 0.6527 - val_loss: 0.4709 - val_acc: 0.7872
Epoch 2/50
67349/67349 [==============================] - 340s 5ms/step - loss: 0.3994 - acc: 0.8336 - val_loss: 0.4474 - val_acc: 0.8097
Epoch 3/50
67349/67349 [==============================] - 335s 5ms/step - loss: 0.3328 - acc: 0.8654 - val_loss: 0.4662 - val_acc: 0.8130
Epoch 4/50
67349/67349 [==============================] - 335s 5ms/step - loss: 0.3060 - acc: 0.8785 - val_loss: 0.4883 - val_acc: 0.8116
Epoch 5/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2918 - acc: 0.8851 - val_loss: 0.4899 - val_acc: 0.8185
Epoch 6/50
67349/67349 [==============================] - 339s 5ms/step - loss: 0.2828 - acc: 0.8895 - val_loss: 0.4964 - val_acc: 0.8127
Epoch 7/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2763 - acc: 0.8928 - val_loss: 0.5052 - val_acc: 0.8147
Epoch 8/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2727 - acc: 0.8946 - val_loss: 0.5044 - val_acc: 0.8158
Epoch 9/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2696 - acc: 0.8967 - val_loss: 0.5036 - val_acc: 0.8171
Epoch 10/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2672 - acc: 0.8978 - val_loss: 0.5055 - val_acc: 0.8152
Epoch 11/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2652 - acc: 0.8985 - val_loss: 0.5063 - val_acc: 0.8166
Epoch 12/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2640 - acc: 0.8995 - val_loss: 0.5106 - val_acc: 0.8149
Epoch 13/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2628 - acc: 0.8999 - val_loss: 0.5048 - val_acc: 0.8182
Epoch 14/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2621 - acc: 0.9002 - val_loss: 0.5062 - val_acc: 0.8166
Epoch 15/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2613 - acc: 0.9009 - val_loss: 0.5032 - val_acc: 0.8144
Epoch 16/50
67349/67349 [==============================] - 61149s 908ms/step - loss: 0.2608 - acc: 0.9009 - val_loss: 0.5035 - val_acc: 0.8182
Epoch 17/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2601 - acc: 0.9018 - val_loss: 0.5081 - val_acc: 0.8182
Epoch 18/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2598 - acc: 0.9012 - val_loss: 0.5066 - val_acc: 0.8174
Epoch 19/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2592 - acc: 0.9021 - val_loss: 0.5092 - val_acc: 0.8160
Epoch 20/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2587 - acc: 0.9022 - val_loss: 0.5119 - val_acc: 0.8171
Epoch 21/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2584 - acc: 0.9023 - val_loss: 0.5130 - val_acc: 0.8174
Epoch 22/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2580 - acc: 0.9021 - val_loss: 0.5072 - val_acc: 0.8158
Epoch 23/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2577 - acc: 0.9026 - val_loss: 0.5061 - val_acc: 0.8149
Epoch 24/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2575 - acc: 0.9027 - val_loss: 0.5092 - val_acc: 0.8193
Epoch 25/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2572 - acc: 0.9030 - val_loss: 0.5088 - val_acc: 0.8158
Epoch 26/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2569 - acc: 0.9032 - val_loss: 0.5131 - val_acc: 0.8136
Epoch 27/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2568 - acc: 0.9035 - val_loss: 0.5118 - val_acc: 0.8160
Epoch 28/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2566 - acc: 0.9035 - val_loss: 0.5144 - val_acc: 0.8160
Epoch 29/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2565 - acc: 0.9034 - val_loss: 0.5133 - val_acc: 0.8149
Epoch 30/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2563 - acc: 0.9037 - val_loss: 0.5068 - val_acc: 0.8160
Epoch 31/50
67349/67349 [==============================] - 332s 5ms/step - loss: 0.2562 - acc: 0.9034 - val_loss: 0.5104 - val_acc: 0.8155
Epoch 32/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9035 - val_loss: 0.5116 - val_acc: 0.8149
Epoch 33/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9037 - val_loss: 0.5116 - val_acc: 0.8147
Epoch 34/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9034 - val_loss: 0.5122 - val_acc: 0.8144
Epoch 35/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9037 - val_loss: 0.5126 - val_acc: 0.8147
Epoch 36/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2559 - acc: 0.9038 - val_loss: 0.5118 - val_acc: 0.8163
Epoch 37/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2559 - acc: 0.9037 - val_loss: 0.5123 - val_acc: 0.8138
Epoch 38/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9036 - val_loss: 0.5123 - val_acc: 0.8155
Epoch 39/50
67349/67349 [==============================] - 331s 5ms/step - loss: 0.2559 - acc: 0.9040 - val_loss: 0.5072 - val_acc: 0.8166
Epoch 40/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2561 - acc: 0.9038 - val_loss: 0.5058 - val_acc: 0.8160
Epoch 41/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2558 - acc: 0.9038 - val_loss: 0.5132 - val_acc: 0.8160
Epoch 42/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2559 - acc: 0.9037 - val_loss: 0.5074 - val_acc: 0.8160
Epoch 43/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2558 - acc: 0.9038 - val_loss: 0.5132 - val_acc: 0.8144
Epoch 44/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2558 - acc: 0.9039 - val_loss: 0.5132 - val_acc: 0.8163
Epoch 45/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2558 - acc: 0.9039 - val_loss: 0.5122 - val_acc: 0.8171
Epoch 46/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2558 - acc: 0.9040 - val_loss: 0.5145 - val_acc: 0.8177
Epoch 47/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2557 - acc: 0.9044 - val_loss: 0.5088 - val_acc: 0.8207
Epoch 48/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2557 - acc: 0.9042 - val_loss: 0.5093 - val_acc: 0.8182
Epoch 49/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2555 - acc: 0.9043 - val_loss: 0.5088 - val_acc: 0.8182
Epoch 50/50
67349/67349 [==============================] - 330s 5ms/step - loss: 0.2559 - acc: 0.9039 - val_loss: 0.5046 - val_acc: 0.8171
1821/1821 [==============================] - 2s 1ms/step
Glove - 6B - 100d. - 50 epochs Using TensorFlow backend.
2018-06-11 15:32:38.252921: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
2018-06-11 15:32:38.618376: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1356] Found device 0 with properties:
name: GeForce GTX 750 Ti major: 5 minor: 0 memoryClockRate(GHz): 1.137
pciBusID: 0000:02:00.0
totalMemory: 4.00GiB freeMemory: 3.35GiB
2018-06-11 15:32:38.630271: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1435] Adding visible gpu devices: 0
2018-06-11 15:32:39.394161: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:923] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-06-11 15:32:39.400725: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:929] 0
2018-06-11 15:32:39.407151: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:942] 0: N
2018-06-11 15:32:39.412574: I T:\src\github\tensorflow\tensorflow\core\common_runtime\gpu\gpu_device.cc:1053] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3081 MB memory) -> physical GPU (device: 0, name: GeForce GTX 750 Ti, pci bus id: 0000:02:00.0, compute capability: 5.0)
__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to
==================================================================================================
input_1 (InputLayer) (None, 56) 0
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, 56, 100) 1755900 input_1[0][0]
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, 56, 100) 1755900 input_1[0][0]
__________________________________________________________________________________________________
complex_multiply_1 (ComplexMult [(None, 56, 100), (N 0 embedding_1[0][0]
embedding_2[0][0]
__________________________________________________________________________________________________
complex_mixture_1 (ComplexMixtu [(None, 100, 100), ( 0 complex_multiply_1[0][0]
complex_multiply_1[0][1]
__________________________________________________________________________________________________
flatten_1 (Flatten) (None, 10000) 0 complex_mixture_1[0][0]
__________________________________________________________________________________________________
flatten_2 (Flatten) (None, 10000) 0 complex_mixture_1[0][1]
__________________________________________________________________________________________________
complex_dense_1 (ComplexDense) (None, 4) 40004 flatten_1[0][0]
flatten_2[0][0]
__________________________________________________________________________________________________
get_real_1 (GetReal) (None, 2) 0 complex_dense_1[0][0]
==================================================================================================
Total params: 3,551,804
Trainable params: 3,551,804
Non-trainable params: 0
__________________________________________________________________________________________________
67349
1821
872
Train on 67349 samples, validate on 1821 samples
Epoch 1/50
67349/67349 [==============================] - 150s 2ms/step - loss: 0.6348 - acc: 0.6319 - val_loss: 0.4999 - val_acc: 0.7779
Epoch 2/50
67349/67349 [==============================] - 148s 2ms/step - loss: 0.4315 - acc: 0.8165 - val_loss: 0.4443 - val_acc: 0.8070
Epoch 3/50
67349/67349 [==============================] - 148s 2ms/step - loss: 0.3539 - acc: 0.8542 - val_loss: 0.4535 - val_acc: 0.8202
Epoch 4/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.3208 - acc: 0.8699 - val_loss: 0.4608 - val_acc: 0.8193
Epoch 5/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.3029 - acc: 0.8787 - val_loss: 0.4738 - val_acc: 0.8202
Epoch 6/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2922 - acc: 0.8839 - val_loss: 0.4836 - val_acc: 0.8182
Epoch 7/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2849 - acc: 0.8880 - val_loss: 0.4950 - val_acc: 0.8185
Epoch 8/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2800 - acc: 0.8902 - val_loss: 0.4964 - val_acc: 0.8196
Epoch 9/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2762 - acc: 0.8920 - val_loss: 0.4935 - val_acc: 0.8207
Epoch 10/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2733 - acc: 0.8937 - val_loss: 0.5015 - val_acc: 0.8166
Epoch 11/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2711 - acc: 0.8948 - val_loss: 0.5012 - val_acc: 0.8160
Epoch 12/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2696 - acc: 0.8958 - val_loss: 0.5006 - val_acc: 0.8171
Epoch 13/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2683 - acc: 0.8970 - val_loss: 0.5042 - val_acc: 0.8152
Epoch 14/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2677 - acc: 0.8974 - val_loss: 0.5036 - val_acc: 0.8155
Epoch 15/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2665 - acc: 0.8983 - val_loss: 0.5062 - val_acc: 0.8174
Epoch 16/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2657 - acc: 0.8985 - val_loss: 0.5074 - val_acc: 0.8210
Epoch 17/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2651 - acc: 0.8987 - val_loss: 0.5084 - val_acc: 0.8182
Epoch 18/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2646 - acc: 0.8988 - val_loss: 0.5047 - val_acc: 0.8224
Epoch 19/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2641 - acc: 0.8990 - val_loss: 0.5049 - val_acc: 0.8215
Epoch 20/50
67349/67349 [==============================] - 148s 2ms/step - loss: 0.2638 - acc: 0.8991 - val_loss: 0.5052 - val_acc: 0.8177
Epoch 21/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2632 - acc: 0.8993 - val_loss: 0.5052 - val_acc: 0.8202
Epoch 22/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2630 - acc: 0.8992 - val_loss: 0.5083 - val_acc: 0.8191
Epoch 23/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2628 - acc: 0.8996 - val_loss: 0.5108 - val_acc: 0.8160
Epoch 24/50
67349/67349 [==============================] - 151s 2ms/step - loss: 0.2620 - acc: 0.8999 - val_loss: 0.5060 - val_acc: 0.8193
Epoch 25/50
67349/67349 [==============================] - 148s 2ms/step - loss: 0.2618 - acc: 0.9004 - val_loss: 0.5098 - val_acc: 0.8185
Epoch 26/50
67349/67349 [==============================] - 149s 2ms/step - loss: 0.2614 - acc: 0.9005 - val_loss: 0.5049 - val_acc: 0.8182
Epoch 27/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2610 - acc: 0.9002 - val_loss: 0.5055 - val_acc: 0.8177
Epoch 28/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2606 - acc: 0.9006 - val_loss: 0.5111 - val_acc: 0.8210
Epoch 29/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2609 - acc: 0.9005 - val_loss: 0.5073 - val_acc: 0.8215
Epoch 30/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2602 - acc: 0.9007 - val_loss: 0.5073 - val_acc: 0.8207
Epoch 31/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2601 - acc: 0.9004 - val_loss: 0.5109 - val_acc: 0.8174
Epoch 32/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2598 - acc: 0.9009 - val_loss: 0.5066 - val_acc: 0.8185
Epoch 33/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2596 - acc: 0.9009 - val_loss: 0.5086 - val_acc: 0.8202
Epoch 34/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2596 - acc: 0.9011 - val_loss: 0.5051 - val_acc: 0.8196
Epoch 35/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2594 - acc: 0.9010 - val_loss: 0.5036 - val_acc: 0.8188
Epoch 36/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2591 - acc: 0.9003 - val_loss: 0.5094 - val_acc: 0.8202
Epoch 37/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2589 - acc: 0.9012 - val_loss: 0.5060 - val_acc: 0.8182
Epoch 38/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2589 - acc: 0.9012 - val_loss: 0.5057 - val_acc: 0.8191
Epoch 39/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2587 - acc: 0.9010 - val_loss: 0.5096 - val_acc: 0.8177
Epoch 40/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2586 - acc: 0.9011 - val_loss: 0.5082 - val_acc: 0.8199
Epoch 41/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2588 - acc: 0.9006 - val_loss: 0.5078 - val_acc: 0.8155
Epoch 42/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2586 - acc: 0.9014 - val_loss: 0.5040 - val_acc: 0.8224
Epoch 43/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2587 - acc: 0.9007 - val_loss: 0.5072 - val_acc: 0.8182
Epoch 44/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2584 - acc: 0.9013 - val_loss: 0.5116 - val_acc: 0.8210
Epoch 45/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2585 - acc: 0.9015 - val_loss: 0.5081 - val_acc: 0.8237
Epoch 46/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2585 - acc: 0.9013 - val_loss: 0.5079 - val_acc: 0.8221
Epoch 47/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2586 - acc: 0.9014 - val_loss: 0.5086 - val_acc: 0.8226
Epoch 48/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2584 - acc: 0.9015 - val_loss: 0.5058 - val_acc: 0.8232
Epoch 49/50
67349/67349 [==============================] - 146s 2ms/step - loss: 0.2584 - acc: 0.9014 - val_loss: 0.5033 - val_acc: 0.8221
Epoch 50/50
67349/67349 [==============================] - 147s 2ms/step - loss: 0.2583 - acc: 0.9014 - val_loss: 0.5077 - val_acc: 0.8234
1821/1821 [==============================] - 1s 543us/step
