gistfile1.txt

/home/enijkamp/env/tf/bin/python3 /home/enijkamp/Dropbox/repeller-sgd/experiments/cyclic/cyclic_9.py
2018-05-15 01:55:34,154 - cyclic_9
2018-05-15 01:55:34,156 - loading ../../resnet_cifar100/model_2/model.ckpt-156280
2018-05-15 01:55:34.156473: I tensorflow/core/platform/cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-05-15 01:55:34.273215: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:898] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-05-15 01:55:34.273501: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 0 with properties: 
name: TITAN X (Pascal) major: 6 minor: 1 memoryClockRate(GHz): 1.531
pciBusID: 0000:02:00.0
totalMemory: 11.90GiB freeMemory: 11.54GiB
2018-05-15 01:55:34.325401: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:898] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2018-05-15 01:55:34.325627: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1344] Found device 1 with properties: 
name: GeForce GTX 660 Ti major: 3 minor: 0 memoryClockRate(GHz): 1.124
pciBusID: 0000:01:00.0
totalMemory: 2.94GiB freeMemory: 1.85GiB
2018-05-15 01:55:34.325645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1394] Ignoring visible gpu device (device: 1, name: GeForce GTX 660 Ti, pci bus id: 0000:01:00.0, compute capability: 3.0) with Cuda compute capability 3.0. The minimum required Cuda capability is 3.5.
2018-05-15 01:55:34.325648: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1423] Adding visible gpu devices: 0
2018-05-15 01:55:34.499502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:911] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-05-15 01:55:34.499519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:917]      0 1 
2018-05-15 01:55:34.499523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 0:   N N 
2018-05-15 01:55:34.499525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 1:   N N 
2018-05-15 01:55:34.499674: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1041] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11179 MB memory) -> physical GPU (device: 0, name: TITAN X (Pascal), pci bus id: 0000:02:00.0, compute capability: 6.1)
2018-05-15 01:55:37,013 - Restoring parameters from ../../resnet_cifar100/model_2/model.ckpt-156280
2018-05-15 01:55:37,373 -  conv2d_w
2018-05-15 01:55:37,373 -  conv2d_w_1
2018-05-15 01:55:37,373 -  batch_normalization_offset
2018-05-15 01:55:37,373 -  batch_normalization_scales
2018-05-15 01:55:37,373 -  conv2d_w_2
2018-05-15 01:55:37,373 -  batch_normalization_offset_1
2018-05-15 01:55:37,373 -  batch_normalization_scales_1
2018-05-15 01:55:37,373 -  conv2d_w_3
2018-05-15 01:55:37,373 -  batch_normalization_offset_2
2018-05-15 01:55:37,373 -  batch_normalization_scales_2
2018-05-15 01:55:37,373 -  conv2d_w_4
2018-05-15 01:55:37,373 -  batch_normalization_offset_3
2018-05-15 01:55:37,373 -  batch_normalization_scales_3
2018-05-15 01:55:37,373 -  conv2d_w_5
2018-05-15 01:55:37,373 -  batch_normalization_offset_4
2018-05-15 01:55:37,373 -  batch_normalization_scales_4
2018-05-15 01:55:37,373 -  conv2d_w_6
2018-05-15 01:55:37,373 -  batch_normalization_offset_5
2018-05-15 01:55:37,373 -  batch_normalization_scales_5
2018-05-15 01:55:37,373 -  conv2d_w_7
2018-05-15 01:55:37,374 -  batch_normalization_offset_6
2018-05-15 01:55:37,374 -  batch_normalization_scales_6
2018-05-15 01:55:37,374 -  conv2d_w_8
2018-05-15 01:55:37,374 -  batch_normalization_offset_7
2018-05-15 01:55:37,374 -  batch_normalization_scales_7
2018-05-15 01:55:37,374 -  conv2d_w_9
2018-05-15 01:55:37,374 -  batch_normalization_offset_8
2018-05-15 01:55:37,374 -  batch_normalization_scales_8
2018-05-15 01:55:37,374 -  conv2d_w_10
2018-05-15 01:55:37,374 -  batch_normalization_offset_9
2018-05-15 01:55:37,374 -  batch_normalization_scales_9
2018-05-15 01:55:37,374 -  conv2d_w_11
2018-05-15 01:55:37,374 -  batch_normalization_offset_10
2018-05-15 01:55:37,374 -  batch_normalization_scales_10
2018-05-15 01:55:37,374 -  conv2d_w_12
2018-05-15 01:55:37,374 -  batch_normalization_offset_11
2018-05-15 01:55:37,374 -  batch_normalization_scales_11
2018-05-15 01:55:37,374 -  conv2d_w_13
2018-05-15 01:55:37,374 -  batch_normalization_offset_12
2018-05-15 01:55:37,374 -  batch_normalization_scales_12
2018-05-15 01:55:37,374 -  conv2d_w_14
2018-05-15 01:55:37,374 -  batch_normalization_offset_13
2018-05-15 01:55:37,374 -  batch_normalization_scales_13
2018-05-15 01:55:37,374 -  conv2d_w_15
2018-05-15 01:55:37,374 -  batch_normalization_offset_14
2018-05-15 01:55:37,374 -  batch_normalization_scales_14
2018-05-15 01:55:37,374 -  conv2d_w_16
2018-05-15 01:55:37,374 -  batch_normalization_offset_15
2018-05-15 01:55:37,374 -  batch_normalization_scales_15
2018-05-15 01:55:37,374 -  conv2d_w_17
2018-05-15 01:55:37,374 -  batch_normalization_offset_16
2018-05-15 01:55:37,375 -  batch_normalization_scales_16
2018-05-15 01:55:37,375 -  conv2d_w_18
2018-05-15 01:55:37,375 -  batch_normalization_offset_17
2018-05-15 01:55:37,375 -  batch_normalization_scales_17
2018-05-15 01:55:37,375 -  conv2d_w_19
2018-05-15 01:55:37,375 -  batch_normalization_offset_18
2018-05-15 01:55:37,375 -  batch_normalization_scales_18
2018-05-15 01:55:37,375 -  conv2d_w_20
2018-05-15 01:55:37,375 -  batch_normalization_offset_19
2018-05-15 01:55:37,375 -  batch_normalization_scales_19
2018-05-15 01:55:37,375 -  conv2d_w_21
2018-05-15 01:55:37,375 -  batch_normalization_offset_20
2018-05-15 01:55:37,375 -  batch_normalization_scales_20
2018-05-15 01:55:37,375 -  conv2d_w_22
2018-05-15 01:55:37,375 -  batch_normalization_offset_21
2018-05-15 01:55:37,375 -  batch_normalization_scales_21
2018-05-15 01:55:37,375 -  conv2d_w_23
2018-05-15 01:55:37,375 -  batch_normalization_offset_22
2018-05-15 01:55:37,375 -  batch_normalization_scales_22
2018-05-15 01:55:37,375 -  conv2d_w_24
2018-05-15 01:55:37,375 -  batch_normalization_offset_23
2018-05-15 01:55:37,375 -  batch_normalization_scales_23
2018-05-15 01:55:37,375 -  conv2d_w_25
2018-05-15 01:55:37,375 -  batch_normalization_offset_24
2018-05-15 01:55:37,375 -  batch_normalization_scales_24
2018-05-15 01:55:37,375 -  conv2d_w_26
2018-05-15 01:55:37,375 -  batch_normalization_offset_25
2018-05-15 01:55:37,375 -  batch_normalization_scales_25
2018-05-15 01:55:37,375 -  conv2d_w_27
2018-05-15 01:55:37,375 -  batch_normalization_offset_26
2018-05-15 01:55:37,375 -  batch_normalization_scales_26
2018-05-15 01:55:37,376 -  conv2d_w_28
2018-05-15 01:55:37,376 -  batch_normalization_offset_27
2018-05-15 01:55:37,376 -  batch_normalization_scales_27
2018-05-15 01:55:37,376 -  conv2d_w_29
2018-05-15 01:55:37,376 -  batch_normalization_offset_28
2018-05-15 01:55:37,376 -  batch_normalization_scales_28
2018-05-15 01:55:37,376 -  conv2d_w_30
2018-05-15 01:55:37,376 -  batch_normalization_offset_29
2018-05-15 01:55:37,376 -  batch_normalization_scales_29
2018-05-15 01:55:37,376 -  conv2d_w_31
2018-05-15 01:55:37,376 -  batch_normalization_offset_30
2018-05-15 01:55:37,376 -  batch_normalization_scales_30
2018-05-15 01:55:37,376 -  conv2d_w_32
2018-05-15 01:55:37,376 -  batch_normalization_offset_31
2018-05-15 01:55:37,376 -  batch_normalization_scales_31
2018-05-15 01:55:37,376 -  conv2d_w_33
2018-05-15 01:55:37,376 -  batch_normalization_offset_32
2018-05-15 01:55:37,376 -  batch_normalization_scales_32
2018-05-15 01:55:37,376 -  batch_normalization_offset_33
2018-05-15 01:55:37,376 -  batch_normalization_scales_33
2018-05-15 01:55:37,376 -  final_dense/fcl_weights
2018-05-15 01:55:37,376 -  fcl_biases
2018-05-15 01:55:37.488074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1394] Ignoring visible gpu device (device: 1, name: GeForce GTX 660 Ti, pci bus id: 0000:01:00.0, compute capability: 3.0) with Cuda compute capability 3.0. The minimum required Cuda capability is 3.5.
2018-05-15 01:55:37.488095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1423] Adding visible gpu devices: 0
2018-05-15 01:55:37.488120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:911] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-05-15 01:55:37.488125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:917]      0 1 
2018-05-15 01:55:37.488130: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 0:   N N 
2018-05-15 01:55:37.488133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:930] 1:   N N 
2018-05-15 01:55:37.488233: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1041] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11179 MB memory) -> physical GPU (device: 0, name: TITAN X (Pascal), pci bus id: 0000:02:00.0, compute capability: 6.1)
2018-05-15 01:56:07,411 - sgd
2018-05-15 01:56:46,619 - step 0     .   c=0.06938145 d(w0,w1)=0.11036328 d(w0,w_avg)=0.11036328 t=2.35801339 c0=1.72033861 c1=1.72070680 c_avg=1.72070680 a0=0.63750000 a1=0.63720000 a_avg=0.63720000 a_avg-a0=-0.00030000
2018-05-15 01:56:46,619 - step 0     .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 01:56:46,619 - step 0     .  eig1:   [   -0.0030    +0.1349    -0.2505    -0.6382    +0.7550    -0.9886    +1.5663    +2.3744    +3.4557    +4.3722]
2018-05-15 01:56:46,619 - step 0     .  eig_avg:[   -0.0035    +0.1266    -0.2579    -0.6482    +0.7567    -1.1651    +1.5852    +2.3925    +3.4558    +4.2733]
2018-05-15 01:57:48,581 - step 500   .   c=0.22160953 d(w0,w1)=24.31311035 d(w0,w_avg)=13.14036655 t=69.10028386 c0=1.72033861 c1=1.78423100 c_avg=1.69333541 a0=0.63750000 a1=0.61930000 a_avg=0.63800000 a_avg-a0=0.00050000
2018-05-15 01:57:48,581 - step 500   .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 01:57:48,581 - step 500   .  eig1:   [   -0.0009    +0.2655    -0.2776    -0.8720    +1.2293    -1.5705    -2.1752    +2.2492    +3.4009    +4.4816]
2018-05-15 01:57:48,581 - step 500   .  eig_avg:[   -0.0040    +0.1479    -0.3016    -0.8276    +0.8449    -1.3079    -1.7266    +1.7744    +2.6586    +3.5929]
2018-05-15 01:58:51,647 - step 1000  .   c=0.25812602 d(w0,w1)=31.63500404 d(w0,w_avg)=17.77311325 t=62.58401036 c0=1.72033861 c1=1.74844295 c_avg=1.66084360 a0=0.63750000 a1=0.62040000 a_avg=0.64100000 a_avg-a0=0.00350000
2018-05-15 01:58:51,647 - step 1000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 01:58:51,647 - step 1000  .  eig1:   [   -0.0026    +0.1903    -0.2634    -0.7492    +0.9391    -1.2744    -1.5992    +1.8031    +2.7257    +3.6535]
2018-05-15 01:58:51,647 - step 1000  .  eig_avg:[   +0.0117    -0.0628    +0.4263    -0.4574    -0.8391    -1.1756    +1.1840    +1.9161    +2.9064    +3.5946]
2018-05-15 01:59:54,934 - step 1500  .   c=0.19849750 d(w0,w1)=36.84613800 d(w0,w_avg)=20.92074966 t=63.13342524 c0=1.72033861 c1=1.74214813 c_avg=1.64149558 a0=0.63750000 a1=0.62080000 a_avg=0.64330000 a_avg-a0=0.00580000
2018-05-15 01:59:54,935 - step 1500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 01:59:54,935 - step 1500  .  eig1:   [   +0.0114    -0.0952    +0.4564    -0.5796    -1.1089    +1.4331    -1.6053    +2.3683    +3.4040    +4.4578]
2018-05-15 01:59:54,935 - step 1500  .  eig_avg:[   +0.0140    -0.0497    +0.4243    -0.4343    -0.8329    +1.1636    -1.3550    +1.9642    +2.7989    +3.6650]
2018-05-15 02:00:58,015 - step 2000  .   c=0.24448299 d(w0,w1)=40.82098389 d(w0,w_avg)=23.46255112 t=63.58556867 c0=1.72033861 c1=1.75376615 c_avg=1.63366876 a0=0.63750000 a1=0.61890000 a_avg=0.64320000 a_avg-a0=0.00570000
2018-05-15 02:00:58,015 - step 2000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:00:58,015 - step 2000  .  eig1:   [   -0.0001    -0.2339    +0.2526    -0.7831    +1.1053    -1.3051    -2.0668    +2.1237    +3.2107    +4.1697]
2018-05-15 02:00:58,015 - step 2000  .  eig_avg:[   +0.0148    -0.0425    -0.3947    +0.4066    -0.7972    +1.1188    -1.2172    +1.8696    +2.6123    +3.5687]
2018-05-15 02:02:00,058 - step 2500  .   c=0.27675769 d(w0,w1)=44.41772079 d(w0,w_avg)=25.63316917 t=62.47517323 c0=1.72033861 c1=1.73655044 c_avg=1.62757462 a0=0.63750000 a1=0.62640000 a_avg=0.64410000 a_avg-a0=0.00660000
2018-05-15 02:02:00,058 - step 2500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:02:00,058 - step 2500  .  eig1:   [   +0.0004    -0.2044    +0.2412    -0.6843    +1.0172    -1.1628    -1.7913    +1.8790    +2.7847    +3.6578]
2018-05-15 02:02:00,058 - step 2500  .  eig_avg:[   +0.0073    -0.0728    +0.3389    -0.4337    -0.8982    +1.0246    -1.3438    +1.7772    +2.6039    +3.4417]
2018-05-15 02:03:01,724 - step 3000  .   c=0.26917940 d(w0,w1)=47.72277069 d(w0,w_avg)=27.57321930 t=61.68322015 c0=1.72033861 c1=1.76384939 c_avg=1.62449416 a0=0.63750000 a1=0.62030000 a_avg=0.64390000 a_avg-a0=0.00640000
2018-05-15 02:03:01,724 - step 3000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:03:01,724 - step 3000  .  eig1:   [   +0.0250    -0.0450    -0.5130    +0.5867    -1.0278    +1.4174    -1.5524    +2.3862    +3.3207    -3.6637]
2018-05-15 02:03:01,724 - step 3000  .  eig_avg:[   +0.0098    -0.0558    +0.3669    -0.4002    -0.9341    +1.0678    -1.2746    +1.7889    +2.5832    +3.4576]
2018-05-15 02:04:03,821 - step 3500  .   c=0.22162375 d(w0,w1)=50.74367905 d(w0,w_avg)=29.35497284 t=61.93744588 c0=1.72033861 c1=1.75494844 c_avg=1.62370359 a0=0.63750000 a1=0.61870000 a_avg=0.64410000 a_avg-a0=0.00660000
2018-05-15 02:04:03,821 - step 3500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:04:03,821 - step 3500  .  eig1:   [   -0.0024    +0.1942    -0.2723    -0.7640    +1.0041    -1.2757    +1.8997    +3.0545    -3.9378    +4.0677]
2018-05-15 02:04:03,821 - step 3500  .  eig_avg:[   +0.0042    -0.1029    +0.2952    -0.4894    -1.0032    +1.0104    -1.3323    +1.6822    +2.4769    +3.3392]
2018-05-15 02:05:06,070 - step 4000  .   c=0.22768152 d(w0,w1)=53.53450775 d(w0,w_avg)=31.00089645 t=62.30114508 c0=1.72033861 c1=1.77181092 c_avg=1.62133243 a0=0.63750000 a1=0.62460000 a_avg=0.64630000 a_avg-a0=0.00880000
2018-05-15 02:05:06,070 - step 4000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:05:06,070 - step 4000  .  eig1:   [   +0.0071    -0.1220    +0.4478    -0.6689    -1.3917    +1.4649    -1.7012    +2.4870    +3.6552    +4.7069]
2018-05-15 02:05:06,071 - step 4000  .  eig_avg:[   +0.0051    -0.0863    +0.2932    -0.4474    -0.8215    +0.9433    -1.0692    +1.6321    +2.3805    +3.1040]
2018-05-15 02:06:08,433 - step 4500  .   c=0.20778826 d(w0,w1)=56.41680908 d(w0,w_avg)=32.55428314 t=62.14765310 c0=1.72033861 c1=1.76434593 c_avg=1.62084152 a0=0.63750000 a1=0.62700000 a_avg=0.64660000 a_avg-a0=0.00910000
2018-05-15 02:06:08,433 - step 4500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:06:08,433 - step 4500  .  eig1:   [   +0.0007    -0.1960    +0.2423    -0.6798    +0.9920    -1.1237    -1.6290    +1.7805    +2.7005    +3.7101]
2018-05-15 02:06:08,433 - step 4500  .  eig_avg:[   -0.0188    +0.0278    -0.3244    +0.4293    -0.6542    -1.0416    +1.1010    +1.8699    +2.5479    +3.3453]
2018-05-15 02:07:10,759 - step 5000  .   c=0.12606040 d(w0,w1)=59.22668457 d(w0,w_avg)=34.06221390 t=62.43014956 c0=1.72033861 c1=1.77359994 c_avg=1.62127874 a0=0.63750000 a1=0.62530000 a_avg=0.64660000 a_avg-a0=0.00910000
2018-05-15 02:07:10,759 - step 5000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:07:10,759 - step 5000  .  eig1:   [   +0.0037    -0.1432    +0.3159    -0.6311    +1.1254    -1.1783    -1.4033    +1.9854    +2.9368    +3.9483]
2018-05-15 02:07:10,759 - step 5000  .  eig_avg:[   -0.0078    +0.0585    -0.2558    +0.5056    -0.5516    -0.8490    +1.1008    +1.8085    +2.6106    +3.3024]
2018-05-15 02:08:13,148 - step 5500  .   c=0.19367240 d(w0,w1)=61.65911865 d(w0,w_avg)=35.52005768 t=62.41860104 c0=1.72033861 c1=1.79791347 c_avg=1.62151478 a0=0.63750000 a1=0.61870000 a_avg=0.64670000 a_avg-a0=0.00920000
2018-05-15 02:08:13,148 - step 5500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:08:13,148 - step 5500  .  eig1:   [   +0.0011    -0.1870    +0.2515    -0.6842    +0.9954    -1.1944    -1.4700    +1.9211    +2.8227    +3.6939]
2018-05-15 02:08:13,148 - step 5500  .  eig_avg:[   -0.0041    +0.0860    -0.2087    -0.4915    +0.5340    -0.7940    +1.1595    +1.8246    +2.5657    +3.3290]
2018-05-15 02:09:15,454 - step 6000  .   c=0.17064056 d(w0,w1)=64.22423553 d(w0,w_avg)=36.93142700 t=62.40765977 c0=1.72033861 c1=1.79547788 c_avg=1.62454313 a0=0.63750000 a1=0.62300000 a_avg=0.64630000 a_avg-a0=0.00880000
2018-05-15 02:09:15,454 - step 6000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:09:15,454 - step 6000  .  eig1:   [   -0.0199    +0.0422    -0.3606    +0.5278    -0.7366    -0.9756    +1.3338    +2.1656    +2.9289    +3.8329]
2018-05-15 02:09:15,454 - step 6000  .  eig_avg:[   +0.0141    -0.0335    -0.3438    +0.3602    -0.7222    -0.8922    +0.9738    +1.6199    +2.3090    +3.0267]
2018-05-15 02:10:17,983 - step 6500  .   c=0.17915960 d(w0,w1)=66.58415222 d(w0,w_avg)=38.29165649 t=62.22742033 c0=1.72033861 c1=1.80762837 c_avg=1.62692816 a0=0.63750000 a1=0.62400000 a_avg=0.64730000 a_avg-a0=0.00980000
2018-05-15 02:10:17,983 - step 6500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:10:17,983 - step 6500  .  eig1:   [   -0.0035    +0.1428    -0.2548    -0.6799    +0.7651    -0.9997    +1.5796    +2.4254    -2.6937    +3.2782]
2018-05-15 02:10:17,983 - step 6500  .  eig_avg:[   -0.0151    +0.0301    -0.2871    +0.4062    -0.5913    -0.8598    +1.0507    +1.6321    +2.3221    +3.0200]
2018-05-15 02:11:20,348 - step 7000  .   c=0.14056495 d(w0,w1)=69.14558411 d(w0,w_avg)=39.63713837 t=62.41708374 c0=1.72033861 c1=1.80798885 c_avg=1.62914368 a0=0.63750000 a1=0.62500000 a_avg=0.64900000 a_avg-a0=0.01150000
2018-05-15 02:11:20,348 - step 7000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:11:20,349 - step 7000  .  eig1:   [   +0.0071    -0.1010    +0.3932    -0.5767    -1.0593    +1.1910    -1.3608    +2.0728    +2.9510    +4.0229]
2018-05-15 02:11:20,349 - step 7000  .  eig_avg:[   -0.0068    +0.0581    -0.2401    +0.4690    -0.5285    -0.7475    +1.0768    +1.6582    +2.4107    +3.2041]
2018-05-15 02:12:22,838 - step 7500  .   c=0.12920839 d(w0,w1)=71.59810638 d(w0,w_avg)=40.95260620 t=62.54302168 c0=1.72033861 c1=1.85099879 c_avg=1.63182992 a0=0.63750000 a1=0.62400000 a_avg=0.64880000 a_avg-a0=0.01130000
2018-05-15 02:12:22,838 - step 7500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:12:22,838 - step 7500  .  eig1:   [   -0.0090    +0.0872    -0.3791    +0.8066    -0.9055    -1.4679    +1.8835    +2.9682    +4.0065    +5.1100]
2018-05-15 02:12:22,839 - step 7500  .  eig_avg:[   +0.0163    -0.0278    -0.3334    +0.3774    -0.6713    -0.9119    +0.9990    +1.6451    +2.3917    +3.0003]
2018-05-15 02:13:25,349 - step 8000  .   c=0.18349680 d(w0,w1)=73.70211792 d(w0,w_avg)=42.23596191 t=62.55671668 c0=1.72033861 c1=1.82868623 c_avg=1.63392948 a0=0.63750000 a1=0.62500000 a_avg=0.64920000 a_avg-a0=0.01170000
2018-05-15 02:13:25,349 - step 8000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:13:25,349 - step 8000  .  eig1:   [   -0.0019    +0.1773    -0.2419    -0.7039    +0.8900    -1.2454    -1.6836    +1.7893    +2.5814    +3.5717]
2018-05-15 02:13:25,349 - step 8000  .  eig_avg:[   +0.0122    -0.0355    -0.3556    +0.3639    -0.6514    +0.9789    -0.9985    +1.5947    +2.3187    +3.0639]
2018-05-15 02:14:27,613 - step 8500  .   c=0.24882191 d(w0,w1)=76.11583710 d(w0,w_avg)=43.50617218 t=62.23026800 c0=1.72033861 c1=1.85237818 c_avg=1.63645638 a0=0.63750000 a1=0.62400000 a_avg=0.64820000 a_avg-a0=0.01070000
2018-05-15 02:14:27,613 - step 8500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:14:27,614 - step 8500  .  eig1:   [   +0.0083    -0.0887    +0.3869    -0.5227    -0.9827    +1.1521    -1.2523    +2.0392    +2.9577    +3.7774]
2018-05-15 02:14:27,614 - step 8500  .  eig_avg:[   -0.0074    +0.0527    -0.2518    +0.4650    -0.5525    -0.8297    +1.0911    +1.7781    +2.4483    +3.1099]
2018-05-15 02:15:29,787 - step 9000  .   c=0.21653308 d(w0,w1)=78.43393707 d(w0,w_avg)=44.75760651 t=62.33272457 c0=1.72033861 c1=1.84161753 c_avg=1.63860716 a0=0.63750000 a1=0.62420000 a_avg=0.64820000 a_avg-a0=0.01070000
2018-05-15 02:15:29,787 - step 9000  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:15:29,787 - step 9000  .  eig1:   [   +0.0071    -0.0859    +0.3637    -0.4925    -0.9046    +1.1065    -1.1630    +1.9465    +2.6940    +3.5543]
2018-05-15 02:15:29,787 - step 9000  .  eig_avg:[   +0.0179    -0.0241    -0.3357    +0.4032    -0.6635    -0.9073    +1.0252    +1.7214    +2.4433    +3.1380]
2018-05-15 02:16:32,206 - step 9500  .   c=0.25143400 d(w0,w1)=80.80551910 d(w0,w_avg)=45.99914169 t=62.19749403 c0=1.72033861 c1=1.89714348 c_avg=1.64121631 a0=0.63750000 a1=0.61690000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:16:32,206 - step 9500  .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:16:32,206 - step 9500  .  eig1:   [   +0.0007    -0.1789    +0.2271    -0.6265    +0.9512    -1.1653    -1.6159    +1.7734    +2.5852    +3.5349]
2018-05-15 02:16:32,206 - step 9500  .  eig_avg:[   -0.0130    +0.0327    -0.2953    +0.4591    -0.6694    -0.9704    +1.0944    +1.7636    +2.4418    +3.1722]
2018-05-15 02:17:34,572 - step 10000 .   c=0.15655228 d(w0,w1)=82.91296387 d(w0,w_avg)=47.22396851 t=62.46639729 c0=1.72033861 c1=1.85057068 c_avg=1.64451320 a0=0.63750000 a1=0.62600000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:17:34,572 - step 10000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:17:34,572 - step 10000 .  eig1:   [   +0.0020    -0.1628    +0.2683    -0.6288    +0.9872    -1.0487    -1.5357    +1.8869    +2.8120    +3.7048]
2018-05-15 02:17:34,572 - step 10000 .  eig_avg:[   +0.0171    -0.0248    -0.3422    +0.4099    -0.8147    -0.9866    +1.0293    +1.7318    +2.5411    +3.2945]
2018-05-15 02:18:37,228 - step 10500 .   c=0.20296316 d(w0,w1)=84.98845673 d(w0,w_avg)=48.43273544 t=62.49992490 c0=1.72033861 c1=1.86706025 c_avg=1.64790067 a0=0.63750000 a1=0.62620000 a_avg=0.64950000 a_avg-a0=0.01200000
2018-05-15 02:18:37,228 - step 10500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:18:37,228 - step 10500 .  eig1:   [   +0.0041    -0.1253    +0.3207    -0.5725    -1.0199    +1.1366    -1.6491    +1.9690    +2.9072    +3.8288]
2018-05-15 02:18:37,228 - step 10500 .  eig_avg:[   -0.0094    +0.0428    -0.2995    +0.4976    -0.6625    -0.9959    +1.1500    +1.8460    +2.5895    +3.3576]
2018-05-15 02:19:40,025 - step 11000 .   c=0.15057476 d(w0,w1)=87.17318726 d(w0,w_avg)=49.62415695 t=62.87731051 c0=1.72033861 c1=1.86735417 c_avg=1.65150684 a0=0.63750000 a1=0.62920000 a_avg=0.64870000 a_avg-a0=0.01120000
2018-05-15 02:19:40,025 - step 11000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:19:40,025 - step 11000 .  eig1:   [   +0.0029    -0.1434    +0.2997    -0.5971    -1.0585    +1.0656    -1.4908    +1.9100    +2.8775    +3.6891]
2018-05-15 02:19:40,025 - step 11000 .  eig_avg:[   +0.0089    -0.0454    +0.3666    -0.3829    -0.8648    -1.0510    +1.0552    +1.7075    +2.5201    +3.3074]
2018-05-15 02:20:42,664 - step 11500 .   c=0.15156558 d(w0,w1)=89.37004089 d(w0,w_avg)=50.80746460 t=62.50519276 c0=1.72033861 c1=1.90130032 c_avg=1.65507291 a0=0.63750000 a1=0.62520000 a_avg=0.64820000 a_avg-a0=0.01070000
2018-05-15 02:20:42,664 - step 11500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:20:42,664 - step 11500 .  eig1:   [   -0.0099    +0.0640    -0.3258    +0.5960    -0.6725    -1.4176    +1.4196    +2.2357    +3.2619    +4.0523]
2018-05-15 02:20:42,664 - step 11500 .  eig_avg:[   -0.0122    +0.0323    -0.2901    +0.4743    -0.6690    -1.0761    +1.1290    +1.7470    +2.5824    +3.2684]
2018-05-15 02:21:44,963 - step 12000 .   c=0.16707675 d(w0,w1)=91.55797577 d(w0,w_avg)=51.98298264 t=62.57058382 c0=1.72033861 c1=1.89417809 c_avg=1.65865256 a0=0.63750000 a1=0.62430000 a_avg=0.64780000 a_avg-a0=0.01030000
2018-05-15 02:21:44,963 - step 12000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:21:44,963 - step 12000 .  eig1:   [   +0.0040    -0.1202    +0.3144    -0.5660    -1.0553    +1.0782    -1.3326    +1.8884    +2.8377    +3.7260]
2018-05-15 02:21:44,964 - step 12000 .  eig_avg:[   +0.0156    -0.0248    -0.3356    +0.3816    -0.6583    +1.0262    -1.0339    +1.7003    +2.4845    +3.1356]
2018-05-15 02:22:47,407 - step 12500 .   c=0.15951541 d(w0,w1)=93.78407288 d(w0,w_avg)=53.14945221 t=62.40143299 c0=1.72033861 c1=1.90015849 c_avg=1.66247991 a0=0.63750000 a1=0.62070000 a_avg=0.64810000 a_avg-a0=0.01060000
2018-05-15 02:22:47,407 - step 12500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:22:47,407 - step 12500 .  eig1:   [   +0.0015    -0.1580    +0.2480    -0.5558    -0.9044    +1.0262    +1.8205    +2.8551    +3.9577    +5.0036]
2018-05-15 02:22:47,407 - step 12500 .  eig_avg:[   +0.0110    -0.0347    -0.3573    +0.3734    -0.7565    +1.0018    -1.0539    +1.5782    +2.4568    +3.2956]
2018-05-15 02:23:49,785 - step 13000 .   c=0.13861461 d(w0,w1)=95.79575348 d(w0,w_avg)=54.30920792 t=62.38629889 c0=1.72033861 c1=1.89364833 c_avg=1.66595842 a0=0.63750000 a1=0.62530000 a_avg=0.64830000 a_avg-a0=0.01080000
2018-05-15 02:23:49,786 - step 13000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:23:49,786 - step 13000 .  eig1:   [   +0.0139    -0.0457    -0.4354    +0.4595    -0.8766    -1.2168    +1.2188    +2.0454    +2.9234    +3.8532]
2018-05-15 02:23:49,786 - step 13000 .  eig_avg:[   +0.0170    -0.0221    -0.3082    +0.3919    -0.6798    +0.9958    -1.0424    +1.7048    +2.4102    +3.0157]
2018-05-15 02:24:52,349 - step 13500 .   c=0.18412977 d(w0,w1)=97.81687927 d(w0,w_avg)=55.46041107 t=62.34828424 c0=1.72033861 c1=1.89782127 c_avg=1.66885747 a0=0.63750000 a1=0.62090000 a_avg=0.64880000 a_avg-a0=0.01130000
2018-05-15 02:24:52,349 - step 13500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:24:52,349 - step 13500 .  eig1:   [   -0.0006    +0.2005    -0.2107    -0.6606    +0.9429    -1.3701    +1.7865    -2.1619    +2.7118    +3.5606]
2018-05-15 02:24:52,349 - step 13500 .  eig_avg:[   +0.0111    -0.0341    -0.3471    +0.3690    -0.7130    +0.9792    -1.0197    +1.6073    +2.3812    +3.1387]
2018-05-15 02:25:54,863 - step 14000 .   c=0.17972562 d(w0,w1)=99.82933807 d(w0,w_avg)=56.59901428 t=62.65476656 c0=1.72033861 c1=1.92421409 c_avg=1.67237436 a0=0.63750000 a1=0.61830000 a_avg=0.64840000 a_avg-a0=0.01090000
2018-05-15 02:25:54,864 - step 14000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:25:54,864 - step 14000 .  eig1:   [   -0.0097    +0.0620    -0.3376    +0.6269    -0.7325    -1.0573    +1.4674    +2.3746    +3.2028    +4.2360]
2018-05-15 02:25:54,864 - step 14000 .  eig_avg:[   +0.0062    -0.0556    +0.3203    -0.3934    -0.8229    +0.9558    -1.0612    +1.4885    +2.2862    +3.0837]
2018-05-15 02:26:57,593 - step 14500 .   c=0.15229227 d(w0,w1)=101.67967224 d(w0,w_avg)=57.72714615 t=62.61053538 c0=1.72033861 c1=1.96616799 c_avg=1.67531991 a0=0.63750000 a1=0.61850000 a_avg=0.64860000 a_avg-a0=0.01110000
2018-05-15 02:26:57,593 - step 14500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:26:57,593 - step 14500 .  eig1:   [   -0.0127    +0.0581    -0.4075    +0.7010    -0.9325    -1.2157    +1.6461    +2.6074    +3.6568    +4.7411]
2018-05-15 02:26:57,593 - step 14500 .  eig_avg:[   +0.0077    -0.0468    +0.3389    -0.3642    -0.7910    +0.9788    -1.0802    +1.6279    +2.3211    +3.1060]
2018-05-15 02:28:00,208 - step 15000 .   c=0.20776758 d(w0,w1)=103.67300415 d(w0,w_avg)=58.84791946 t=62.69985843 c0=1.72033861 c1=1.93415234 c_avg=1.67802788 a0=0.63750000 a1=0.62520000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:28:00,208 - step 15000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:28:00,208 - step 15000 .  eig1:   [   +0.0133    -0.0487    +0.4592    -0.4725    -0.9075    -1.1912    +1.2843    +2.1537    +3.0188    +3.9909]
2018-05-15 02:28:00,209 - step 15000 .  eig_avg:[   +0.0045    -0.0713    +0.3039    -0.4101    +0.8825    -0.9198    -1.1205    +1.5598    +2.2644    +2.9634]
2018-05-15 02:29:03,137 - step 15500 .   c=0.12479432 d(w0,w1)=105.70240021 d(w0,w_avg)=59.95779800 t=62.54635167 c0=1.72033861 c1=1.93402393 c_avg=1.68140121 a0=0.63750000 a1=0.62340000 a_avg=0.64890000 a_avg-a0=0.01140000
2018-05-15 02:29:03,137 - step 15500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:29:03,137 - step 15500 .  eig1:   [   +0.0241    -0.0301    -0.4190    +0.5159    -0.8705    -1.2910    +1.3366    +2.2169    +3.1102    +4.0398]
2018-05-15 02:29:03,137 - step 15500 .  eig_avg:[   -0.0145    +0.0253    -0.3074    +0.4350    -0.5763    -0.9765    +1.0309    +1.7421    +2.3927    +3.0702]
2018-05-15 02:30:05,722 - step 16000 .   c=0.12405534 d(w0,w1)=107.57173157 d(w0,w_avg)=61.06050491 t=62.90870690 c0=1.72033861 c1=1.92998220 c_avg=1.68455142 a0=0.63750000 a1=0.62270000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:30:05,722 - step 16000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:30:05,722 - step 16000 .  eig1:   [   -0.0021    +0.1704    -0.2494    -0.7404    +0.9423    -1.0073    +1.7910    +2.8651    +3.8415    +4.8414]
2018-05-15 02:30:05,722 - step 16000 .  eig_avg:[   +0.0113    -0.0315    -0.3528    +0.3728    -0.7150    +1.0086    -1.0394    +1.6300    +2.4222    +3.1719]
2018-05-15 02:31:08,489 - step 16500 .   c=0.17458430 d(w0,w1)=109.58728790 d(w0,w_avg)=62.15574646 t=62.54971147 c0=1.72033861 c1=1.96444941 c_avg=1.68779067 a0=0.63750000 a1=0.61990000 a_avg=0.64990000 a_avg-a0=0.01240000
2018-05-15 02:31:08,489 - step 16500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:31:08,489 - step 16500 .  eig1:   [   -0.0039    +0.1134    -0.2671    -0.6869    +0.7032    -1.0093    +1.5823    +2.3728    +3.4362    +4.2807]
2018-05-15 02:31:08,489 - step 16500 .  eig_avg:[   -0.0177    +0.0209    -0.3222    +0.4293    -0.6409    -1.0689    +1.0773    +1.7206    +2.5101    +3.1862]
2018-05-15 02:32:11,084 - step 17000 .   c=0.14938165 d(w0,w1)=111.50223541 d(w0,w_avg)=63.24291992 t=62.80612445 c0=1.72033861 c1=1.99279607 c_avg=1.69124054 a0=0.63750000 a1=0.62000000 a_avg=0.64950000 a_avg-a0=0.01200000
2018-05-15 02:32:11,084 - step 17000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:32:11,084 - step 17000 .  eig1:   [   -0.0089    +0.0630    -0.2848    +0.5570    -0.6159    -0.8941    +1.2531    +1.9688    +2.6583    +3.4434]
2018-05-15 02:32:11,084 - step 17000 .  eig_avg:[   +0.0166    -0.0219    -0.3302    +0.3975    -0.7119    +1.0450    -1.1335    +1.7211    +2.4313    +3.0542]
2018-05-15 02:33:13,557 - step 17500 .   c=0.12146550 d(w0,w1)=113.22102356 d(w0,w_avg)=64.31936646 t=62.49869347 c0=1.72033861 c1=1.96565332 c_avg=1.69458592 a0=0.63750000 a1=0.62550000 a_avg=0.64890000 a_avg-a0=0.01140000
2018-05-15 02:33:13,557 - step 17500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:33:13,557 - step 17500 .  eig1:   [   -0.0139    +0.0481    -0.3662    +0.5896    -0.7951    -1.1417    +1.3744    +2.2859    +3.2509    +4.0469]
2018-05-15 02:33:13,557 - step 17500 .  eig_avg:[   +0.0125    -0.0290    -0.3561    +0.4067    -0.8928    -1.0235    +1.0415    +1.7256    +2.4660    +3.1906]
2018-05-15 02:34:15,797 - step 18000 .   c=0.12334640 d(w0,w1)=115.07244873 d(w0,w_avg)=65.38751221 t=62.44810843 c0=1.72033861 c1=1.96207536 c_avg=1.69789024 a0=0.63750000 a1=0.62470000 a_avg=0.64930000 a_avg-a0=0.01180000
2018-05-15 02:34:15,798 - step 18000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:34:15,798 - step 18000 .  eig1:   [   -0.0030    +0.1504    -0.3002    -0.8328    +0.9032    -1.7637    +1.9189    -2.1092    +2.7960    +3.8641]
2018-05-15 02:34:15,798 - step 18000 .  eig_avg:[   +0.0126    -0.0289    -0.3540    +0.4003    -0.7804    +1.0706    -1.1191    +1.7082    +2.4068    +3.5019]
2018-05-15 02:35:18,111 - step 18500 .   c=0.19387287 d(w0,w1)=116.82093048 d(w0,w_avg)=66.44605255 t=62.20568275 c0=1.72033861 c1=1.94077500 c_avg=1.70080212 a0=0.63750000 a1=0.62810000 a_avg=0.64870000 a_avg-a0=0.01120000
2018-05-15 02:35:18,111 - step 18500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:35:18,111 - step 18500 .  eig1:   [   -0.0091    +0.0734    -0.3763    +0.7287    -0.8556    -1.2329    +1.6354    +2.7554    +3.5737    +4.7746]
2018-05-15 02:35:18,111 - step 18500 .  eig_avg:[   -0.0183    +0.0199    -0.3282    +0.4571    -0.8062    -1.1137    +1.1706    +1.8023    +2.4991    +3.3473]
2018-05-15 02:36:20,347 - step 19000 .   c=0.10859858 d(w0,w1)=118.64722443 d(w0,w_avg)=67.49626923 t=62.38852143 c0=1.72033861 c1=1.99533609 c_avg=1.70407625 a0=0.63750000 a1=0.62150000 a_avg=0.64890000 a_avg-a0=0.01140000
2018-05-15 02:36:20,347 - step 19000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:36:20,347 - step 19000 .  eig1:   [   +0.0024    -0.1571    +0.3136    -0.6285    +1.2067    -1.5232    -1.8580    +2.1697    +3.1990    +4.2087]
2018-05-15 02:36:20,347 - step 19000 .  eig_avg:[   -0.0106    +0.0333    -0.3071    +0.5046    -0.7236    -1.0342    +1.1623    +1.8569    +2.7095    +3.4130]
2018-05-15 02:37:22,894 - step 19500 .   c=0.13050355 d(w0,w1)=120.52445984 d(w0,w_avg)=68.53849792 t=62.30998921 c0=1.72033861 c1=1.95087403 c_avg=1.70705009 a0=0.63750000 a1=0.63060000 a_avg=0.64880000 a_avg-a0=0.01130000
2018-05-15 02:37:22,894 - step 19500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:37:22,894 - step 19500 .  eig1:   [   -0.0007    +0.1877    -0.2064    -0.6031    +0.9056    -0.9301    +1.7635    +2.7064    +3.7645    +4.7217]
2018-05-15 02:37:22,894 - step 19500 .  eig_avg:[   -0.0035    +0.0783    -0.2226    +0.5387    -0.5593    -0.9184    +1.2152    +1.8512    +2.7010    +3.4317]
2018-05-15 02:38:25,274 - step 20000 .   c=0.08066446 d(w0,w1)=122.26660919 d(w0,w_avg)=69.57529449 t=62.52933931 c0=1.72033861 c1=1.99169463 c_avg=1.70993860 a0=0.63750000 a1=0.62070000 a_avg=0.64860000 a_avg-a0=0.01110000
2018-05-15 02:38:25,274 - step 20000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:38:25,274 - step 20000 .  eig1:   [   +0.0062    -0.0714    +0.3858    -0.4834    -0.8639    +1.1082    -1.4045    +1.9234    +2.7366    +3.6563]
2018-05-15 02:38:25,274 - step 20000 .  eig_avg:[   -0.0005    +0.1383    -0.1566    -0.4495    +0.6635    -0.7878    +1.3018    +2.0423    +2.7528    +3.4928]
2018-05-15 02:39:27,697 - step 20500 .   c=0.15927160 d(w0,w1)=124.06344604 d(w0,w_avg)=70.60398865 t=62.32260466 c0=1.72033861 c1=2.00574614 c_avg=1.71334590 a0=0.63750000 a1=0.62610000 a_avg=0.64830000 a_avg-a0=0.01080000
2018-05-15 02:39:27,697 - step 20500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:39:27,697 - step 20500 .  eig1:   [   -0.0010    +0.1762    -0.2192    -0.6218    +0.9201    -1.0644    +1.8123    +2.8725    +3.6056    +4.6894]
2018-05-15 02:39:27,697 - step 20500 .  eig_avg:[   -0.0011    +0.1207    -0.1676    -0.4500    +0.6281    -0.8359    +1.3118    +1.9532    +2.7471    +3.5067]
2018-05-15 02:40:29,952 - step 21000 .   c=0.24663925 d(w0,w1)=125.69811249 d(w0,w_avg)=71.62468719 t=62.44176865 c0=1.72033861 c1=2.02599745 c_avg=1.71670584 a0=0.63750000 a1=0.61890000 a_avg=0.64870000 a_avg-a0=0.01120000
2018-05-15 02:40:29,952 - step 21000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:40:29,952 - step 21000 .  eig1:   [   -0.0144    +0.0446    -0.3931    +0.6401    -0.9100    -1.5520    +1.5711    +2.5576    +3.6574    +4.7018]
2018-05-15 02:40:29,952 - step 21000 .  eig_avg:[   -0.0013    +0.1195    -0.1802    -0.5089    +0.6598    -0.8471    +1.2831    +2.0367    +2.7606    +3.5678]
2018-05-15 02:41:32,466 - step 21500 .   c=0.11358730 d(w0,w1)=127.47541809 d(w0,w_avg)=72.63939667 t=62.36739969 c0=1.72033861 c1=2.01346816 c_avg=1.71992420 a0=0.63750000 a1=0.62050000 a_avg=0.64860000 a_avg-a0=0.01110000
2018-05-15 02:41:32,466 - step 21500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:41:32,466 - step 21500 .  eig1:   [   -0.0135    +0.0328    -0.3354    +0.5116    -0.6446    +1.2700    -1.7522    +1.9858    +3.0056    +3.7719]
2018-05-15 02:41:32,466 - step 21500 .  eig_avg:[   -0.0029    +0.0845    -0.2182    -0.5809    +0.5892    -0.8453    +1.2577    +1.9700    +2.6750    +3.3450]
2018-05-15 02:42:35,032 - step 22000 .   c=0.14114584 d(w0,w1)=129.25831604 d(w0,w_avg)=73.64997101 t=62.42292690 c0=1.72033861 c1=1.97600236 c_avg=1.72287141 a0=0.63750000 a1=0.62690000 a_avg=0.64820000 a_avg-a0=0.01070000
2018-05-15 02:42:35,033 - step 22000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:42:35,033 - step 22000 .  eig1:   [   -0.0075    +0.0836    -0.3632    +0.7482    -0.8068    -1.3711    +1.7076    +2.6218    +3.7563    +4.7264]
2018-05-15 02:42:35,033 - step 22000 .  eig_avg:[   -0.0029    +0.0825    -0.2184    -0.5833    +0.5971    -0.9160    +1.2264    +2.0004    +2.6061    +3.4978]
2018-05-15 02:43:37,392 - step 22500 .   c=0.10016011 d(w0,w1)=130.95039368 d(w0,w_avg)=74.65354919 t=62.55207062 c0=1.72033861 c1=1.99603254 c_avg=1.72554367 a0=0.63750000 a1=0.62720000 a_avg=0.64880000 a_avg-a0=0.01130000
2018-05-15 02:43:37,392 - step 22500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:43:37,392 - step 22500 .  eig1:   [   +0.0087    -0.0628    +0.4349    -0.4793    -1.1193    +1.2616    -1.4134    +2.2056    +3.1250    +3.9706]
2018-05-15 02:43:37,392 - step 22500 .  eig_avg:[   -0.0024    +0.0957    -0.2082    -0.5841    +0.6200    -0.8757    +1.2556    +1.9559    +2.6895    +3.6314]
2018-05-15 02:44:39,946 - step 23000 .   c=0.13732222 d(w0,w1)=132.61010742 d(w0,w_avg)=75.64914703 t=62.50685215 c0=1.72033861 c1=2.02940990 c_avg=1.72855327 a0=0.63750000 a1=0.62370000 a_avg=0.64930000 a_avg-a0=0.01180000
2018-05-15 02:44:39,946 - step 23000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:44:39,946 - step 23000 .  eig1:   [   +0.0026    -0.1314    +0.3194    -0.6084    +1.1123    -1.1888    -1.5802    +2.1134    +2.9012    +4.0333]
2018-05-15 02:44:39,946 - step 23000 .  eig_avg:[   -0.0016    +0.1104    -0.1868    -0.5517    +0.6338    -0.8575    +1.2729    +2.0367    +2.9546    +3.6557]
2018-05-15 02:45:42,542 - step 23500 .   c=0.09151237 d(w0,w1)=134.12606812 d(w0,w_avg)=76.63710022 t=62.52034807 c0=1.72033861 c1=2.01693710 c_avg=1.73203475 a0=0.63750000 a1=0.62000000 a_avg=0.64890000 a_avg-a0=0.01140000
2018-05-15 02:45:42,542 - step 23500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:45:42,542 - step 23500 .  eig1:   [   +0.0019    -0.1360    +0.2540    -0.5135    +1.0175    -1.0362    +1.9772    +2.8884    +3.7816    +4.9038]
2018-05-15 02:45:42,542 - step 23500 .  eig_avg:[   -0.0019    +0.1041    -0.2023    -0.5610    +0.6420    -0.8513    +1.2962    +2.1395    +2.7724    +3.6441]
2018-05-15 02:46:45,103 - step 24000 .   c=0.11807438 d(w0,w1)=135.72976685 d(w0,w_avg)=77.61847687 t=62.55532670 c0=1.72033861 c1=2.05836373 c_avg=1.73540460 a0=0.63750000 a1=0.62280000 a_avg=0.64930000 a_avg-a0=0.01180000
2018-05-15 02:46:45,103 - step 24000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:46:45,103 - step 24000 .  eig1:   [   +0.0210    -0.0252    -0.3898    +0.4767    -0.8031    -1.0309    +1.2364    +2.0507    +2.8549    +3.7202]
2018-05-15 02:46:45,103 - step 24000 .  eig_avg:[   +0.0003    -0.1314    +0.1596    -0.4268    +0.7448    -0.8306    +1.4068    +2.1022    +2.7525    +3.6369]
2018-05-15 02:47:47,313 - step 24500 .   c=0.13134441 d(w0,w1)=137.36892700 d(w0,w_avg)=78.59245300 t=62.31520414 c0=1.72033861 c1=2.04286686 c_avg=1.73889467 a0=0.63750000 a1=0.62350000 a_avg=0.64920000 a_avg-a0=0.01170000
2018-05-15 02:47:47,313 - step 24500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:47:47,313 - step 24500 .  eig1:   [   -0.0073    +0.0670    -0.2964    +0.5886    -0.6599    -0.9133    +1.3710    +2.1545    +2.9614    +3.8446]
2018-05-15 02:47:47,313 - step 24500 .  eig_avg:[   -0.0011    +0.1269    -0.1820    -0.5278    +0.7255    -0.8227    +1.3664    +2.1051    +2.9228    +3.7485]
2018-05-15 02:48:49,274 - step 25000 .   c=0.08578882 d(w0,w1)=138.95672607 d(w0,w_avg)=79.55993652 t=62.20457411 c0=1.72033861 c1=2.04352385 c_avg=1.74209516 a0=0.63750000 a1=0.62200000 a_avg=0.64910000 a_avg-a0=0.01160000
2018-05-15 02:48:49,274 - step 25000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:48:49,274 - step 25000 .  eig1:   [   -0.0015    +0.1429    -0.2047    -0.5455    +0.7525    -1.0235    +1.5614    +2.4127    +3.2687    +4.1546]
2018-05-15 02:48:49,274 - step 25000 .  eig_avg:[   -0.0011    +0.1254    -0.1815    -0.5091    +0.6847    -0.9228    +1.3955    +2.1002    +2.9411    +3.7755]
2018-05-15 02:49:51,327 - step 25500 .   c=0.11348379 d(w0,w1)=140.52632141 d(w0,w_avg)=80.52094269 t=61.94418716 c0=1.72033861 c1=2.05689122 c_avg=1.74533629 a0=0.63750000 a1=0.62080000 a_avg=0.64990000 a_avg-a0=0.01240000
2018-05-15 02:49:51,327 - step 25500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:49:51,327 - step 25500 .  eig1:   [   -0.0024    +0.1402    -0.2563    -0.6516    +0.8513    -1.1870    +1.7311    +2.6565    +3.7190    +4.8417]
2018-05-15 02:49:51,327 - step 25500 .  eig_avg:[   -0.0029    +0.0893    -0.2347    -0.5964    +0.6635    -0.9028    +1.2730    +2.1196    +2.8598    +3.6840]
2018-05-15 02:50:53,461 - step 26000 .   c=0.07118499 d(w0,w1)=142.02932739 d(w0,w_avg)=81.47460175 t=62.13571000 c0=1.72033861 c1=2.05231328 c_avg=1.74875841 a0=0.63750000 a1=0.62550000 a_avg=0.64960000 a_avg-a0=0.01210000
2018-05-15 02:50:53,462 - step 26000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:50:53,462 - step 26000 .  eig1:   [   +0.0026    -0.1410    +0.3186    -0.6043    -0.9257    +1.2467    +2.1448    +3.3327    +4.3389    +5.4492]
2018-05-15 02:50:53,462 - step 26000 .  eig_avg:[   -0.0019    +0.1075    -0.2082    -0.5865    +0.7020    -0.9038    +1.3732    +2.1694    +3.0038    +3.8782]
2018-05-15 02:51:55,597 - step 26500 .   c=0.09843128 d(w0,w1)=143.59468079 d(w0,w_avg)=82.42174530 t=62.03001666 c0=1.72033861 c1=2.06475548 c_avg=1.75218178 a0=0.63750000 a1=0.62050000 a_avg=0.64950000 a_avg-a0=0.01200000
2018-05-15 02:51:55,598 - step 26500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:51:55,598 - step 26500 .  eig1:   [   -0.0054    +0.0809    -0.2934    +0.6288    -0.6633    -1.0717    +1.4116    +2.1539    +3.1839    +3.9587]
2018-05-15 02:51:55,598 - step 26500 .  eig_avg:[   -0.0008    +0.1376    -0.1789    -0.5036    +0.7248    -0.8617    +1.3875    +2.0427    +3.0013    +3.9131]
2018-05-15 02:52:57,871 - step 27000 .   c=0.19928756 d(w0,w1)=145.15982056 d(w0,w_avg)=83.36393738 t=62.28049803 c0=1.72033861 c1=2.12360190 c_avg=1.75570627 a0=0.63750000 a1=0.61740000 a_avg=0.64900000 a_avg-a0=0.01150000
2018-05-15 02:52:57,872 - step 27000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:52:57,872 - step 27000 .  eig1:   [   +0.0051    -0.0656    +0.2952    -0.3755    -0.6537    +0.9971    +1.6972    +2.5202    +3.4098    +4.2883]
2018-05-15 02:52:57,872 - step 27000 .  eig_avg:[   +0.0006    -0.1289    +0.1833    -0.4539    +0.7679    -0.9489    +1.4219    +2.2491    +3.0101    +4.1400]
2018-05-15 02:54:00,158 - step 27500 .   c=0.06369530 d(w0,w1)=146.63726807 d(w0,w_avg)=84.30017090 t=62.26014614 c0=1.72033861 c1=2.09798912 c_avg=1.75923486 a0=0.63750000 a1=0.62120000 a_avg=0.64860000 a_avg-a0=0.01110000
2018-05-15 02:54:00,158 - step 27500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:54:00,159 - step 27500 .  eig1:   [   -0.0009    +0.1773    -0.2206    -0.7047    +0.9963    -1.1688    +1.8722    +2.8440    +3.8716    +4.8719]
2018-05-15 02:54:00,159 - step 27500 .  eig_avg:[   -0.0001    -0.1505    +0.1569    -0.4581    +0.7885    -0.9480    +1.3963    +2.2323    +3.0724    +3.8473]
2018-05-15 02:55:02,491 - step 28000 .   c=0.08016251 d(w0,w1)=148.13749695 d(w0,w_avg)=85.22939301 t=62.39968753 c0=1.72033861 c1=2.10395422 c_avg=1.76292246 a0=0.63750000 a1=0.62110000 a_avg=0.64870000 a_avg-a0=0.01120000
2018-05-15 02:55:02,491 - step 28000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:55:02,491 - step 28000 .  eig1:   [   -0.0013    +0.1694    -0.2392    -0.6798    +0.9092    -1.0125    +1.8519    +2.6366    +3.7839    +4.9435]
2018-05-15 02:55:02,491 - step 28000 .  eig_avg:[   -0.0005    +0.1451    -0.1663    -0.5376    +0.7439    -0.8133    +1.3608    +2.1285    +2.9800    +3.8214]
2018-05-15 02:56:05,103 - step 28500 .   c=0.07034799 d(w0,w1)=149.72335815 d(w0,w_avg)=86.15430450 t=62.32835865 c0=1.72033861 c1=2.09201202 c_avg=1.76631876 a0=0.63750000 a1=0.62080000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:56:05,103 - step 28500 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:56:05,104 - step 28500 .  eig1:   [   -0.0029    +0.0968    -0.2261    -0.5638    +0.5912    -0.7790    +1.3166    +2.0423    +2.7530    +3.6436]
2018-05-15 02:56:05,104 - step 28500 .  eig_avg:[   +0.0009    -0.1219    +0.1955    -0.4724    -0.7133    +0.8152    +1.4904    +2.2936    +3.0882    +4.1043]
2018-05-15 02:57:07,494 - step 29000 .   c=0.10228723 d(w0,w1)=151.15686035 d(w0,w_avg)=87.07267761 t=62.59551477 c0=1.72033861 c1=2.09468963 c_avg=1.76967475 a0=0.63750000 a1=0.62000000 a_avg=0.64850000 a_avg-a0=0.01100000
2018-05-15 02:57:07,494 - step 29000 .  eig0:   [   -0.0241    +0.0279    -0.4165    +0.5369    -0.8371    -1.1154    +1.3675    +2.2762    +3.1585    +4.1054]
2018-05-15 02:57:07,494 - step 29000 .  eig1:   [   -0.0013    +0.1685    -0.2317    -0.6738    +0.9494    -1.0500    +1.7867    +2.8009    +3.8256    +5.0912]
2018-05-15 02:57:07,494 - step 29000 .  eig_avg:[   +0.0008    -0.1276    +0.1958    -0.4609    +0.7917    -0.7955    +1.4337    +2.3646    +3.0431    +4.1063]