runtrace.txt

(gpuc) 16:32:04 vladf@---:/data/vladf$ python tf_random_speed.py
2017-12-23 16:32:34.773396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1030] Found device 0 with properties: 
name: Tesla P100-PCIE-16GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285
pciBusID: 0000:0d:00.0
totalMemory: 15.89GiB freeMemory: 14.60GiB
2017-12-23 16:32:34.773443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
feed_dict (randomize jit) 16.786871671676636 sec
loss 4542.5 -> 4.15892
****************************************
2017-12-23 16:32:54.483313: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
feed_dict (randomize up-front) 17.372198820114136 sec
loss 4542.5 -> 4.34486
****************************************
2017-12-23 16:33:13.219050: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
foldl 8.488924503326416 sec
loss 4539.77 -> 4.40847
****************************************
2017-12-23 16:33:23.127757: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
while 7.355571508407593 sec
loss 4562.97 -> 4.27961
****************************************
2017-12-23 16:33:32.198681: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
tf dataset (bufsize 1000 ) 12.269741773605347 sec
loss 4550.22 -> 4.38528
****************************************
2017-12-23 16:33:45.961335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
tf dataset (bufsize 10000 ) 12.446614265441895 sec
loss 4550.22 -> 4.08236
****************************************
2017-12-23 16:34:00.202036: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
tf dataset (bufsize 100000 ) 14.463135480880737 sec
loss 4550.22 -> 4.34049
****************************************
2017-12-23 16:34:16.450677: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1120] Creating TensorFlow device (/device:GPU:0) -> (device: 0, name: Tesla P100-PCIE-16GB, pci bus id: 0000:0d:00.0, compute capability: 6.0)
****************************************
tf dataset (bufsize 1000000 ) 19.992233991622925 sec
loss 4550.22 -> 3.87981
****************************************