Skip to content

Instantly share code, notes, and snippets.

@bearpelican
Created August 8, 2018 06:21
Show Gist options
  • Select an option

  • Save bearpelican/2d6d77420b2681684cfb3ffa3399b035 to your computer and use it in GitHub Desktop.

Select an option

Save bearpelican/2d6d77420b2681684cfb3ffa3399b035 to your computer and use it in GitHub Desktop.
~~epoch hours top1Accuracy
Distributed: init_process_group success
Loaded model
Defined loss and optimizer
Created data loaders
Begin training
Begin training loop: 1530911465.107739
Prefetcher first preload complete
Received input: 3.9817962646484375
Changing LR from None to 0.0
Changing LR from 0.21829899423884386 to 0.219353578752075
Prefetcher first preload complete
~~0 0.02165860361111111 8.791
* Prec@1 2.781 Prec@5 8.791
Begin training loop: 1530911513.1637576
Prefetcher first preload complete
Received input: 4.140221357345581
Changing LR from 0.219353578752075 to 0.217687074829932
Changing LR from 0.4332910197571852 to 0.4343325847085246
Prefetcher first preload complete
~~1 0.032896680000000005 24.614
* Prec@1 9.905 Prec@5 24.614
Begin training loop: 1530911553.6222298
Prefetcher first preload complete
Received input: 4.027294158935547
Changing LR from 0.4343325847085246 to 0.4244897959183674
Changing LR from 0.6347036422224392 to 0.6357191680499952
Prefetcher first preload complete
~~2 0.04396760194444444 36.894
* Prec@1 16.967 Prec@5 36.894
Begin training loop: 1530911593.4766128
Prefetcher first preload complete
Received input: 4.292510509490967
Changing LR from 0.6357191680499952 to 0.5877551020408163
Changing LR from 0.7817986524753442 to 0.7827360609315496
Prefetcher first preload complete
~~3 0.055251288055555556 42.200
* Prec@1 20.216 Prec@5 42.200
Begin training loop: 1530911634.097718
Prefetcher first preload complete
Received input: 4.2108988761901855
Changing LR from 0.7827360609315496 to 0.7836734693877551
Changing LR from 0.9777170198222829 to 0.9786544282784884
Prefetcher first preload complete
~~4 0.06653028305555556 48.231
* Prec@1 24.640 Prec@5 48.231
Begin training loop: 1530911674.702566
Prefetcher first preload complete
Received input: 4.0779290199279785
Changing LR from 0.9786544282784884 to 0.9795918367346939
Changing LR from 1.1736353871692218 to 1.1745727956254273
Prefetcher first preload complete
~~5 0.07759701277777778 48.339
* Prec@1 24.228 Prec@5 48.339
Begin training loop: 1530911714.54273
Prefetcher first preload complete
Received input: 4.161496639251709
Changing LR from 1.1745727956254273 to 1.1755102040816325
Changing LR from 1.3695537545161605 to 1.370491162972366
Prefetcher first preload complete
~~6 0.08929455333333333 57.588
* Prec@1 32.204 Prec@5 57.588
Begin training loop: 1530911756.6534517
Prefetcher first preload complete
Received input: 4.206857204437256
Changing LR from 1.370491162972366 to 1.6
Prefetcher first preload complete
~~7 0.10040488027777777 51.320
* Prec@1 27.135 Prec@5 51.320
Begin training loop: 1530911796.6513565
Prefetcher first preload complete
Received input: 4.1393444538116455
Prefetcher first preload complete
~~8 0.1121581475 62.182
* Prec@1 35.851 Prec@5 62.182
Begin training loop: 1530911838.9628255
Prefetcher first preload complete
Received input: 4.16794490814209
Prefetcher first preload complete
~~9 0.12341901861111111 64.273
* Prec@1 37.904 Prec@5 64.273
Begin training loop: 1530911879.5021155
Prefetcher first preload complete
Received input: 4.099195718765259
Prefetcher first preload complete
~~10 0.13452808361111113 62.766
* Prec@1 36.768 Prec@5 62.766
Begin training loop: 1530911919.4952726
Prefetcher first preload complete
Received input: 4.072023868560791
Prefetcher first preload complete
~~11 0.14572014972222222 60.994
* Prec@1 35.421 Prec@5 60.994
Begin training loop: 1530911959.785624
Prefetcher first preload complete
Received input: 4.098813772201538
Prefetcher first preload complete
~~12 0.15695763527777779 55.870
* Prec@1 30.564 Prec@5 55.870
Begin training loop: 1530912000.2410743
Prefetcher first preload complete
Received input: 4.269343614578247
Prefetcher first preload complete
~~13 0.16847375388888888 65.799
* Prec@1 39.044 Prec@5 65.799
Begin training loop: 1530912041.6986096
Prefetcher first preload complete
Received input: 4.133016347885132
Prefetcher first preload complete
~~14 0.17978366972222223 62.196
* Prec@1 36.320 Prec@5 62.196
Begin training loop: 1530912082.414774
Prefetcher first preload complete
Received input: 4.164243221282959
Prefetcher first preload complete
~~15 0.1910461436111111 65.585
* Prec@1 39.451 Prec@5 65.585
Begin training loop: 1530912122.9597254
Prefetcher first preload complete
Received input: 4.13477349281311
Prefetcher first preload complete
~~16 0.20267800416666665 59.931
* Prec@1 34.247 Prec@5 59.931
Begin training loop: 1530912164.8351042
Prefetcher first preload complete
Received input: 4.138800144195557
Prefetcher first preload complete
~~17 0.21374085666666667 65.101
* Prec@1 38.696 Prec@5 65.101
Begin training loop: 1530912204.660823
Prefetcher first preload complete
Received input: 4.253711223602295
Prefetcher first preload complete
~~18 0.22513111055555554 65.393
* Prec@1 39.599 Prec@5 65.393
Begin training loop: 1530912245.665217
Prefetcher first preload complete
Received input: 4.193503379821777
Prefetcher first preload complete
~~19 0.2360996413888889 62.934
* Prec@1 37.608 Prec@5 62.934
Begin training loop: 1530912301.4622808
Prefetcher first preload complete
Received input: 7.9899280071258545
Prefetcher first preload complete
~~20 0.2696663572222222 71.137
* Prec@1 44.750 Prec@5 71.137
Begin training loop: 1530912405.991833
Prefetcher first preload complete
Received input: 6.745267629623413
Prefetcher first preload complete
~~21 0.29457657444444446 69.054
* Prec@1 43.028 Prec@5 69.054
Begin training loop: 1530912495.6688657
Prefetcher first preload complete
Received input: 6.2841033935546875
Prefetcher first preload complete
~~22 0.319030685 73.846
* Prec@1 47.751 Prec@5 73.846
Begin training loop: 1530912583.7036898
Prefetcher first preload complete
Received input: 5.975212097167969
Prefetcher first preload complete
~~23 0.34330297277777777 70.188
* Prec@1 44.440 Prec@5 70.188
Begin training loop: 1530912671.0842855
Prefetcher first preload complete
Received input: 6.330786228179932
Changing LR from 1.6 to 0.16
Prefetcher first preload complete
~~24 0.3674446980555556 88.562
* Prec@1 68.084 Prec@5 88.562
Begin training loop: 1530912757.9943225
Prefetcher first preload complete
Received input: 6.3727240562438965
Prefetcher first preload complete
~~25 0.39166644222222224 88.966
* Prec@1 68.762 Prec@5 88.966
Begin training loop: 1530912845.1932998
Prefetcher first preload complete
Received input: 6.32015061378479
Prefetcher first preload complete
~~26 0.4158585986111111 89.331
* Prec@1 69.258 Prec@5 89.331
Begin training loop: 1530912932.285836
Prefetcher first preload complete
Received input: 6.321009159088135
Prefetcher first preload complete
~~27 0.439748125 89.525
* Prec@1 69.564 Prec@5 89.525
Begin training loop: 1530913018.2868378
Prefetcher first preload complete
Received input: 6.468589782714844
Prefetcher first preload complete
~~28 0.4638435877777778 89.785
* Prec@1 69.792 Prec@5 89.785
Begin training loop: 1530913105.031423
Prefetcher first preload complete
Received input: 5.862149953842163
Prefetcher first preload complete
~~29 0.4876333944444444 89.799
* Prec@1 70.218 Prec@5 89.799
Begin training loop: 1530913190.6740828
Prefetcher first preload complete
Received input: 6.369967460632324
Prefetcher first preload complete
~~30 0.5116667227777778 89.363
* Prec@1 69.398 Prec@5 89.363
Begin training loop: 1530913277.194326
Prefetcher first preload complete
Received input: 6.4889185428619385
Prefetcher first preload complete
~~31 0.5355661025 89.759
* Prec@1 69.796 Prec@5 89.759
Begin training loop: 1530913363.232275
Prefetcher first preload complete
Received input: 6.363805294036865
Prefetcher first preload complete
~~32 0.5594680930555556 89.657
* Prec@1 69.972 Prec@5 89.657
Begin training loop: 1530913449.2794447
Prefetcher first preload complete
Received input: 6.264745712280273
Prefetcher first preload complete
~~33 0.5833870952777778 89.429
* Prec@1 69.536 Prec@5 89.429
Begin training loop: 1530913535.3872592
Prefetcher first preload complete
Received input: 5.646114826202393
Prefetcher first preload complete
~~34 0.6074452086111112 89.655
* Prec@1 69.614 Prec@5 89.655
Begin training loop: 1530913621.9961388
Prefetcher first preload complete
Received input: 6.538741588592529
Prefetcher first preload complete
~~35 0.6316150813888889 87.502
* Prec@1 66.437 Prec@5 87.502
Begin training loop: 1530913709.0080056
Prefetcher first preload complete
Received input: 6.743063449859619
Prefetcher first preload complete
~~36 0.6554856822222221 89.929
* Prec@1 70.453 Prec@5 89.929
Begin training loop: 1530913794.9419851
Prefetcher first preload complete
Received input: 6.463208913803101
Prefetcher first preload complete
~~37 0.6795715861111111 89.543
* Prec@1 69.486 Prec@5 89.543
Begin training loop: 1530913881.652413
Prefetcher first preload complete
Received input: 6.38227915763855
Prefetcher first preload complete
~~38 0.7036000627777779 89.083
* Prec@1 68.914 Prec@5 89.083
Begin training loop: 1530913968.1537623
Prefetcher first preload complete
Received input: 6.246779918670654
Changing LR from 0.16 to 0.016
Prefetcher first preload complete
~~39 0.7273684091666667 91.673
* Prec@1 73.682 Prec@5 91.673
Begin training loop: 1530914053.7199395
Prefetcher first preload complete
Received input: 6.642903804779053
Prefetcher first preload complete
~~40 0.7514202302777778 91.735
* Prec@1 73.748 Prec@5 91.735
Begin training loop: 1530914140.3069773
Prefetcher first preload complete
Received input: 6.3587424755096436
Prefetcher first preload complete
~~41 0.7753603983333334 91.753
* Prec@1 73.870 Prec@5 91.753
Begin training loop: 1530914226.4913874
Prefetcher first preload complete
Received input: 6.434988975524902
Prefetcher first preload complete
~~42 0.7994918511111112 91.817
* Prec@1 73.994 Prec@5 91.817
Begin training loop: 1530914313.3640246
Prefetcher first preload complete
Received input: 6.1927783489227295
Prefetcher first preload complete
~~43 0.8233844347222222 91.955
* Prec@1 74.092 Prec@5 91.955
Begin training loop: 1530914399.3782558
Prefetcher first preload complete
Received input: 6.188918113708496
Prefetcher first preload complete
~~44 0.8473953733333334 91.915
* Prec@1 74.192 Prec@5 91.915
Begin training loop: 1530914485.816924
Prefetcher first preload complete
Received input: 6.370213031768799
Prefetcher first preload complete
~~45 0.8713272916666667 91.911
* Prec@1 74.200 Prec@5 91.911
Begin training loop: 1530914578.7719545
Prefetcher first preload complete
Received input: 5.440333366394043
Prefetcher first preload complete
~~46 0.9177351658333334 92.944
* Prec@1 75.668 Prec@5 92.944
Begin training loop: 1530914739.0397248
Prefetcher first preload complete
Received input: 5.8955347537994385
Prefetcher first preload complete
~~47 0.9523545516666666 92.874
* Prec@1 75.658 Prec@5 92.874
Begin training loop: 1530914869.7590106
Prefetcher first preload complete
Received input: 5.67817234992981
Changing LR from 0.016 to 0.0016
Prefetcher first preload complete
~~48 1.0170126930555556 93.036
* Prec@1 75.932 Prec@5 93.036
Begin training loop: 1530915096.4386282
Prefetcher first preload complete
Received input: 5.892843246459961
Prefetcher first preload complete
~~49 1.078595366388889 93.026
* Prec@1 75.908 Prec@5 93.026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment