Created
August 8, 2018 06:21
-
-
Save bearpelican/2d6d77420b2681684cfb3ffa3399b035 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ~~epoch hours top1Accuracy | |
| Distributed: init_process_group success | |
| Loaded model | |
| Defined loss and optimizer | |
| Created data loaders | |
| Begin training | |
| Begin training loop: 1530911465.107739 | |
| Prefetcher first preload complete | |
| Received input: 3.9817962646484375 | |
| Changing LR from None to 0.0 | |
| Changing LR from 0.21829899423884386 to 0.219353578752075 | |
| Prefetcher first preload complete | |
| ~~0 0.02165860361111111 8.791 | |
| * Prec@1 2.781 Prec@5 8.791 | |
| Begin training loop: 1530911513.1637576 | |
| Prefetcher first preload complete | |
| Received input: 4.140221357345581 | |
| Changing LR from 0.219353578752075 to 0.217687074829932 | |
| Changing LR from 0.4332910197571852 to 0.4343325847085246 | |
| Prefetcher first preload complete | |
| ~~1 0.032896680000000005 24.614 | |
| * Prec@1 9.905 Prec@5 24.614 | |
| Begin training loop: 1530911553.6222298 | |
| Prefetcher first preload complete | |
| Received input: 4.027294158935547 | |
| Changing LR from 0.4343325847085246 to 0.4244897959183674 | |
| Changing LR from 0.6347036422224392 to 0.6357191680499952 | |
| Prefetcher first preload complete | |
| ~~2 0.04396760194444444 36.894 | |
| * Prec@1 16.967 Prec@5 36.894 | |
| Begin training loop: 1530911593.4766128 | |
| Prefetcher first preload complete | |
| Received input: 4.292510509490967 | |
| Changing LR from 0.6357191680499952 to 0.5877551020408163 | |
| Changing LR from 0.7817986524753442 to 0.7827360609315496 | |
| Prefetcher first preload complete | |
| ~~3 0.055251288055555556 42.200 | |
| * Prec@1 20.216 Prec@5 42.200 | |
| Begin training loop: 1530911634.097718 | |
| Prefetcher first preload complete | |
| Received input: 4.2108988761901855 | |
| Changing LR from 0.7827360609315496 to 0.7836734693877551 | |
| Changing LR from 0.9777170198222829 to 0.9786544282784884 | |
| Prefetcher first preload complete | |
| ~~4 0.06653028305555556 48.231 | |
| * Prec@1 24.640 Prec@5 48.231 | |
| Begin training loop: 1530911674.702566 | |
| Prefetcher first preload complete | |
| Received input: 4.0779290199279785 | |
| Changing LR from 0.9786544282784884 to 0.9795918367346939 | |
| Changing LR from 1.1736353871692218 to 1.1745727956254273 | |
| Prefetcher first preload complete | |
| ~~5 0.07759701277777778 48.339 | |
| * Prec@1 24.228 Prec@5 48.339 | |
| Begin training loop: 1530911714.54273 | |
| Prefetcher first preload complete | |
| Received input: 4.161496639251709 | |
| Changing LR from 1.1745727956254273 to 1.1755102040816325 | |
| Changing LR from 1.3695537545161605 to 1.370491162972366 | |
| Prefetcher first preload complete | |
| ~~6 0.08929455333333333 57.588 | |
| * Prec@1 32.204 Prec@5 57.588 | |
| Begin training loop: 1530911756.6534517 | |
| Prefetcher first preload complete | |
| Received input: 4.206857204437256 | |
| Changing LR from 1.370491162972366 to 1.6 | |
| Prefetcher first preload complete | |
| ~~7 0.10040488027777777 51.320 | |
| * Prec@1 27.135 Prec@5 51.320 | |
| Begin training loop: 1530911796.6513565 | |
| Prefetcher first preload complete | |
| Received input: 4.1393444538116455 | |
| Prefetcher first preload complete | |
| ~~8 0.1121581475 62.182 | |
| * Prec@1 35.851 Prec@5 62.182 | |
| Begin training loop: 1530911838.9628255 | |
| Prefetcher first preload complete | |
| Received input: 4.16794490814209 | |
| Prefetcher first preload complete | |
| ~~9 0.12341901861111111 64.273 | |
| * Prec@1 37.904 Prec@5 64.273 | |
| Begin training loop: 1530911879.5021155 | |
| Prefetcher first preload complete | |
| Received input: 4.099195718765259 | |
| Prefetcher first preload complete | |
| ~~10 0.13452808361111113 62.766 | |
| * Prec@1 36.768 Prec@5 62.766 | |
| Begin training loop: 1530911919.4952726 | |
| Prefetcher first preload complete | |
| Received input: 4.072023868560791 | |
| Prefetcher first preload complete | |
| ~~11 0.14572014972222222 60.994 | |
| * Prec@1 35.421 Prec@5 60.994 | |
| Begin training loop: 1530911959.785624 | |
| Prefetcher first preload complete | |
| Received input: 4.098813772201538 | |
| Prefetcher first preload complete | |
| ~~12 0.15695763527777779 55.870 | |
| * Prec@1 30.564 Prec@5 55.870 | |
| Begin training loop: 1530912000.2410743 | |
| Prefetcher first preload complete | |
| Received input: 4.269343614578247 | |
| Prefetcher first preload complete | |
| ~~13 0.16847375388888888 65.799 | |
| * Prec@1 39.044 Prec@5 65.799 | |
| Begin training loop: 1530912041.6986096 | |
| Prefetcher first preload complete | |
| Received input: 4.133016347885132 | |
| Prefetcher first preload complete | |
| ~~14 0.17978366972222223 62.196 | |
| * Prec@1 36.320 Prec@5 62.196 | |
| Begin training loop: 1530912082.414774 | |
| Prefetcher first preload complete | |
| Received input: 4.164243221282959 | |
| Prefetcher first preload complete | |
| ~~15 0.1910461436111111 65.585 | |
| * Prec@1 39.451 Prec@5 65.585 | |
| Begin training loop: 1530912122.9597254 | |
| Prefetcher first preload complete | |
| Received input: 4.13477349281311 | |
| Prefetcher first preload complete | |
| ~~16 0.20267800416666665 59.931 | |
| * Prec@1 34.247 Prec@5 59.931 | |
| Begin training loop: 1530912164.8351042 | |
| Prefetcher first preload complete | |
| Received input: 4.138800144195557 | |
| Prefetcher first preload complete | |
| ~~17 0.21374085666666667 65.101 | |
| * Prec@1 38.696 Prec@5 65.101 | |
| Begin training loop: 1530912204.660823 | |
| Prefetcher first preload complete | |
| Received input: 4.253711223602295 | |
| Prefetcher first preload complete | |
| ~~18 0.22513111055555554 65.393 | |
| * Prec@1 39.599 Prec@5 65.393 | |
| Begin training loop: 1530912245.665217 | |
| Prefetcher first preload complete | |
| Received input: 4.193503379821777 | |
| Prefetcher first preload complete | |
| ~~19 0.2360996413888889 62.934 | |
| * Prec@1 37.608 Prec@5 62.934 | |
| Begin training loop: 1530912301.4622808 | |
| Prefetcher first preload complete | |
| Received input: 7.9899280071258545 | |
| Prefetcher first preload complete | |
| ~~20 0.2696663572222222 71.137 | |
| * Prec@1 44.750 Prec@5 71.137 | |
| Begin training loop: 1530912405.991833 | |
| Prefetcher first preload complete | |
| Received input: 6.745267629623413 | |
| Prefetcher first preload complete | |
| ~~21 0.29457657444444446 69.054 | |
| * Prec@1 43.028 Prec@5 69.054 | |
| Begin training loop: 1530912495.6688657 | |
| Prefetcher first preload complete | |
| Received input: 6.2841033935546875 | |
| Prefetcher first preload complete | |
| ~~22 0.319030685 73.846 | |
| * Prec@1 47.751 Prec@5 73.846 | |
| Begin training loop: 1530912583.7036898 | |
| Prefetcher first preload complete | |
| Received input: 5.975212097167969 | |
| Prefetcher first preload complete | |
| ~~23 0.34330297277777777 70.188 | |
| * Prec@1 44.440 Prec@5 70.188 | |
| Begin training loop: 1530912671.0842855 | |
| Prefetcher first preload complete | |
| Received input: 6.330786228179932 | |
| Changing LR from 1.6 to 0.16 | |
| Prefetcher first preload complete | |
| ~~24 0.3674446980555556 88.562 | |
| * Prec@1 68.084 Prec@5 88.562 | |
| Begin training loop: 1530912757.9943225 | |
| Prefetcher first preload complete | |
| Received input: 6.3727240562438965 | |
| Prefetcher first preload complete | |
| ~~25 0.39166644222222224 88.966 | |
| * Prec@1 68.762 Prec@5 88.966 | |
| Begin training loop: 1530912845.1932998 | |
| Prefetcher first preload complete | |
| Received input: 6.32015061378479 | |
| Prefetcher first preload complete | |
| ~~26 0.4158585986111111 89.331 | |
| * Prec@1 69.258 Prec@5 89.331 | |
| Begin training loop: 1530912932.285836 | |
| Prefetcher first preload complete | |
| Received input: 6.321009159088135 | |
| Prefetcher first preload complete | |
| ~~27 0.439748125 89.525 | |
| * Prec@1 69.564 Prec@5 89.525 | |
| Begin training loop: 1530913018.2868378 | |
| Prefetcher first preload complete | |
| Received input: 6.468589782714844 | |
| Prefetcher first preload complete | |
| ~~28 0.4638435877777778 89.785 | |
| * Prec@1 69.792 Prec@5 89.785 | |
| Begin training loop: 1530913105.031423 | |
| Prefetcher first preload complete | |
| Received input: 5.862149953842163 | |
| Prefetcher first preload complete | |
| ~~29 0.4876333944444444 89.799 | |
| * Prec@1 70.218 Prec@5 89.799 | |
| Begin training loop: 1530913190.6740828 | |
| Prefetcher first preload complete | |
| Received input: 6.369967460632324 | |
| Prefetcher first preload complete | |
| ~~30 0.5116667227777778 89.363 | |
| * Prec@1 69.398 Prec@5 89.363 | |
| Begin training loop: 1530913277.194326 | |
| Prefetcher first preload complete | |
| Received input: 6.4889185428619385 | |
| Prefetcher first preload complete | |
| ~~31 0.5355661025 89.759 | |
| * Prec@1 69.796 Prec@5 89.759 | |
| Begin training loop: 1530913363.232275 | |
| Prefetcher first preload complete | |
| Received input: 6.363805294036865 | |
| Prefetcher first preload complete | |
| ~~32 0.5594680930555556 89.657 | |
| * Prec@1 69.972 Prec@5 89.657 | |
| Begin training loop: 1530913449.2794447 | |
| Prefetcher first preload complete | |
| Received input: 6.264745712280273 | |
| Prefetcher first preload complete | |
| ~~33 0.5833870952777778 89.429 | |
| * Prec@1 69.536 Prec@5 89.429 | |
| Begin training loop: 1530913535.3872592 | |
| Prefetcher first preload complete | |
| Received input: 5.646114826202393 | |
| Prefetcher first preload complete | |
| ~~34 0.6074452086111112 89.655 | |
| * Prec@1 69.614 Prec@5 89.655 | |
| Begin training loop: 1530913621.9961388 | |
| Prefetcher first preload complete | |
| Received input: 6.538741588592529 | |
| Prefetcher first preload complete | |
| ~~35 0.6316150813888889 87.502 | |
| * Prec@1 66.437 Prec@5 87.502 | |
| Begin training loop: 1530913709.0080056 | |
| Prefetcher first preload complete | |
| Received input: 6.743063449859619 | |
| Prefetcher first preload complete | |
| ~~36 0.6554856822222221 89.929 | |
| * Prec@1 70.453 Prec@5 89.929 | |
| Begin training loop: 1530913794.9419851 | |
| Prefetcher first preload complete | |
| Received input: 6.463208913803101 | |
| Prefetcher first preload complete | |
| ~~37 0.6795715861111111 89.543 | |
| * Prec@1 69.486 Prec@5 89.543 | |
| Begin training loop: 1530913881.652413 | |
| Prefetcher first preload complete | |
| Received input: 6.38227915763855 | |
| Prefetcher first preload complete | |
| ~~38 0.7036000627777779 89.083 | |
| * Prec@1 68.914 Prec@5 89.083 | |
| Begin training loop: 1530913968.1537623 | |
| Prefetcher first preload complete | |
| Received input: 6.246779918670654 | |
| Changing LR from 0.16 to 0.016 | |
| Prefetcher first preload complete | |
| ~~39 0.7273684091666667 91.673 | |
| * Prec@1 73.682 Prec@5 91.673 | |
| Begin training loop: 1530914053.7199395 | |
| Prefetcher first preload complete | |
| Received input: 6.642903804779053 | |
| Prefetcher first preload complete | |
| ~~40 0.7514202302777778 91.735 | |
| * Prec@1 73.748 Prec@5 91.735 | |
| Begin training loop: 1530914140.3069773 | |
| Prefetcher first preload complete | |
| Received input: 6.3587424755096436 | |
| Prefetcher first preload complete | |
| ~~41 0.7753603983333334 91.753 | |
| * Prec@1 73.870 Prec@5 91.753 | |
| Begin training loop: 1530914226.4913874 | |
| Prefetcher first preload complete | |
| Received input: 6.434988975524902 | |
| Prefetcher first preload complete | |
| ~~42 0.7994918511111112 91.817 | |
| * Prec@1 73.994 Prec@5 91.817 | |
| Begin training loop: 1530914313.3640246 | |
| Prefetcher first preload complete | |
| Received input: 6.1927783489227295 | |
| Prefetcher first preload complete | |
| ~~43 0.8233844347222222 91.955 | |
| * Prec@1 74.092 Prec@5 91.955 | |
| Begin training loop: 1530914399.3782558 | |
| Prefetcher first preload complete | |
| Received input: 6.188918113708496 | |
| Prefetcher first preload complete | |
| ~~44 0.8473953733333334 91.915 | |
| * Prec@1 74.192 Prec@5 91.915 | |
| Begin training loop: 1530914485.816924 | |
| Prefetcher first preload complete | |
| Received input: 6.370213031768799 | |
| Prefetcher first preload complete | |
| ~~45 0.8713272916666667 91.911 | |
| * Prec@1 74.200 Prec@5 91.911 | |
| Begin training loop: 1530914578.7719545 | |
| Prefetcher first preload complete | |
| Received input: 5.440333366394043 | |
| Prefetcher first preload complete | |
| ~~46 0.9177351658333334 92.944 | |
| * Prec@1 75.668 Prec@5 92.944 | |
| Begin training loop: 1530914739.0397248 | |
| Prefetcher first preload complete | |
| Received input: 5.8955347537994385 | |
| Prefetcher first preload complete | |
| ~~47 0.9523545516666666 92.874 | |
| * Prec@1 75.658 Prec@5 92.874 | |
| Begin training loop: 1530914869.7590106 | |
| Prefetcher first preload complete | |
| Received input: 5.67817234992981 | |
| Changing LR from 0.016 to 0.0016 | |
| Prefetcher first preload complete | |
| ~~48 1.0170126930555556 93.036 | |
| * Prec@1 75.932 Prec@5 93.036 | |
| Begin training loop: 1530915096.4386282 | |
| Prefetcher first preload complete | |
| Received input: 5.892843246459961 | |
| Prefetcher first preload complete | |
| ~~49 1.078595366388889 93.026 | |
| * Prec@1 75.908 Prec@5 93.026 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment