Skip to content

Instantly share code, notes, and snippets.

@fac2003
Created June 21, 2016 17:30
Show Gist options
  • Save fac2003/44d17565a7f95691c8097d964a440beb to your computer and use it in GitHub Desktop.
Save fac2003/44d17565a7f95691c8097d964a440beb to your computer and use it in GitHub Desktop.
o.n.n.NativeOps - Number of threads used for linear algebra 32
Using existing text file at /tmp/Shakespeare.txt
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [1]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Creating new cuBLAS handle for device [0]...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 0
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 1
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 4
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 3
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 5
o.n.j.h.i.CudaZeroHandler - Creating bucketID: 2
o.d.o.s.BaseOptimizer - Objective function automatically set to minimize. Set stepFunction in neural net configuration to change default settings.
o.d.s.i.m.SparkDl4jMultiLayer - Running distributed training: (averaging each iteration = true), (iterations = 1), (num partions = 16)
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [130]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [134]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.d.s.i.m.SparkDl4jMultiLayer - Broadcasting initial parameters of length 559877
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [99]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [103]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [101]
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [100]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [102]
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [98]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.d.s.i.m.IterativeReduceFlatMap - Training on 29 examples with data {0=1338.0, 1=234.0, 2=336.0, 3=699.0, 4=2281.0, 5=395.0, 6=301.0, 7=1279.0, 8=1080.0, 9=17.0, 10=142.0, 11=816.0, 12=484.0, 13=1157.0, 14=1536.0, 15=
288.0, 16=18.0, 17=1134.0, 18=1280.0, 19=1597.0, 20=688.0, 21=219.0, 22=409.0, 23=32.0, 24=499.0, 25=4.0, 26=219.0, 27=71.0, 28=69.0, 29=59.0, 30=174.0, 31=51.0, 32=19.0, 33=60.0, 34=220.0, 35=4.0, 36=15.0, 37=97.0, 38
=58.0, 39=93.0, 40=118.0, 41=35.0, 42=4.0, 43=121.0, 44=138.0, 45=200.0, 46=36.0, 47=5.0, 48=96.0, 49=3.0, 50=24.0, 53=5.0, 54=6.0, 55=7.0, 56=4.0, 57=3.0, 58=3.0, 59=2.0, 60=5.0, 61=3.0, 62=13.0, 66=40.0, 67=31.0, 68=
183.0, 70=432.0, 71=335.0, 72=16.0, 73=82.0, 74=6839.0, 75=710.0}
o.d.o.s.BaseOptimizer - Objective function automatically set to minimize. Set stepFunction in neural net configuration to change default settings.
o.d.o.l.ScoreIterationListener - Score at iteration 0 is 434.3631901444515
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 88
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.91108
o.d.o.l.ScoreIterationListener - Score at iteration 1 is 348.980185844182
o.d.o.l.ScoreIterationListener - Score at iteration 2 is 359.03928880878686
o.d.o.l.ScoreIterationListener - Score at iteration 3 is 323.77712823312504
o.d.o.l.ScoreIterationListener - Score at iteration 4 is 318.8295865725753
o.d.o.l.ScoreIterationListener - Score at iteration 5 is 317.5251749859404
o.d.o.l.ScoreIterationListener - Score at iteration 6 is 314.9290783828396
o.d.o.l.ScoreIterationListener - Score at iteration 7 is 314.5922091878189
o.d.o.l.ScoreIterationListener - Score at iteration 8 is 304.9810273914548
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [132]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.d.s.i.m.SparkDl4jMultiLayer - Running iterative reduce and averaging parameters
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [70]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [122]
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [125]
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [127]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [128]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [126]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [121]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [116]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [123]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [119]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [129]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [115]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [124]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [117]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [120]
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [118]
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.d.s.i.c.Adder - Invoked add operation
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.h.i.CudaZeroHandler - Mapping device [0] to thread [131]
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.j.a.c.i.BasicContextPool - Creating new context...
o.n.j.a.c.i.BasicContextPool - Creating new stream for device [0]...
o.n.j.a.c.i.BasicContextPool - Reusing blas here...
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.93055
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.95369
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.96526
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.972206
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.97684
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.98015
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.98263
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.98456
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.9861
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 138
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.987366
o.d.s.i.m.IterativeReduceFlatMap - Training on 21 examples with data {0=944.0, 1=201.0, 2=249.0, 3=553.0, 4=1545.0, 5=272.0, 6=233.0, 7=826.0, 8=830.0, 9=13.0, 10=126.0, 11=530.0, 12=365.0, 13=873.0, 14=1110.0, 15=159.
0, 16=7.0, 17=775.0, 18=866.0, 19=1096.0, 20=440.0, 21=133.0, 22=283.0, 23=8.0, 24=345.0, 25=7.0, 26=129.0, 27=61.0, 28=62.0, 29=66.0, 30=156.0, 31=23.0, 32=70.0, 33=91.0, 34=172.0, 35=1.0, 36=32.0, 37=103.0, 38=61.0,
39=77.0, 40=158.0, 41=7.0, 42=7.0, 43=84.0, 44=89.0, 45=129.0, 46=40.0, 47=4.0, 48=63.0, 50=29.0, 51=2.0, 54=1.0, 62=47.0, 66=42.0, 67=28.0, 68=88.0, 70=329.0, 71=305.0, 72=3.0, 73=62.0, 74=5087.0, 75=482.0}
o.d.o.s.BaseOptimizer - Objective function automatically set to minimize. Set stepFunction in neural net configuration to change default settings.
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 148
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.98759
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 164
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.98731
o.d.o.l.ScoreIterationListener - Score at iteration 0 is 434.37222351793304
o.n.l.j.CachedShapeInfoProvider - Total shapeInfo buffers in cache: 165
o.n.l.j.CachedShapeInfoProvider - Current shapeInfo hit ratio: 99.988144
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment