Skip to content

Instantly share code, notes, and snippets.

@agibsonccc
Created March 16, 2016 23:00
Show Gist options
  • Select an option

  • Save agibsonccc/92e9ceba931c638056ac to your computer and use it in GitHub Desktop.

Select an option

Save agibsonccc/92e9ceba931c638056ac to your computer and use it in GitHub Desktop.
/usr/java/jdk1.8.0_73/bin/java -Didea.launcher.port=7534 -Didea.launcher.bin.path=/home/agibsonccc/ides/idea-IU-143.2287.1/bin -Dfile.encoding=UTF-8 -classpath /usr/java/jdk1.8.0_73/jre/lib/charsets.jar:/usr/java/jdk1.8.0_73/jre/lib/deploy.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/cldrdata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/dnsns.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jaccess.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/jfxrt.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/localedata.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/nashorn.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunec.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunjce_provider.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/sunpkcs11.jar:/usr/java/jdk1.8.0_73/jre/lib/ext/zipfs.jar:/usr/java/jdk1.8.0_73/jre/lib/javaws.jar:/usr/java/jdk1.8.0_73/jre/lib/jce.jar:/usr/java/jdk1.8.0_73/jre/lib/jfr.jar:/usr/java/jdk1.8.0_73/jre/lib/jfxswt.jar:/usr/java/jdk1.8.0_73/jre/lib/jsse.jar:/usr/java/jdk1.8.0_73/jre/lib/management-agent.jar:/usr/java/jdk1.8.0_73/jre/lib/plugin.jar:/usr/java/jdk1.8.0_73/jre/lib/resources.jar:/usr/java/jdk1.8.0_73/jre/lib/rt.jar:/home/agibsonccc/code/gradientcheck-tests/target/classes:/home/agibsonccc/.m2/repository/org/deeplearning4j/deeplearning4j-core/0.4-rc3.9-SNAPSHOT/deeplearning4j-core-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/io/netty/netty-buffer/4.0.28.Final/netty-buffer-4.0.28.Final.jar:/home/agibsonccc/.m2/repository/io/netty/netty-common/4.0.28.Final/netty-common-4.0.28.Final.jar:/home/agibsonccc/.m2/repository/org/nd4j/canova-api/0.0.0.15-SNAPSHOT/canova-api-0.0.0.15-20160315.152155-101.jar:/home/agibsonccc/.m2/repository/org/slf4j/slf4j-api/1.7.12/slf4j-api-1.7.12.jar:/home/agibsonccc/.m2/repository/ch/qos/logback/logback-classic/1.1.2/logback-classic-1.1.2.jar:/home/agibsonccc/.m2/repository/ch/qos/logback/logback-core/1.1.2/logback-core-1.1.2.jar:/home/agibsonccc/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/agibsonccc/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/agibsonccc/.m2/repository/org/apache/commons/commons-compress/1.8/commons-compress-1.8.jar:/home/agibsonccc/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/agibsonccc/.m2/repository/com/google/guava/guava/11.0/guava-11.0.jar:/home/agibsonccc/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-api/0.4-rc3.9-SNAPSHOT/nd4j-api-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/junit/junit/4.11/junit-4.11.jar:/home/agibsonccc/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-buffer/0.4-rc3.9-SNAPSHOT/nd4j-buffer-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-common/0.4-rc3.9-SNAPSHOT/nd4j-common-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/org/reflections/reflections/0.9.10/reflections-0.9.10.jar:/home/agibsonccc/.m2/repository/org/javassist/javassist/3.19.0-GA/javassist-3.19.0-GA.jar:/home/agibsonccc/.m2/repository/com/google/code/findbugs/annotations/2.0.1/annotations-2.0.1.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-context/0.4-rc3.9-SNAPSHOT/nd4j-context-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/org/apache/httpcomponents/httpclient/4.3.5/httpclient-4.3.5.jar:/home/agibsonccc/.m2/repository/org/apache/httpcomponents/httpcore/4.3.2/httpcore-4.3.2.jar:/home/agibsonccc/.m2/repository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/home/agibsonccc/.m2/repository/commons-codec/commons-codec/1.6/commons-codec-1.6.jar:/home/agibsonccc/.m2/repository/com/brsanthu/google-analytics-java/1.1.2/google-analytics-java-1.1.2.jar:/home/agibsonccc/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.5/jcl-over-slf4j-1.7.5.jar:/home/agibsonccc/.m2/repository/org/apache/commons/commons-lang3/3.3.1/commons-lang3-3.3.1.jar:/home/agibsonccc/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.5.1/jackson-core-2.5.1.jar:/home/agibsonccc/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.5.1/jackson-databind-2.5.1.jar:/home/agibsonccc/.m2/repository/org/json/json/20131018/json-20131018.jar:/home/agibsonccc/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.5.1/jackson-annotations-2.5.1.jar:/home/agibsonccc/.m2/repository/org/projectlombok/lombok/1.16.4/lombok-1.16.4.jar:/home/agibsonccc/.m2/repository/com/fasterxml/jackson/dataformat/jackson-dataformat-yaml/2.5.1/jackson-dataformat-yaml-2.5.1.jar:/home/agibsonccc/.m2/repository/org/yaml/snakeyaml/1.12/snakeyaml-1.12.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native-api/0.4-rc3.9-SNAPSHOT/nd4j-native-api-0.4-rc3.9-SNAPSHOT.jar:/home/agibsonccc/.m2/repository/org/bytedeco/javacpp/1.2-SNAPSHOT/javacpp-1.2-20160220.074546-3.jar:/home/agibsonccc/ides/idea-IU-143.2287.1/lib/idea_rt.jar com.intellij.rt.execution.application.AppMain org.deeplearning4j.App
15:56:24.610 [main] DEBUG org.reflections.Reflections - going to scan these urls:
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-common/0.4-rc3.9-SNAPSHOT/nd4j-common-0.4-rc3.9-SNAPSHOT.jar!/
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-context/0.4-rc3.9-SNAPSHOT/nd4j-context-0.4-rc3.9-SNAPSHOT.jar!/
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native-api/0.4-rc3.9-SNAPSHOT/nd4j-native-api-0.4-rc3.9-SNAPSHOT.jar!/
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-buffer/0.4-rc3.9-SNAPSHOT/nd4j-buffer-0.4-rc3.9-SNAPSHOT.jar!/
jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-api/0.4-rc3.9-SNAPSHOT/nd4j-api-0.4-rc3.9-SNAPSHOT.jar!/
15:56:24.687 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libjniNativeOps.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner TypeAnnotationsScanner
15:56:24.688 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libjniNativeOps.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner SubTypesScanner
15:56:24.689 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libjniNd4jBlas.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner TypeAnnotationsScanner
15:56:24.689 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libjniNd4jBlas.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner SubTypesScanner
15:56:24.689 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libnd4j.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner TypeAnnotationsScanner
15:56:24.689 [main] DEBUG org.reflections.Reflections - could not scan file org/nd4j/nativeblas/linux-x86_64/libnd4j.so in url jar:file:/home/agibsonccc/.m2/repository/org/nd4j/nd4j-native/0.4-rc3.9-SNAPSHOT/nd4j-native-0.4-rc3.9-SNAPSHOT.jar!/ with scanner SubTypesScanner
15:56:24.772 [main] INFO org.reflections.Reflections - Reflections took 157 ms to scan 6 urls, producing 117 keys and 378 values
FLOAT
DOUBLE
testGradientMLP2LayerIrisSimpleRandom() - activationFn=sigmoid, lossFn=MCXENT, outputActivation=softmax, doLearningFirst=false
Layer 0 # params: 15
Layer 1 # params: 12
15:56:27.050 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 0 passed: grad= 1.900256494359858E-5, numericalGrad= 1.9002564743964E-5, relError= 5.252832481873009E-9
15:56:28.129 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 1 passed: grad= 2.649860169995215E-5, numericalGrad= 2.6498601424229662E-5, relError= 5.202585657608425E-9
15:56:29.196 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 2 passed: grad= 4.606612046430188E-5, numericalGrad= 4.6066120362731056E-5, relError= 1.1024460419308453E-9
15:56:30.278 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 3 passed: grad= 9.601640712612312E-5, numericalGrad= 9.601640671430545E-5, relError= 2.144517212720839E-9
15:56:31.354 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 4 passed: grad= -4.748345645113674E-6, numericalGrad= -4.748345161509349E-6, relError= 5.092345691619301E-8
15:56:32.416 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 5 passed: grad= 2.9504500989344686E-5, numericalGrad= 2.9504501175559028E-5, relError= 3.1556937978695635E-9
15:56:33.491 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 6 passed: grad= -4.130729589222402E-5, numericalGrad= -4.130729569506997E-5, relError= 2.386431380837427E-9
15:56:34.564 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 7 passed: grad= -3.219032854980902E-5, numericalGrad= -3.219032884693718E-5, relError= 4.615177477762727E-9
15:56:35.644 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 8 passed: grad= 1.180955443968949E-4, numericalGrad= 1.1809554434361047E-4, relError= 2.2559881766105044E-10
15:56:36.723 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 9 passed: grad= -1.1556912052263443E-5, numericalGrad= -1.1556912316024182E-5, relError= 1.1411384568444528E-8
15:56:37.787 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 10 passed: grad= 4.3164789414922846E-4, numericalGrad= 4.3164789365057743E-4, relError= 5.776131897156053E-10
15:56:38.865 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 11 passed: grad= 6.367089350877885E-4, numericalGrad= 6.36708935131125E-4, relError= 3.4031669909541046E-11
15:56:39.934 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 12 passed: grad= 0.06053784585410861, numericalGrad= 0.060537840731567094, relError= 4.230858944865393E-8
15:56:41.008 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 13 passed: grad= 0.03861984188855409, numericalGrad= 0.03861983864639207, relError= 4.197534224001012E-8
15:56:42.078 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 14 passed: grad= 0.11402442826680426, numericalGrad= 0.11402441751273695, relError= 4.715685916572201E-8
15:56:43.148 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 15 passed: grad= -0.020419887696214837, numericalGrad= -0.020419885909728208, relError= 4.374379363622889E-8
15:56:44.217 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 16 passed: grad= -0.02027128746140435, numericalGrad= -0.02027128567572145, relError= 4.4044636587756306E-8
15:56:45.280 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 17 passed: grad= -0.01961337722594847, numericalGrad= -0.01961337543976427, relError= 4.553484749984391E-8
15:56:46.346 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 18 passed: grad= 0.13419406694248986, numericalGrad= 0.13419406592773964, relError= 3.780905725740246E-9
15:56:47.413 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 19 passed: grad= 0.1341842780091711, numericalGrad= 0.13418427699385393, relError= 3.7832940735767825E-9
15:56:48.485 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 20 passed: grad= 0.13397308742977798, numericalGrad= 0.13397308641527328, relError= 3.786225747916668E-9
15:56:49.548 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 21 passed: grad= -0.11377417924627499, numericalGrad= -0.11377417769775633, relError= 6.805228925041998E-9
15:56:50.621 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 22 passed: grad= -0.11391299054776678, numericalGrad= -0.11391298899832147, relError= 6.801003604838491E-9
15:56:51.705 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 23 passed: grad= -0.11435971020382944, numericalGrad= -0.11435970865414369, relError= 6.775488336137588E-9
15:56:52.784 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 24 passed: grad= -0.040228366747706856, numericalGrad= -0.040228352458648864, relError= 1.7759931219343778E-7
15:56:53.857 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 25 passed: grad= 0.2682684686347366, numericalGrad= 0.2682684605171959, relError= 1.5129509739461635E-8
15:56:54.930 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 26 passed: grad= -0.2280401018870299, numericalGrad= -0.22804008949250942, relError= 2.717618677548804E-8
15:56:54.930 [main] INFO o.d.gradientcheck.GradientCheckUtil - GradientCheckUtil.checkGradients(): 27 params checked, 27 passed, 0 failed. Largest relative error = 1.7759931219343778E-7
testGradientMLP2LayerIrisSimpleRandom() - activationFn=sigmoid, lossFn=MSE, outputActivation=tanh, doLearningFirst=false
Layer 0 # params: 15
Layer 1 # params: 12
15:56:56.217 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 0 passed: grad= -6.6787993467629584E-6, numericalGrad= -6.6788001795714536E-6, relError= 6.234716750396059E-8
15:56:56.921 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 1 passed: grad= 2.6474187410379825E-5, numericalGrad= 2.6474187286851247E-5, relError= 2.3330003728467167E-9
15:56:57.627 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 2 passed: grad= -4.570503404973672E-5, numericalGrad= -4.570503420175953E-5, relError= 1.6630860605349922E-9
15:56:58.340 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 3 passed: grad= -4.18441513932964E-5, numericalGrad= -4.184415125507712E-5, relError= 1.6515961301167051E-9
15:56:59.050 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 4 passed: grad= -4.573264326745038E-5, numericalGrad= -4.573264367202512E-5, relError= 4.4232599071311185E-9
15:56:59.761 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 5 passed: grad= 4.039485483211123E-5, numericalGrad= 4.0394856681835734E-5, relError= 2.2895545331133207E-8
15:57:00.477 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 6 passed: grad= -1.9676049776978286E-4, numericalGrad= -1.9676049722860967E-4, relError= 1.375207945183955E-9
15:57:01.190 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 7 passed: grad= -2.546386393992217E-4, numericalGrad= -2.5463863972952083E-4, relError= 6.485644846490946E-10
15:57:01.906 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 8 passed: grad= 7.11240255777776E-5, numericalGrad= 7.112402600206735E-5, relError= 2.9827456264556564E-9
15:57:02.629 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 9 passed: grad= -1.3228670360838123E-5, numericalGrad= -1.3228670159293188E-5, relError= 7.617732224630059E-9
15:57:03.343 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 10 passed: grad= 2.651160073894224E-4, numericalGrad= 2.651160069255809E-4, relError= 8.747896459593726E-10
15:57:04.056 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 11 passed: grad= 3.84869156387718E-4, numericalGrad= 3.848691566554763E-4, relError= 3.4785621329645474E-10
15:57:04.771 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 12 passed: grad= 0.08745490106219048, numericalGrad= 0.08745489356221103, relError= 4.287912783360088E-8
15:57:05.482 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 13 passed: grad= 0.172458667225434, numericalGrad= 0.17245865044956954, relError= 4.8637350425531426E-8
15:57:06.196 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 14 passed: grad= 0.030110341257068136, numericalGrad= 0.030110336975752716, relError= 7.109377618910628E-8
15:57:06.910 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 15 passed: grad= -0.24336676091116685, numericalGrad= -0.2433667225827385, relError= 7.874623309804307E-8
15:57:07.621 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 16 passed: grad= -0.24322206667729665, numericalGrad= -0.24322202838233942, relError= 7.872427196052213E-8
15:57:08.329 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 17 passed: grad= -0.24258137926658288, numericalGrad= -0.24258134111843077, relError= 7.862960303128464E-8
15:57:09.036 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 18 passed: grad= 0.06287340558129706, numericalGrad= 0.06287336913946007, relError= 2.898033533933496E-7
15:57:09.743 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 19 passed: grad= 0.06286612200894294, numericalGrad= 0.06286608556849149, relError= 2.8982590976599257E-7
15:57:10.457 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 20 passed: grad= 0.0627082370921488, numericalGrad= 0.06270820066089922, relError= 2.904822544733468E-7
15:57:11.167 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 21 passed: grad= -0.179809319053703, numericalGrad= -0.17980932520333948, relError= 1.7100438380853156E-8
15:57:11.878 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 22 passed: grad= -0.17985215201804544, numericalGrad= -0.17985215817795108, relError= 1.7124914732789294E-8
15:57:12.588 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 23 passed: grad= -0.17998981792216942, numericalGrad= -0.1799898241195974, relError= 1.721605130866069E-8
15:57:13.302 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 24 passed: grad= -0.48613814567266217, numericalGrad= -0.4861378395983884, relError= 3.148018447395421E-7
15:57:14.005 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 25 passed: grad= 0.12565742203276514, numericalGrad= 0.12565713052536953, relError= 1.159930424417788E-6
15:57:14.729 [main] INFO o.d.gradientcheck.GradientCheckUtil - Param 26 passed: grad= -0.3597702927348834, numericalGrad= -0.3597703420896714, relError= 6.859207887650907E-8
15:57:14.729 [main] INFO o.d.gradientcheck.GradientCheckUtil - GradientCheckUtil.checkGradients(): 27 params checked, 27 passed, 0 failed. Largest relative error = 1.159930424417788E-6
15:57:15.480 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Objective function automatically set to minimize. Set stepFunction in neural net configuration to change default settings.
15:57:16.288 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -0.23792081016611605
15:57:17.040 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.1555232767091734
15:57:17.040 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.1555232767091734, scoreAtStart=1.329312847319991
15:57:17.787 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-0.05089162157453267, gg=0.23792081016611605
15:57:17.821 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -0.057257616970610055
15:57:18.527 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.1123322045607407
15:57:18.527 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.1123322045607407, scoreAtStart=1.1555232767091732
15:57:19.257 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-0.014081505189148238, gg=0.057257616970610055
15:57:19.286 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -0.014422393890304589
15:57:19.986 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.1017855374343104
15:57:19.986 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.1017855374343104, scoreAtStart=1.1123322045607416
15:57:20.716 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-0.0035732603088522753, gg=0.014422393890304589
15:57:20.748 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -0.003013485881232174
15:57:21.439 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099622603979318
15:57:21.439 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099622603979318, scoreAtStart=1.10178553743431
15:57:22.175 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-7.394106271128995E-4, gg=0.003013485881232174
15:57:22.212 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -5.654919323975034E-4
15:57:22.917 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0992198106723863
15:57:22.917 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0992198106723863, scoreAtStart=1.0996226039793175
15:57:23.653 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-1.3772299866562522E-4, gg=5.654919323975034E-4
15:57:24.451 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0179919484750439E-4
15:57:25.159 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991472998311262
15:57:25.159 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991472998311262, scoreAtStart=1.0992198106723865
15:57:25.897 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-2.4516233977445383E-5, gg=1.0179919484750439E-4
15:57:25.929 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.8664821474364036E-5
15:57:26.633 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099133775428551
15:57:26.633 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099133775428551, scoreAtStart=1.0991472998311262
15:57:27.370 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-4.283255304675046E-6, gg=1.8664821474364036E-5
15:57:27.403 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -4.0978449232475475E-6
15:57:28.114 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991305705909182
15:57:28.114 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991305705909182, scoreAtStart=1.0991337754285513
15:57:28.855 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-7.430002001109954E-7, gg=4.0978449232475475E-6
15:57:28.888 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.099130570590918, oldScore=1.0991337754285513, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:28.889 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.568643917284044E-6
15:57:29.593 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991291566375074
15:57:29.593 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991291566375074, scoreAtStart=1.099130570590918
15:57:30.322 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-1.28919747863644E-7, gg=1.568643917284044E-6
15:57:30.363 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.099129156637507, oldScore=1.099130570590918, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:30.363 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.1303341681528688E-6
15:57:31.064 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991280532729455
15:57:31.064 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991280532729455, scoreAtStart=1.099129156637507
15:57:31.801 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-2.2780572336277447E-8, gg=1.1303341681528688E-6
15:57:31.835 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0991280532729448, oldScore=1.099129156637507, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:32.605 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0536148047569903E-6
15:57:33.295 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991270045762291
15:57:33.295 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991270045762291, scoreAtStart=1.099128053272945
15:57:34.028 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-4.460490851850178E-9, gg=1.0536148047569903E-6
15:57:34.069 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.0991270045762298, oldScore=1.099128053272945, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:34.069 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0393184788896025E-6
15:57:34.757 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991259663711364
15:57:34.757 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991259663711364, scoreAtStart=1.0991270045762298
15:57:35.488 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-1.2993155406247468E-9, gg=1.0393184788896025E-6
15:57:35.531 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0991259663711366, oldScore=1.0991270045762298, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:35.531 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0357925264910132E-6
15:57:36.223 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991249310353712
15:57:36.223 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991249310353712, scoreAtStart=1.0991259663711366
15:57:36.953 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-7.531932267839615E-10, gg=1.0357925264910132E-6
15:57:36.988 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.0991249310353717, oldScore=1.0991259663711366, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:36.988 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0341258607171423E-6
15:57:37.686 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991238972525963
15:57:37.686 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991238972525963, scoreAtStart=1.0991249310353717
15:57:38.425 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.580987361890777E-10, gg=1.0341258607171423E-6
15:57:38.466 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0991238972525963, oldScore=1.0991249310353717, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:38.466 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0327816110121316E-6
15:57:39.158 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991228647940212
15:57:39.158 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991228647940212, scoreAtStart=1.0991238972525963
15:57:39.878 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.407913363851745E-10, gg=1.0327816110121316E-6
15:57:39.920 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0991228647940217, oldScore=1.0991238972525963, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:40.683 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0314947559304813E-6
15:57:41.380 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099121833618395
15:57:41.381 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099121833618395, scoreAtStart=1.0991228647940212
15:57:42.113 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.369002131283617E-10, gg=1.0314947559304813E-6
15:57:42.149 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.099121833618395, oldScore=1.0991228647940212, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:42.149 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0302196019555814E-6
15:57:42.844 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991208037167963
15:57:42.844 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991208037167963, scoreAtStart=1.099121833618395
15:57:43.577 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.353238100035243E-10, gg=1.0302196019555814E-6
15:57:43.612 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0991208037167963, oldScore=1.099121833618395, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:43.612 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0289482728654148E-6
15:57:44.307 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099119775085881
15:57:44.307 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099119775085881, scoreAtStart=1.0991208037167963
15:57:45.046 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.341476186091403E-10, gg=1.0289482728654148E-6
15:57:45.084 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.099119775085881, oldScore=1.0991208037167963, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:45.085 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0276794108223578E-6
15:57:45.791 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991187477232651
15:57:45.791 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991187477232651, scoreAtStart=1.099119775085881
15:57:46.529 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.33041541492564E-10, gg=1.0276794108223578E-6
15:57:46.562 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0991187477232651, oldScore=1.099119775085881, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:46.562 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0264127805312978E-6
15:57:47.271 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991177216267314
15:57:47.272 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991177216267314, scoreAtStart=1.0991187477232651
15:57:48.014 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.319486967804811E-10, gg=1.0264127805312978E-6
15:57:48.050 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.099117721626732, oldScore=1.0991187477232651, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:48.826 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0251483395784893E-6
15:57:49.540 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991166967940922
15:57:49.540 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991166967940922, scoreAtStart=1.0991177216267312
15:57:50.302 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.308592968560847E-10, gg=1.0251483395784893E-6
15:57:50.348 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.0991166967940933, oldScore=1.0991177216267312, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:50.348 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.023886078509518E-6
15:57:51.060 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991156732231706
15:57:51.060 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991156732231706, scoreAtStart=1.0991166967940933
15:57:51.788 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.29771662796159E-10, gg=1.023886078509518E-6
15:57:51.822 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0991156732231708, oldScore=1.0991166967940933, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:51.822 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.022625993427032E-6
15:57:52.519 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991146509117913
15:57:52.520 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991146509117913, scoreAtStart=1.0991156732231708
15:57:53.273 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.286855076452474E-10, gg=1.022625993427032E-6
15:57:53.305 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.0991146509117917, oldScore=1.0991156732231708, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:53.306 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0213680813414424E-6
15:57:54.021 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991136298577804
15:57:54.021 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991136298577804, scoreAtStart=1.0991146509117917
15:57:54.749 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.276007818931807E-10, gg=1.0213680813414424E-6
15:57:54.794 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0991136298577808, oldScore=1.0991146509117917, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:54.795 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.020112339400877E-6
15:57:55.501 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991126100589708
15:57:55.501 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991126100589708, scoreAtStart=1.0991136298577808
15:57:56.242 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.265174759983658E-10, gg=1.020112339400877E-6
15:57:56.284 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.09911261005897, oldScore=1.0991136298577808, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:57.062 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.018858764771378E-6
15:57:57.751 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991115915131933
15:57:57.751 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991115915131933, scoreAtStart=1.09911261005897
15:57:58.503 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.254355864658169E-10, gg=1.018858764771378E-6
15:57:58.549 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.0991115915131926, oldScore=1.09911261005897, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:57:58.550 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0176073546225245E-6
15:57:59.282 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991105742182858
15:57:59.283 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991105742182858, scoreAtStart=1.0991115915131926
15:58:00.019 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.243551110127648E-10, gg=1.0176073546225245E-6
15:58:00.055 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0991105742182856, oldScore=1.0991115915131926, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:00.055 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.016358106126516E-6
15:58:00.752 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991095581720864
15:58:00.752 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991095581720864, scoreAtStart=1.0991105742182856
15:58:01.486 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.232760471654694E-10, gg=1.016358106126516E-6
15:58:01.521 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.0991095581720864, oldScore=1.0991105742182856, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:01.521 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0151110164596062E-6
15:58:02.206 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991085433724375
15:58:02.207 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991085433724375, scoreAtStart=1.0991095581720864
15:58:02.946 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.221983926502487E-10, gg=1.0151110164596062E-6
15:58:02.982 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0991085433724372, oldScore=1.0991095581720864, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:02.982 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0138660828022096E-6
15:58:03.692 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991075298171848
15:58:03.692 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991075298171848, scoreAtStart=1.0991085433724372
15:58:04.424 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.211221449868789E-10, gg=1.0138660828022096E-6
15:58:04.460 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0991075298171844, oldScore=1.0991085433724372, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:05.256 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0126233023395409E-6
15:58:05.949 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099106517504174
15:58:05.949 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099106517504174, scoreAtStart=1.0991075298171848
15:58:06.679 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.200473019066059E-10, gg=1.0126233023395409E-6
15:58:06.722 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.0991065175041737, oldScore=1.0991075298171848, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:06.722 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.011382672261285E-6
15:58:07.423 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991055064312554
15:58:07.423 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991055064312554, scoreAtStart=1.0991065175041737
15:58:08.167 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.18973860823037E-10, gg=1.011382672261285E-6
15:58:08.208 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.099105506431256, oldScore=1.0991065175041737, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:08.208 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0101441897622735E-6
15:58:08.915 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991044965962853
15:58:08.915 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991044965962853, scoreAtStart=1.099105506431256
15:58:09.641 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.179018195987505E-10, gg=1.0101441897622735E-6
15:58:09.684 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.099104496596285, oldScore=1.099105506431256, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:09.684 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0089078520416017E-6
15:58:10.375 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991034879971149
15:58:10.375 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991034879971149, scoreAtStart=1.099104496596285
15:58:11.111 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.168311755269074E-10, gg=1.0089078520416017E-6
15:58:11.143 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0991034879971153, oldScore=1.099104496596285, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:11.143 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0076736563037761E-6
15:58:11.840 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991024806316065
15:58:11.841 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991024806316065, scoreAtStart=1.0991034879971153
15:58:12.565 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.157619266019088E-10, gg=1.0076736563037761E-6
15:58:12.609 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0991024806316068, oldScore=1.0991034879971153, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:13.368 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.006441599757314E-6
15:58:14.069 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991014744976202
15:58:14.069 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991014744976202, scoreAtStart=1.0991024806316072
15:58:14.804 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.146940700508423E-10, gg=1.006441599757314E-6
15:58:14.848 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.09910147449762, oldScore=1.0991024806316072, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:14.849 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0052116796162788E-6
15:58:15.546 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0991004695930213
15:58:15.547 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0991004695930213, scoreAtStart=1.09910147449762
15:58:16.278 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.136276037376334E-10, gg=1.0052116796162788E-6
15:58:16.311 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0991004695930209, oldScore=1.09910147449762, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:16.311 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0039838930990065E-6
15:58:17.007 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099099465915674
15:58:17.007 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099099465915674, scoreAtStart=1.0991004695930209
15:58:17.732 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.125625252653544E-10, gg=1.0039838930990065E-6
15:58:17.774 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.099099465915674, oldScore=1.0991004695930209, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:17.775 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0027582374286315E-6
15:58:18.469 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0990984634634515
15:58:18.469 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0990984634634515, scoreAtStart=1.099099465915674
15:58:19.197 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.114988321216993E-10, gg=1.0027582374286315E-6
15:58:19.238 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0990984634634513, oldScore=1.099099465915674, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:19.238 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0015347098333103E-6
15:58:19.926 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0990974622342244
15:58:19.926 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0990974622342244, scoreAtStart=1.0990984634634513
15:58:20.660 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.10436522064991E-10, gg=1.0015347098333103E-6
15:58:20.693 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0990974622342249, oldScore=1.0990984634634513, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:21.456 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -1.0003133075456873E-6
15:58:22.152 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0990964622258692
15:58:22.152 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0990964622258692, scoreAtStart=1.0990974622342247
15:58:22.881 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.093755926974272E-10, gg=1.0003133075456873E-6
15:58:22.917 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.0990964622258692, oldScore=1.0990974622342247, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:22.917 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.990940278032025E-7
15:58:23.608 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099095463436263
15:58:23.608 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099095463436263, scoreAtStart=1.0990964622258692
15:58:24.334 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.083160415571497E-10, gg=9.990940278032025E-7
15:58:24.370 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0990954634362644, oldScore=1.0990964622258692, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:24.370 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.978768678482222E-7
15:58:25.060 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099094465863289
15:58:25.060 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099094465863289, scoreAtStart=1.0990954634362644
15:58:25.785 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.0725786642442E-10, gg=9.978768678482222E-7
15:58:25.817 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.0990944658632884, oldScore=1.0990954634362644, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:25.817 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.966618249275533E-7
15:58:26.514 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099093469504828
15:58:26.514 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099093469504828, scoreAtStart=1.0990944658632884
15:58:27.250 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.062010648556896E-10, gg=9.966618249275533E-7
15:58:27.286 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0990934695048282, oldScore=1.0990944658632884, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:27.286 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.954488962928912E-7
15:58:27.972 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099092474358767
15:58:27.972 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099092474358767, scoreAtStart=1.0990934695048282
15:58:28.711 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.051456344634522E-10, gg=9.954488962928912E-7
15:58:28.744 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.0990924743587678, oldScore=1.0990934695048282, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:29.515 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.942380792007082E-7
15:58:30.213 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099091480422997
15:58:30.213 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099091480422997, scoreAtStart=1.0990924743587678
15:58:30.942 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.040915730713636E-10, gg=9.942380792007082E-7
15:58:30.978 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 0: score=1.099091480422997, oldScore=1.0990924743587678, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:30.978 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.930293709118304E-7
15:58:31.667 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0990904876954084
15:58:31.667 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0990904876954084, scoreAtStart=1.099091480422997
15:58:32.395 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.030388780474384E-10, gg=9.930293709118304E-7
15:58:32.428 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 1: score=1.0990904876954088, oldScore=1.099091480422997, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:32.428 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.9182276869235E-7
15:58:33.122 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099089496173896
15:58:33.122 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099089496173896, scoreAtStart=1.0990904876954088
15:58:33.856 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.019875472865464E-10, gg=9.9182276869235E-7
15:58:33.898 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 2: score=1.0990894961738955, oldScore=1.0990904876954088, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:33.898 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.906182698125708E-7
15:58:34.591 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.0990885058563562
15:58:34.591 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.0990885058563562, scoreAtStart=1.0990894961738955
15:58:35.342 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-6.009375783243334E-10, gg=9.906182698125708E-7
15:58:35.375 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 3: score=1.0990885058563558, oldScore=1.0990894961738955, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
15:58:35.375 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - slope = -9.894158715477267E-7
15:58:36.084 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Model score after step = 1.099087516740691
15:58:36.084 [main] DEBUG o.d.o.solvers.BackTrackLineSearch - Sufficient decrease (Wolfe cond.), exiting backtrack on iter 0: score=1.099087516740691, scoreAtStart=1.0990885058563558
15:58:36.824 [main] DEBUG o.d.o.solvers.ConjugateGradient - Polak-Ribiere gamma <= 0.0; using gamma=0.0 -> SGD line search. dgg=-5.998889688817285E-10, gg=9.894158715477267E-7
15:58:36.858 [main] DEBUG o.d.optimize.solvers.BaseOptimizer - Hit termination condition on iteration 4: score=1.099087516740691, oldScore=1.0990885058563558, condition=org.deeplearning4j.optimize.terminations.EpsTermination@29a5f4e7
Exception in thread "main" java.lang.AssertionError: testGradMLP2LayerIrisSimple() - score did not (sufficiently) decrease during learning - activationFn=sigmoid, lossFn=MCXENT, outputActivation=softmax, doLearningFirst=true (before=1.3293128473199909, scoreAfter=1.099087516740691)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.deeplearning4j.App.main(App.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.intellij.rt.execution.application.AppMain.main(AppMain.java:144)
Process finished with exit code 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment