Skip to content

Instantly share code, notes, and snippets.

@Bekbolatov

Bekbolatov/pcfg_1

Created November 15, 2015 03:58
Show Gist options
  • Save Bekbolatov/f8414529beab867b6142 to your computer and use it in GitHub Desktop.
Save Bekbolatov/f8414529beab867b6142 to your computer and use it in GitHub Desktop.
Download ZIP
pcfg with inf horizontal markovization
Raw
pcfg_1
/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/bin/java -Didea.launcher.port=7534 "-Didea.launcher.bin.path=/Applications/IntelliJ IDEA 14 CE.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath "/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/javafx-doclet.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/lib/tools.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/htmlconverter.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_80.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Users/rbekbolatov/repos/gh/bekbolatov/Coursework/uw/csep517_15au/hw/proj3/out/production/proj3:/Applications/IntelliJ IDEA 14 CE.app/Contents/lib/idea_rt.jar" com.intellij.rt.execution.application.AppMain edu.berkeley.nlp.assignments.PCFGParserTester2 -validate -quiet
Testing on validation data.
Maximum length for training sentences: 1000
Maximum length for test sentences: 40
Loading training trees (sections 2-21) ... done. (39832 trees)
Loading validation trees (section 22) ... done. (1578 trees)
Annotating / binarizing training trees ... done.
Building grammar ... SIZE: 219913
done. (14984 states)
Theta = 0.0769943732080714
Base tag probabilities = [NN : 0.13992745476975416, IN : 0.10373799509067101, NNP : 0.09627716235731999, DT : 0.08614693461666394, JJ : 0.06443704817121179, NNS : 0.06300445881595068, , : 0.05129006724012345, . : 0.041554564707566514, CD : 0.038491497092717264, RB : 0.03259903918621346, VBD : 0.031461177986333036, VB : 0.02782865347126611, CC : 0.025206625488932956, TO : 0.023532990606592648, VBZ : 0.022811959226464906, VBN : 0.021077273511938596, PRP : 0.018353143275777136, VBG : 0.015626907838505812, VBP : 0.013148033531643278, MD : 0.010318643239988715, POS : 0.009158677428454741, PRP$ : 0.008849212865305022, $ : 0.007759771290951425, `` : 0.0074650431355707415, '' : 0.007282943239567676, : : 0.005023009848130792, WDT : 0.0045198667828737675, JJR : 0.0034083205968666185, NNPS : 0.0028136012833305966, RP : 0.0028020226772263552, WP : 0.002487295111301983, WRB : 0.00225572298921716, JJS : 0.0020494132804506813, RBR : 0.0018609977811180302, -RRB- : 0.0014483783635850732, -LRB- : 0.0014378523580357632, EX : 9.083942789054638E-4, RBS : 4.747228502738867E-4, PDT : 3.8946220532447463E-4, FW : 2.4630852985385696E-4, WP$ : 1.768368932284101E-4, # : 1.494692788002038E-4, UH : 1.0210225382830822E-4, SYM : 6.105083218599873E-5, LS : 3.789361997751645E-5]
basic lexicon
5.356040821474935E-6
5.34095048448033E-4
hmm counter
Avvo: [NNP : 8.435225457135035E-5, UH : 4.462332458257498E-6, RB : 6.371862539642103E-7, NN : 9.183592036541057E-8, JJ : 5.234656485602435E-8, -LRB- : 4.183997917383357E-8, NNS : 4.183997917383357E-8, CD : 4.183997917383357E-8, WRB : 4.183997917383357E-8, IN : 4.183997917383357E-8, EX : 4.183997917383357E-8, VBD : 4.183997917383356E-8, DT : 4.183997917383356E-8, VB : 4.183997917383356E-8, VBG : 4.183997917383356E-8, RBS : 4.183997917383356E-8, -RRB- : 4.183997917383356E-8, . : 4.183997917383356E-8, CC : 4.183997917383356E-8, WP : 4.183997917383356E-8, # : 4.183997917383356E-8, PRP : 4.183997917383356E-8, : : 4.183997917383356E-8, FW : 4.183997917383356E-8, JJS : 4.183997917383356E-8, JJR : 4.183997917383356E-8, VBZ : 4.183997917383356E-8, RP : 4.183997917383356E-8, $ : 4.183997917383356E-8, PDT : 4.1839979173833554E-8, `` : 4.1839979173833554E-8, TO : 4.1839979173833554E-8, , : 4.1839979173833554E-8, MD : 4.1839979173833554E-8, '' : 4.1839979173833554E-8, VBP : 4.1839979173833554E-8, PRP$ : 4.1839979173833554E-8, POS : 4.1839979173833554E-8, VBN : 4.1839979173833554E-8, SYM : 4.1839979173833554E-8, NNPS : 4.1839979173833554E-8, WDT : 4.1839979173833554E-8, LS : 4.1839979173833554E-8, WP$ : 4.183997917383355E-8, RBR : 4.183997917383355E-8]
book:[NN : 5.26573137247527E-4, WRB : 0.0, : : 0.0, NNP : 0.0, CD : 0.0, CC : 0.0, NNS : 0.0, PRP$ : 0.0, UH : 0.0, , : 0.0, . : 0.0, -LRB- : 0.0, VBD : 0.0, POS : 0.0, VBG : 0.0, EX : 0.0, '' : 0.0, $ : 0.0, IN : 0.0, WP : 0.0, # : 0.0, VBZ : 0.0, WDT : 0.0, MD : 0.0, SYM : 0.0, PRP : 0.0, WP$ : 0.0, `` : 0.0, VBP : 0.0, PDT : 0.0, VB : 0.0, VBN : 0.0, NNPS : 0.0, RP : 0.0, JJR : 0.0, FW : 0.0, JJS : 0.0, LS : 0.0, RBS : 0.0, RBR : 0.0, RB : 0.0, TO : 0.0, DT : 0.0, JJ : 0.0, -RRB- : 0.0]
done.
[Current] P: 78.57 R: 73.33 F1: 75.86 EX: 0.0
[Current] P: 60.0 R: 64.28 F1: 62.06 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 64.7 R: 73.33 F1: 68.75 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 75.0 R: 66.66 F1: 70.58 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 84.21 R: 72.72 F1: 78.04 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 68.0 R: 65.38 F1: 66.66 EX: 0.0
[Current] P: 65.21 R: 65.21 F1: 65.21 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 72.0 R: 81.81 F1: 76.59 EX: 0.0
[Current] P: 71.42 R: 60.0 F1: 65.21 EX: 0.0
[Current] P: 60.0 R: 66.66 F1: 63.15 EX: 0.0
[Current] P: 71.42 R: 45.45 F1: 55.55 EX: 0.0
[Current] P: 59.09 R: 59.09 F1: 59.09 EX: 0.0
[Current] P: 54.54 R: 50.0 F1: 52.17 EX: 0.0
[Current] P: 71.42 R: 62.5 F1: 66.66 EX: 0.0
[Current] P: 84.61 R: 78.57 F1: 81.48 EX: 0.0
[Current] P: 66.66 R: 76.92 F1: 71.42 EX: 0.0
[Current] P: 87.5 R: 87.5 F1: 87.5 EX: 0.0
[Current] P: 47.61 R: 52.63 F1: 50.0 EX: 0.0
[Current] P: 100.0 R: 88.88 F1: 94.11 EX: 0.0
[Current] P: 94.11 R: 88.88 F1: 91.42 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 84.61 R: 84.61 F1: 84.61 EX: 0.0
[Current] P: 81.25 R: 68.42 F1: 74.28 EX: 0.0
[Current] P: 92.3 R: 85.71 F1: 88.88 EX: 0.0
[Current] P: 75.0 R: 72.41 F1: 73.68 EX: 0.0
[Current] P: 73.68 R: 77.77 F1: 75.67 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 63.63 R: 53.84 F1: 58.33 EX: 0.0
[Current] P: 90.0 R: 81.81 F1: 85.71 EX: 0.0
[Current] P: 73.68 R: 63.63 F1: 68.29 EX: 0.0
[Current] P: 72.41 R: 63.63 F1: 67.74 EX: 0.0
[Current] P: 90.0 R: 90.0 F1: 90.0 EX: 0.0
[Current] P: 92.3 R: 85.71 F1: 88.88 EX: 0.0
[Current] P: 53.12 R: 53.12 F1: 53.12 EX: 0.0
[Current] P: 94.11 R: 84.21 F1: 88.88 EX: 0.0
[Current] P: 63.15 R: 70.58 F1: 66.66 EX: 0.0
[Current] P: 78.26 R: 75.0 F1: 76.59 EX: 0.0
[Current] P: 87.5 R: 73.68 F1: 80.0 EX: 0.0
[Current] P: 77.77 R: 63.63 F1: 70.0 EX: 0.0
[Current] P: 100.0 R: 88.88 F1: 94.11 EX: 0.0
[Current] P: 70.0 R: 66.66 F1: 68.29 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 70.0 R: 77.77 F1: 73.68 EX: 0.0
[Current] P: 61.11 R: 57.89 F1: 59.45 EX: 0.0
[Current] P: 62.5 R: 58.82 F1: 60.6 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 70.58 R: 60.0 F1: 64.86 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 72.72 R: 57.14 F1: 64.0 EX: 0.0
[Current] P: 57.14 R: 54.54 F1: 55.81 EX: 0.0
[Current] P: 68.42 R: 61.9 F1: 65.0 EX: 0.0
[Current] P: 33.33 R: 28.57 F1: 30.76 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 82.35 R: 82.35 F1: 82.35 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 80.95 R: 80.95 F1: 80.95 EX: 0.0
[Current] P: 75.0 R: 75.0 F1: 75.0 EX: 0.0
[Current] P: 100.0 R: 82.35 F1: 90.32 EX: 0.0
[Current] P: 100.0 R: 90.9 F1: 95.23 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 77.77 R: 100.0 F1: 87.5 EX: 0.0
[Current] P: 100.0 R: 100.0 F1: 100.0 EX: 100.0
[Current] P: 30.0 R: 30.0 F1: 30.0 EX: 0.0
[Current] P: 94.11 R: 80.0 F1: 86.48 EX: 0.0
[Current] P: 75.0 R: 75.0 F1: 75.0 EX: 0.0
[Current] P: 68.75 R: 78.57 F1: 73.33 EX: 0.0
[Current] P: 38.09 R: 36.36 F1: 37.2 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 65.21 R: 71.42 F1: 68.18 EX: 0.0
[Current] P: 57.14 R: 61.53 F1: 59.25 EX: 0.0
[Current] P: 30.43 R: 41.17 F1: 35.0 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 56.0 R: 60.86 F1: 58.33 EX: 0.0
[Current] P: 60.71 R: 65.38 F1: 62.96 EX: 0.0
[Current] P: 79.16 R: 76.0 F1: 77.55 EX: 0.0
[Current] P: 82.35 R: 82.35 F1: 82.35 EX: 0.0
[Current] P: 61.53 R: 61.53 F1: 61.53 EX: 0.0
[Current] P: 62.5 R: 55.55 F1: 58.82 EX: 0.0
[Current] P: 46.15 R: 41.37 F1: 43.63 EX: 0.0
[Current] P: 77.27 R: 80.95 F1: 79.06 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 71.42 R: 50.0 F1: 58.82 EX: 0.0
[Current] P: 72.72 R: 57.14 F1: 64.0 EX: 0.0
[Current] P: 54.54 R: 50.0 F1: 52.17 EX: 0.0
[Current] P: 100.0 R: 66.66 F1: 80.0 EX: 0.0
[Current] P: 52.0 R: 50.0 F1: 50.98 EX: 0.0
[Current] P: 100.0 R: 85.71 F1: 92.3 EX: 0.0
[Current] P: 28.12 R: 30.0 F1: 29.03 EX: 0.0
[Current] P: 53.84 R: 46.66 F1: 50.0 EX: 0.0
[Current] P: 81.81 R: 81.81 F1: 81.81 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
[Current] P: 76.31 R: 80.55 F1: 78.37 EX: 0.0
[Current] P: 100.0 R: 0.0 F1: 0.0 EX: 0.0
Process finished with exit code 130
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment