smeared_lipstick.txt

gistfile1.txt

14/11/19 10:08:12 INFO listeners.LipstickPPNL: --- Init TBPPNL ---
2014-11-19 10:08:12,865 [main] INFO  com.netflix.lipstick.Main - build version: 0.6-SNAPSHOT, ts: 2014-11-19T09:02Z, git: 6324e130b4df844930f33cc7fb08aed94d07e76e
2014-11-19 10:08:12,865 [main] INFO  com.netflix.lipstick.Main - Logging error messages to: /home/chimpy/book/code/pig_1416391692863.log
2014-11-19 10:08:13,245 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/chimpy/.pigbootup not found
2014-11-19 10:08:13,740 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-11-19 10:08:13,741 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://nn:8020
2014-11-19 10:08:14,215 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: jt:8021
2014-11-19 10:08:14,273 [main] INFO  org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defaultFS
2014-11-19 10:08:14,274 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://nn:8020
2014-11-19 10:08:14,276 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to map-reduce job tracker at: jt:8021
2014-11-19 10:08:15,033 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY
2014-11-19 10:08:15,066 [main] INFO  org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, NewPartitionFilterOptimizer, PartitionFilterOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter], RULES_DISABLED=[FilterLogicExpressionSimplifier]}
2014-11-19 10:08:15,090 [main] INFO  org.apache.pig.newplan.logical.rules.ColumnPruneVisitor - Columns pruned for sightings: $1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11
2014-11-19 10:08:15,367 [main] INFO  com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Initializing class com.netflix.lipstick.pigstatus.RestfulPigStatusClient with serviceUrls: http://lipstick:9292
2014-11-19 10:08:15,369 [main] INFO  com.netflix.lipstick.listeners.LipstickPPNL - UUID: c7b0bbd4-ddc6-4354-814c-36a503847e02
2014-11-19 10:08:15,369 [main] INFO  com.netflix.lipstick.listeners.LipstickPPNL - [com.netflix.lipstick.pigtolipstick.BasicP2LClient@66662913]
2014-11-19 10:08:15,385 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold: 100 optimistic? false
2014-11-19 10:08:15,400 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer - Choosing to move algebraic foreach to combiner
2014-11-19 10:08:15,424 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
2014-11-19 10:08:15,424 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
2014-11-19 10:08:15,516 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2014-11-19 10:08:15,541 [main] WARN  org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2014-11-19 10:08:15,974 [main] INFO  com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Trying Lipstick server http://lipstick:9292
2014-11-19 10:08:17,111 [main] INFO  com.netflix.lipstick.pigstatus.RestfulPigStatusClient - This script has been assigned uuid: c7b0bbd4-ddc6-4354-814c-36a503847e02
2014-11-19 10:08:17,111 [main] INFO  com.netflix.lipstick.pigstatus.RestfulPigStatusClient - Navigate to http://lipstick:9292#job/c7b0bbd4-ddc6-4354-814c-36a503847e02 to view progress.
2014-11-19 10:08:17,116 [main] WARN  org.apache.pig.backend.hadoop20.PigJobControl - falling back to default JobControl (not using hadoop 0.20 ?)
java.lang.NoSuchFieldException: runnerState
	at java.lang.Class.getDeclaredField(Class.java:1953)
	at org.apache.pig.backend.hadoop20.PigJobControl.<clinit>(PigJobControl.java:51)
	at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:98)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:289)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:191)
	at org.apache.pig.PigServer.launchPlan(PigServer.java:1324)
	at org.apache.pig.LipstickPigServer.launchPlan(LipstickPigServer.java:142)
	at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1309)
	at org.apache.pig.PigServer.execute(PigServer.java:1299)
	at org.apache.pig.PigServer.executeBatch(PigServer.java:377)
	at org.apache.pig.PigServer.executeBatch(PigServer.java:355)
	at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
	at org.apache.pig.tools.grunt.GruntParser.processShCommand(GruntParser.java:1170)
	at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:183)
	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
	at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
	at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
	at com.netflix.lipstick.Main.run(Main.java:590)
	at com.netflix.lipstick.Main.main(Main.java:130)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
2014-11-19 10:08:17,123 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
2014-11-19 10:08:17,124 [main] WARN  org.apache.pig.tools.pigstats.ScriptState - unable to read pigs manifest file
2014-11-19 10:08:17,124 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
2014-11-19 10:08:17,127 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Reduce phase detected, estimating # of required reducers.
2014-11-19 10:08:17,127 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimator: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
2014-11-19 10:08:17,136 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReducer=1000000000 maxReducers=999 totalInputFileSize=80689972
2014-11-19 10:08:17,136 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism to 1
2014-11-19 10:08:17,137 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - creating jar file Job2584472636876927157.jar
2014-11-19 10:08:21,264 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - jar file Job2584472636876927157.jar created
2014-11-19 10:08:21,288 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
2014-11-19 10:08:21,297 [main] INFO  org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
2014-11-19 10:08:21,297 [main] INFO  org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cache
2014-11-19 10:08:21,298 [main] INFO  org.apache.pig.data.SchemaTupleFrontend - Setting key [pig.schematuple.classes] with classes to deserialize []
2014-11-19 10:08:21,370 [main] ERROR org.apache.pig.tools.grunt.LipstickGrunt - ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
Details at logfile: /home/chimpy/book/code/pig_1416391692863.log