Created
July 21, 2015 13:28
-
-
Save prongs/d0d6e68034a4220cb3c5 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2015-07-21 18:53:39,998 WARN [main]: common.LogUtils (LogUtils.java:logConfigLocation(145)) - hive-site.xml not found on CLASSPATH | |
2015-07-21 18:53:40,011 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Execution log at: /var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T//rajat.khandelwal/rajat.khandelwal_20150721185353_1289f2f0-6bd8-4df7-9a9d-3c21220bf425.log | |
2015-07-21 18:53:40,254 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=deserializePlan from=org.apache.hadoop.hive.ql.exec.Utilities> | |
2015-07-21 18:53:40,255 INFO [main]: exec.Utilities (Utilities.java:deserializePlan(819)) - Deserializing MapredWork via kryo | |
2015-07-21 18:53:40,590 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=deserializePlan start=1437485020254 end=1437485020590 duration=336 from=org.apache.hadoop.hive.ql.exec.Utilities> | |
2015-07-21 18:53:40,625 INFO [main]: mr.ExecDriver (ExecDriver.java:execute(285)) - Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat | |
2015-07-21 18:53:40,630 INFO [main]: mr.ExecDriver (ExecDriver.java:execute(307)) - adding libjars: file:///Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar,file:///Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar,file:///Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:getInputPaths(2994)) - Processing alias rrcube | |
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:getInputPaths(3011)) - Adding input file file:/Users/rajat.khandelwal/2015-07-18-02 | |
2015-07-21 18:53:40,633 INFO [main]: exec.Utilities (Utilities.java:isEmptyPath(2340)) - Content Summary not cached for file:/Users/rajat.khandelwal/2015-07-18-02 | |
2015-07-21 18:53:40,647 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=serializePlan from=org.apache.hadoop.hive.ql.exec.Utilities> | |
2015-07-21 18:53:40,648 INFO [main]: exec.Utilities (Utilities.java:serializePlan(792)) - Serializing MapWork via kryo | |
2015-07-21 18:53:40,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=serializePlan start=1437485020647 end=1437485020753 duration=106 from=org.apache.hadoop.hive.ql.exec.Utilities> | |
2015-07-21 18:53:40,790 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - session.id is deprecated. Instead, use dfs.metrics.session-id | |
2015-07-21 18:53:40,791 INFO [main]: jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId= | |
2015-07-21 18:53:40,844 INFO [main]: jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized | |
2015-07-21 18:53:40,864 INFO [main]: exec.Utilities (Utilities.java:getBaseWork(360)) - No plan file found: file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/rajat.khandelwal/hive_2015-07-21_18-53-40_601_363257168476583723-1/-mr-10001/2b043438-27f9-4313-ada9-99f68e872203/reduce.xml | |
2015-07-21 18:53:41,082 WARN [main]: mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(153)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. | |
2015-07-21 18:53:41,517 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - <PERFLOG method=getSplits from=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat> | |
2015-07-21 18:53:41,808 INFO [main]: io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(404)) - CombineHiveInputSplit creating pool for file:/Users/rajat.khandelwal/2015-07-18-02; using filter path file:/Users/rajat.khandelwal/2015-07-18-02 | |
2015-07-21 18:53:41,823 INFO [main]: input.FileInputFormat (FileInputFormat.java:listStatus(281)) - Total input paths to process : 1 | |
2015-07-21 18:53:41,845 INFO [main]: input.CombineFileInputFormat (CombineFileInputFormat.java:createSplits(413)) - DEBUG: Terminated node allocation with : CompletedNodes: 1, size left: 0 | |
2015-07-21 18:53:41,848 INFO [main]: io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(459)) - number of splits 1 | |
2015-07-21 18:53:41,848 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - </PERFLOG method=getSplits start=1437485021517 end=1437485021848 duration=331 from=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat> | |
2015-07-21 18:53:41,879 INFO [main]: mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(494)) - number of splits:1 | |
2015-07-21 18:53:42,028 INFO [main]: mapreduce.JobSubmitter (JobSubmitter.java:printTokens(583)) - Submitting tokens for job: job_local2017936282_0001 | |
2015-07-21 18:53:42,580 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/opencsv-2.3.jar | |
2015-07-21 18:53:42,650 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar | |
2015-07-21 18:53:42,858 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:42,870 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:42,871 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar | |
2015-07-21 18:53:42,884 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar | |
2015-07-21 18:53:42,884 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/yoda-commons-1.0.50-hdp.jar | |
2015-07-21 18:53:42,894 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar | |
2015-07-21 18:53:42,927 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/hive-metastore-0.13.4-inm-SNAPSHOT.jar | |
2015-07-21 18:53:42,935 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar | |
2015-07-21 18:53:42,935 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:42,942 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:42,943 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/joda-time-2.0.jar | |
2015-07-21 18:53:42,949 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar | |
2015-07-21 18:53:42,950 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/yoda-proto-lib-1.0.50.jar | |
2015-07-21 18:53:42,957 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar | |
2015-07-21 18:53:42,957 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-yoda-1.1.19-SNAPSHOT.jar | |
2015-07-21 18:53:42,965 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar | |
2015-07-21 18:53:42,966 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(207)) - Creating symlink: /tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar <- /Users/rajat.khandelwal/Git/incubator-lens/lens-dist/target/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/apache-lens-2.3.0-beta-incubating-SNAPSHOT-bin/server/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:42,973 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(171)) - Localized file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar as file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:43,149 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar | |
2015-07-21 18:53:43,149 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar | |
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar | |
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar | |
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:43,150 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar | |
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar | |
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar | |
2015-07-21 18:53:43,151 INFO [main]: mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:makeClassLoader(240)) - file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar | |
2015-07-21 18:53:43,159 INFO [main]: mapreduce.Job (Job.java:submit(1300)) - The url to track the job: http://localhost:8080/ | |
2015-07-21 18:53:43,161 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config org.apache.hadoop.hive.shims.HadoopShimsSecure$NullOutputCommitter | |
2015-07-21 18:53:43,162 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.hive.shims.HadoopShimsSecure$NullOutputCommitter | |
2015-07-21 18:53:43,166 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Job running in-process (local Hadoop) | |
2015-07-21 18:53:43,240 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks | |
2015-07-21 18:53:43,245 INFO [LocalJobRunner Map Task Executor #0]: mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local2017936282_0001_m_000000_0 | |
2015-07-21 18:53:43,291 INFO [LocalJobRunner Map Task Executor #0]: util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux. | |
2015-07-21 18:53:43,292 INFO [LocalJobRunner Map Task Executor #0]: mapred.Task (Task.java:initialize(587)) - Using ResourceCalculatorProcessTree : null | |
2015-07-21 18:53:43,301 INFO [LocalJobRunner Map Task Executor #0]: mapred.MapTask (MapTask.java:updateJobWithSplit(482)) - Processing split: Paths:/Users/rajat.khandelwal/2015-07-18-02/part-00029:0+125738200InputFormatClass: org.apache.hadoop.hive.ql.io.RCFileInputFormat | |
2015-07-21 18:53:43,337 INFO [LocalJobRunner Map Task Executor #0]: io.CodecPool (CodecPool.java:getDecompressor(126)) - Got brand-new decompressor | |
2015-07-21 18:53:43,350 INFO [LocalJobRunner Map Task Executor #0]: io.CodecPool (CodecPool.java:getDecompressor(126)) - Got brand-new decompressor | |
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: io.HiveContextAwareRecordReader (HiveContextAwareRecordReader.java:initIOContext(168)) - Processing file file:/Users/rajat.khandelwal/2015-07-18-02/part-00029 | |
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.file is deprecated. Instead, use mapreduce.map.input.file | |
2015-07-21 18:53:43,352 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.start is deprecated. Instead, use mapreduce.map.input.start | |
2015-07-21 18:53:43,353 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - map.input.length is deprecated. Instead, use mapreduce.map.input.length | |
2015-07-21 18:53:43,353 INFO [LocalJobRunner Map Task Executor #0]: mapred.MapTask (MapTask.java:runOldMapper(436)) - numReduceTasks: 0 | |
2015-07-21 18:53:43,367 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(87)) - maximum memory = 477102080 | |
2015-07-21 18:53:43,367 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(92)) - conf classpath = [file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/hadoop-unjar8423227006782307916/, file:/Users/rajat.khandelwal/Git/hive/packaging/target/apache-hive-0.13.4-inm-SNAPSHOT-bin/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/hive-common-0.13.4-inm-SNAPSHOT.jar, file:/var/folders/m6/05_cdz4d6dn1jh51c_dyg46mhr0n9j/T/hadoop-unjar8423227006782307916/classes, file:/Users/rajat.khandelwal/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-commons-1.0.50-hdp.jar, file:/Users/rajat.khandelwal/Git/hive/metastore/target/hive-metastore-0.13.4-inm-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/incubator-lens/lens-query-lib/target/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/joda-time-2.0.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/yoda-proto-lib-1.0.50.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-yoda-1.1.19-SNAPSHOT.jar, file:/Users/rajat.khandelwal/Git/grill-internal/lens-internal-dist/target/lens-internal-dist-1.1.19-SNAPSHOT-pkg/lib/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar] | |
2015-07-21 18:53:43,368 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(94)) - thread classpath = [file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022131/opencsv-2.3.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022132/lens-cube-2.3.0-beta-incubating-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022133/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT-tests.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022134/yoda-commons-1.0.50-hdp.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022135/hive-metastore-0.13.4-inm-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022136/lens-query-lib-2.3.0-beta-incubating-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022137/joda-time-2.0.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022138/yoda-proto-lib-1.0.50.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022139/lens-yoda-1.1.19-SNAPSHOT.jar, file:/tmp/hadoop-rajat.khandelwal/mapred/local/2005264707/1437485022140/lens-storage-db-2.3.0-beta-incubating-SNAPSHOT.jar] | |
2015-07-21 18:53:43,371 INFO [LocalJobRunner Map Task Executor #0]: mr.ObjectCache (ObjectCache.java:retrieve(41)) - Ignoring retrieval request: __MAP_PLAN__ | |
2015-07-21 18:53:43,371 INFO [LocalJobRunner Map Task Executor #0]: mr.ObjectCache (ObjectCache.java:cache(36)) - Ignoring cache key: __MAP_PLAN__ | |
2015-07-21 18:53:43,413 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (MapOperator.java:setChildren(387)) - dump TS struct<impression_id:string,request_ad_formatter:string,request_ad_logic:string,request_ad_format:string,adgroup_id:string,ad_inc_id:int,unused6:string,unused7:string,adv_account_guid:string,rq_campgnidbig:string,country_carrier_id:bigint,unused11:string,unused12:string,request_code_version:int,request_handset_user_agent:string,handset_device_id:bigint,request_host:string,unused17:string,request_market:string,request_nfr:string,request_nodeinfo:string,request_orig_handset:string,request_page_url:string,site_guid:string,request_time:timestamp,age:string,gender:string,request_version:bigint,request_ip:string,request_x_user_agent:string,request_x_header:string,click_x_real_ip:string,page_requests:double,valid_page_requests:double,total_ad_requests:double,valid_ad_requests:double,served_impressions:double,page_impressions:double,request_mkcpcadserved:double,click_ccid:int,unused40:string,click_fraud:string,click_fraudset:string,click_handsetid:string,click_jc:string,cl_rq_ccid:bigint,click_request_device_id:bigint,cl_rq_site_inc_id:bigint,cl_rq_ua:string,click_terminated:string,click_time:timestamp,click_version:bigint,click_uid:string,billed_status:string,billed_createdon:string,unused55:string,unused56:string,billing_impression_type:string,unused58:string,unused59:string,bl_loggingtime:timestamp,unused61:string,bl_siteid:string,bl_adgrpid:string,click:double,total_burn:double,agency_revenue:double,pub_revenue:double,request_slot_id:bigint,request_slot_served:bigint,request_uid:string,unused71:string,unused72:string,rq_loc_src:string,request_geo_city:bigint,rq_geo_region:string,unused76:string,unused77:string,unused78:string,bl_overbill_revenue:double,cl_overbill_cpc_clicks:double,download_time:timestamp,matched_conversions:double,request_intg_method:string,request_intg_version:string,request_intg_origin:string,request_intg_family:string,integration_direct:string,dl_app_id:string,download_u_id:string,unused90:string,unused91:string,download_hash_type:string,joined_click_hash_type:string,non_billable_impressions:double,rq_overbill_cpm_adimp:double,non_billable_cpc_clicks:double,terminated_clicks:double,fraud_clicks:double,nofund_revenue:double,download_source:string,rq_udid_type:string,request_adtype:string,download_goal:string,dl_impid:string,download_joined_count:double,download_unjoined_count:double,download_duplicate_count:double,dl_udid_type:string,cl_udid_type:string,dl_terminated:string,cl_id:string,ad_response_format:string,unused113:string,dcp_page_requests:double,dcp_valid_page_requests:double,dcp_ad_requests:double,dcp_valid_ad_requests:double,dcp_page_impressions:double,dcp_cpc_impressions:double,dcp_total_clicks:double,dcp_fraud_clicks:double,dcp_billed_cpc_clicks:double,dcp_non_billable_cpc_clicks:double,dcp_cpm_impressions:double,dcp_non_billable_cpm_impressions:double,dcp_total_burn:double,dcp_pub_revenue:double,dcp_agency_revenue:double,dcp_cpm_clicks:double,dcp_cpc_beacon_count:double,dcp_cpm_beacon_count:double,user_optout:string,user_unique_count_internal:double,user_valid_page_requests:double,user_valid_ad_requests:double,user_ad_impressions:double,user_page_impressions:double,user_custom_segment_id_segment_retargeting:bigint,user_segment_valid_ad_requests:double,user_segment_unique_count:double,rm_sprout_id:string,rm_time:string,rm_source_name:string,rm_expand_count:double,rm_dismiss_count:double,rm_cta_count:double,rm_media_play_count:double,rm_media_auto_play_count:double,rm_media_start_count:double,rm_media_q1_count:double,rm_media_q2_count:double,rm_media_q3_count:double,rm_media_end_count:double,rm_dwell_time:double,rm_start_millis:string,rm_end_millis:string,rm_total:double,rm_views:double,rm_dls_count:double,rm_dlf_count:double,request_csid:string,cl_final_landing_page:string,rq_aud_seg_ids:string,rq_conceptual_rollover:string,rq_conceptual_ron:string,rq_concept_persona_id:string,rq_blinded_site_id:string,rq_tagged_user:string,rq_u_aid:string,rq_inventory_type:string,unused171:string,unused172:string,request_is_geo_enabled:string,request_geo_fence:string,cp_user_frequency:string,cp_user_unique_count_internal:double,is_impression_geo_targeted:string,geo_targeting_constituent:string,request_system_latlon:string,rq_served_city:string,rq_geo_state:string,rq_geo_zip:string,nondiscounted_burn:double,request_ref_tag:string,down_carrier_region_id:string,down_carrier_city_id:int,request_selected_uid_type:string,request_all_uid_type:string,request_uparams:string,request_uid_params:string,unused191:string,ci_ret_event_type:string,ci_ret_adgroup_id:bigint,ci_ret_unique_count:double,ci_ret_ad_request:double,ci_ret_ad_impressions:double,ci_ret_page_request:double,ci_ret_page_impressions:double,app_ret_app_id:string,app_ret_unique_count:double,app_ret_ad_requests:double,app_ret_ad_impressions:double,app_ret_page_request:double,app_ret_page_impressions:double,user_sig_unique_count:double,user_signal_ad_impressions:double,user_signal_clicks:double,user_signal_ download:double,user_signal_revenue:double,user_signal_ publisher_revenue:double,user_signal_ agency_revenue:double,user_life_span:string,user_life_unique_count:double,dcp_fraud_beacons:double,request_derived_latlon:string,request_custom_region_fence:string,volume_discount:double,creative_charges:double,io_discount:double,withhold_taxes:double,bl_fund_source_id:int,user_site_visited_count:double,user_app_dist_unique_count:double,request_geo_type:string,budget_tier_id:bigint,served_ad_format:string,request_conv_factor:double,segment_id:bigint,rq_optout:string,bc_id:string,beacon_time:timestamp,bc_terminated:string,bc_terminationreason:string,bc_fraud:string,beacon_fraudset:string,bc_total_pings:double,bc_valid_pings:double,bc_fraud_pings:double,bc_terminated_pings:double,bc_click_no_pings:double,rq_id:string,event_time:timestamp,predicted_clicks:double,rq_adgrpincid:string,request_muh:double,request_mul:double,request_mucons:double,request_ecpm_goalseek:double,request_muest:double,async_type:string,async_method:string,unused252:string,template_id:bigint,demand_capabilities_ids:string,request_creative_inc_id:int,effective_slot_width:double,effective_slot_height:double,creative_height:double,creative_width:double,bl_data_seller_id:int,bl_data_provider_id:int,data_enrichment_cost:double,cpm_billed_beacons:double,rq_yob:string,rq_interests:string,rq_user_country:string,rq_user_city:string,rq_user_zip:string,rq_user_loc_type:string,rq_rtbs_pub_id:string,rq_rtbs_site_name:string,rq_rtbs_site_url:string,rq_rtbs_site_platform:string,supply_source_type:string,participated_impressions:double,cbp_segment_id:bigint,device_orientation:string,device_localization:string,device_networktype:string,request_discarded_u_id_params:string,request_ad_frequency:string,request_ad_recency:string,request_adgroup_frequency:string,request_adgroup_recency:string,rq_int_orientation:string,bl_data_event_type:string,request_apbssid:string,request_req_dst:string,request_fill_dst:string,request_served_dst:string,predicted_ecpm:double,request_learning_auction_type:string,rq_auction_conv_factor:double,request_placement_id:bigint,custom_segment_id:string,user_factual_unique_count:double,user_factual_valid_ad_requests:double,install_count:double,normalized_user_id:string,rq_user_profile_version:string,rq_app_affinity_version:string,rq_user_features:string,auto_computed_lambda:double,user_lambda:double,lambda_used:double,normal_burn:double,risky_burn:double,is_predicted_cvr_null:boolean,is_super_tier:string,learning_phase:string,request_predicted_engagement_map:string,request_predicted_expand_rate:double,request_poi_map:string,impression_poi_map:string,request_cat_distance:double,rq_category:string,cl_event_state:string,click_other_invalidset:string,accidental_clicks:double,custom_ad_unit_id:int,same_adv_second_adid:string,same_adv_second_advid:string,user_location_context:double,user_location_context_ad_req:double,user_location_context_page_req:string,user_location_context_unique_count:double,rq_asm_segment_id:string,diff_adv_second_adid:string,diff_adv_second_advid:string,diff_adv_second_ranks:string,num_candidate_ads:string,num_candidate_adgroups:string,num_candidate_advs:string,same_adv_second_ranks:string,cl_conv_factor:double,rq_geoseg_type:string,user_enrich_pg_req:double,user_enrich_pg_imp:double,user_enrich_valid_clicks:double,user_enrich_total_burn:double,rq_deal_id:int,rq_highest_bid:double,rq_bid_floor:double,rq_highbid_dst:string,rq_predicted_media_quartile:double,rq_predicted_cta:double,rm_custom_count:double,rm_media_stop_value:double,rm_custom_value:double,rm_media_stop_count:double,rm_media_error_count:double,rm_media_id:string,rm_media_type:string,rm_custom_action:string,rm_custom_label:string,rm_custom_catgeory:string,rq_device_modelid:string,rq_is_vbssid:boolean,dl_confident_install:double,dl_confident_conversion:double,rq_target_cpd:double,rq_geodata_vendor_id:string,rq_serving_cpc_floor:double,rq_concept_id:string,segmentdemand_served_imp:double,segmentdemand_valid_clicks:double,segmentdemand_download_installs:double,segmentdemand_total_burn:double,segmentdemand_rendered_imp:double,rq_is_adgroup_subsidized:boolean,rq_adgroup_stage:string,rq_is_subsidy_impression:boolean,rq_is_muest_null:boolean,rq_is_derived_site_placement_id:boolean,rq_site_placement_id:string,rm_unique_media_play_count:double,rm_unique_media_auto_play_count:double,rm_unique_media_start_count:double,rm_unique_media_q1_count:double,rm_unique_media_q2_count:double,rm_unique_media_q3_count:double,rm_unique_media_complete_count:double,rm_form_submit_success_count:double,rm_form_submit_failure_count:double,rm_form_submit_attempt_count:double,rm_unique_form_submit_success_count:double,rm_unique_form_submit_failure_count:double,rm_unique_form_submit_attempt_count:double,rq_served_location_source:string,rq_served_location_level_of_targeting:string,rq_served_location_id:string,rq_primary_cities:string,ltv_event_time:timestamp,ltv_event_name:string,ltv_event_value:double,ltv_event_count:double,pub_account_guid:string,site_inc_id:string,operating_system_id:string,device_type_id_cube:string,ltv_manufacturer_id:string,country_id:string,ltv_click:double,ltv_install:double,ltv_valid_click:double,ltv_impression:double,ltv_unique_install_event_count:double,ltv_is_confident_install:string,rq_qualifying_flp_count:double,rq_participant_flp_count:double,it:string,colo:string> | |
2015-07-21 18:53:43,414 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:configure(124)) - | |
<MAP>Id =4 | |
<Children> | |
<TS>Id =0 | |
<Children> | |
<FIL>Id =1 | |
<Children> | |
<SEL>Id =2 | |
<Children> | |
<FS>Id =3 | |
<Children> | |
<\Children> | |
<Parent>Id = 2 null<\Parent> | |
<\FS> | |
<\Children> | |
<Parent>Id = 1 null<\Parent> | |
<\SEL> | |
<\Children> | |
<Parent>Id = 0 null<\Parent> | |
<\FIL> | |
<\Children> | |
<Parent>Id = 4 null<\Parent> | |
<\TS> | |
<\Children> | |
<Parent><\Parent> | |
<\MAP> | |
2015-07-21 18:53:43,417 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:initialize(337)) - Initializing Self 4 MAP | |
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initialize(337)) - Initializing Self 0 TS | |
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initializeChildren(410)) - Operator 0 TS initialized | |
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initializeChildren(414)) - Initializing children of 0 TS | |
2015-07-21 18:53:43,419 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(449)) - Initializing child 1 FIL | |
2015-07-21 18:53:43,420 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(337)) - Initializing Self 1 FIL | |
2015-07-21 18:53:44,028 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initializeChildren(410)) - Operator 1 FIL initialized | |
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initializeChildren(414)) - Initializing children of 1 FIL | |
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(449)) - Initializing child 2 SEL | |
2015-07-21 18:53:44,029 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(337)) - Initializing Self 2 SEL | |
2015-07-21 18:53:44,033 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (SelectOperator.java:initializeOp(63)) - SELECT struct<impression_id:string,request_ad_formatter:string,request_ad_logic:string,request_ad_format:string,adgroup_id:string,ad_inc_id:int,unused6:string,unused7:string,adv_account_guid:string,rq_campgnidbig:string,country_carrier_id:bigint,unused11:string,unused12:string,request_code_version:int,request_handset_user_agent:string,handset_device_id:bigint,request_host:string,unused17:string,request_market:string,request_nfr:string,request_nodeinfo:string,request_orig_handset:string,request_page_url:string,site_guid:string,request_time:timestamp,age:string,gender:string,request_version:bigint,request_ip:string,request_x_user_agent:string,request_x_header:string,click_x_real_ip:string,page_requests:double,valid_page_requests:double,total_ad_requests:double,valid_ad_requests:double,served_impressions:double,page_impressions:double,request_mkcpcadserved:double,click_ccid:int,unused40:string,click_fraud:string,click_fraudset:string,click_handsetid:string,click_jc:string,cl_rq_ccid:bigint,click_request_device_id:bigint,cl_rq_site_inc_id:bigint,cl_rq_ua:string,click_terminated:string,click_time:timestamp,click_version:bigint,click_uid:string,billed_status:string,billed_createdon:string,unused55:string,unused56:string,billing_impression_type:string,unused58:string,unused59:string,bl_loggingtime:timestamp,unused61:string,bl_siteid:string,bl_adgrpid:string,click:double,total_burn:double,agency_revenue:double,pub_revenue:double,request_slot_id:bigint,request_slot_served:bigint,request_uid:string,unused71:string,unused72:string,rq_loc_src:string,request_geo_city:bigint,rq_geo_region:string,unused76:string,unused77:string,unused78:string,bl_overbill_revenue:double,cl_overbill_cpc_clicks:double,download_time:timestamp,matched_conversions:double,request_intg_method:string,request_intg_version:string,request_intg_origin:string,request_intg_family:string,integration_direct:string,dl_app_id:string,download_u_id:string,unused90:string,unused91:string,download_hash_type:string,joined_click_hash_type:string,non_billable_impressions:double,rq_overbill_cpm_adimp:double,non_billable_cpc_clicks:double,terminated_clicks:double,fraud_clicks:double,nofund_revenue:double,download_source:string,rq_udid_type:string,request_adtype:string,download_goal:string,dl_impid:string,download_joined_count:double,download_unjoined_count:double,download_duplicate_count:double,dl_udid_type:string,cl_udid_type:string,dl_terminated:string,cl_id:string,ad_response_format:string,unused113:string,dcp_page_requests:double,dcp_valid_page_requests:double,dcp_ad_requests:double,dcp_valid_ad_requests:double,dcp_page_impressions:double,dcp_cpc_impressions:double,dcp_total_clicks:double,dcp_fraud_clicks:double,dcp_billed_cpc_clicks:double,dcp_non_billable_cpc_clicks:double,dcp_cpm_impressions:double,dcp_non_billable_cpm_impressions:double,dcp_total_burn:double,dcp_pub_revenue:double,dcp_agency_revenue:double,dcp_cpm_clicks:double,dcp_cpc_beacon_count:double,dcp_cpm_beacon_count:double,user_optout:string,user_unique_count_internal:double,user_valid_page_requests:double,user_valid_ad_requests:double,user_ad_impressions:double,user_page_impressions:double,user_custom_segment_id_segment_retargeting:bigint,user_segment_valid_ad_requests:double,user_segment_unique_count:double,rm_sprout_id:string,rm_time:string,rm_source_name:string,rm_expand_count:double,rm_dismiss_count:double,rm_cta_count:double,rm_media_play_count:double,rm_media_auto_play_count:double,rm_media_start_count:double,rm_media_q1_count:double,rm_media_q2_count:double,rm_media_q3_count:double,rm_media_end_count:double,rm_dwell_time:double,rm_start_millis:string,rm_end_millis:string,rm_total:double,rm_views:double,rm_dls_count:double,rm_dlf_count:double,request_csid:string,cl_final_landing_page:string,rq_aud_seg_ids:string,rq_conceptual_rollover:string,rq_conceptual_ron:string,rq_concept_persona_id:string,rq_blinded_site_id:string,rq_tagged_user:string,rq_u_aid:string,rq_inventory_type:string,unused171:string,unused172:string,request_is_geo_enabled:string,request_geo_fence:string,cp_user_frequency:string,cp_user_unique_count_internal:double,is_impression_geo_targeted:string,geo_targeting_constituent:string,request_system_latlon:string,rq_served_city:string,rq_geo_state:string,rq_geo_zip:string,nondiscounted_burn:double,request_ref_tag:string,down_carrier_region_id:string,down_carrier_city_id:int,request_selected_uid_type:string,request_all_uid_type:string,request_uparams:string,request_uid_params:string,unused191:string,ci_ret_event_type:string,ci_ret_adgroup_id:bigint,ci_ret_unique_count:double,ci_ret_ad_request:double,ci_ret_ad_impressions:double,ci_ret_page_request:double,ci_ret_page_impressions:double,app_ret_app_id:string,app_ret_unique_count:double,app_ret_ad_requests:double,app_ret_ad_impressions:double,app_ret_page_request:double,app_ret_page_impressions:double,user_sig_unique_count:double,user_signal_ad_impressions:double,user_signal_clicks:double,user_signal_ download:double,user_signal_revenue:double,user_signal_ publisher_revenue:double,user_signal_ agency_revenue:double,user_life_span:string,user_life_unique_count:double,dcp_fraud_beacons:double,request_derived_latlon:string,request_custom_region_fence:string,volume_discount:double,creative_charges:double,io_discount:double,withhold_taxes:double,bl_fund_source_id:int,user_site_visited_count:double,user_app_dist_unique_count:double,request_geo_type:string,budget_tier_id:bigint,served_ad_format:string,request_conv_factor:double,segment_id:bigint,rq_optout:string,bc_id:string,beacon_time:timestamp,bc_terminated:string,bc_terminationreason:string,bc_fraud:string,beacon_fraudset:string,bc_total_pings:double,bc_valid_pings:double,bc_fraud_pings:double,bc_terminated_pings:double,bc_click_no_pings:double,rq_id:string,event_time:timestamp,predicted_clicks:double,rq_adgrpincid:string,request_muh:double,request_mul:double,request_mucons:double,request_ecpm_goalseek:double,request_muest:double,async_type:string,async_method:string,unused252:string,template_id:bigint,demand_capabilities_ids:string,request_creative_inc_id:int,effective_slot_width:double,effective_slot_height:double,creative_height:double,creative_width:double,bl_data_seller_id:int,bl_data_provider_id:int,data_enrichment_cost:double,cpm_billed_beacons:double,rq_yob:string,rq_interests:string,rq_user_country:string,rq_user_city:string,rq_user_zip:string,rq_user_loc_type:string,rq_rtbs_pub_id:string,rq_rtbs_site_name:string,rq_rtbs_site_url:string,rq_rtbs_site_platform:string,supply_source_type:string,participated_impressions:double,cbp_segment_id:bigint,device_orientation:string,device_localization:string,device_networktype:string,request_discarded_u_id_params:string,request_ad_frequency:string,request_ad_recency:string,request_adgroup_frequency:string,request_adgroup_recency:string,rq_int_orientation:string,bl_data_event_type:string,request_apbssid:string,request_req_dst:string,request_fill_dst:string,request_served_dst:string,predicted_ecpm:double,request_learning_auction_type:string,rq_auction_conv_factor:double,request_placement_id:bigint,custom_segment_id:string,user_factual_unique_count:double,user_factual_valid_ad_requests:double,install_count:double,normalized_user_id:string,rq_user_profile_version:string,rq_app_affinity_version:string,rq_user_features:string,auto_computed_lambda:double,user_lambda:double,lambda_used:double,normal_burn:double,risky_burn:double,is_predicted_cvr_null:boolean,is_super_tier:string,learning_phase:string,request_predicted_engagement_map:string,request_predicted_expand_rate:double,request_poi_map:string,impression_poi_map:string,request_cat_distance:double,rq_category:string,cl_event_state:string,click_other_invalidset:string,accidental_clicks:double,custom_ad_unit_id:int,same_adv_second_adid:string,same_adv_second_advid:string,user_location_context:double,user_location_context_ad_req:double,user_location_context_page_req:string,user_location_context_unique_count:double,rq_asm_segment_id:string,diff_adv_second_adid:string,diff_adv_second_advid:string,diff_adv_second_ranks:string,num_candidate_ads:string,num_candidate_adgroups:string,num_candidate_advs:string,same_adv_second_ranks:string,cl_conv_factor:double,rq_geoseg_type:string,user_enrich_pg_req:double,user_enrich_pg_imp:double,user_enrich_valid_clicks:double,user_enrich_total_burn:double,rq_deal_id:int,rq_highest_bid:double,rq_bid_floor:double,rq_highbid_dst:string,rq_predicted_media_quartile:double,rq_predicted_cta:double,rm_custom_count:double,rm_media_stop_value:double,rm_custom_value:double,rm_media_stop_count:double,rm_media_error_count:double,rm_media_id:string,rm_media_type:string,rm_custom_action:string,rm_custom_label:string,rm_custom_catgeory:string,rq_device_modelid:string,rq_is_vbssid:boolean,dl_confident_install:double,dl_confident_conversion:double,rq_target_cpd:double,rq_geodata_vendor_id:string,rq_serving_cpc_floor:double,rq_concept_id:string,segmentdemand_served_imp:double,segmentdemand_valid_clicks:double,segmentdemand_download_installs:double,segmentdemand_total_burn:double,segmentdemand_rendered_imp:double,rq_is_adgroup_subsidized:boolean,rq_adgroup_stage:string,rq_is_subsidy_impression:boolean,rq_is_muest_null:boolean,rq_is_derived_site_placement_id:boolean,rq_site_placement_id:string,rm_unique_media_play_count:double,rm_unique_media_auto_play_count:double,rm_unique_media_start_count:double,rm_unique_media_q1_count:double,rm_unique_media_q2_count:double,rm_unique_media_q3_count:double,rm_unique_media_complete_count:double,rm_form_submit_success_count:double,rm_form_submit_failure_count:double,rm_form_submit_attempt_count:double,rm_unique_form_submit_success_count:double,rm_unique_form_submit_failure_count:double,rm_unique_form_submit_attempt_count:double,rq_served_location_source:string,rq_served_location_level_of_targeting:string,rq_served_location_id:string,rq_primary_cities:string,ltv_event_time:timestamp,ltv_event_name:string,ltv_event_value:double,ltv_event_count:double,pub_account_guid:string,site_inc_id:string,operating_system_id:string,device_type_id_cube:string,ltv_manufacturer_id:string,country_id:string,ltv_click:double,ltv_install:double,ltv_valid_click:double,ltv_impression:double,ltv_unique_install_event_count:double,ltv_is_confident_install:string,rq_qualifying_flp_count:double,rq_participant_flp_count:double,it:string,colo:string> | |
2015-07-21 18:53:44,049 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initializeChildren(410)) - Operator 2 SEL initialized | |
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initializeChildren(414)) - Initializing children of 2 SEL | |
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(449)) - Initializing child 3 FS | |
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(337)) - Initializing Self 3 FS | |
2015-07-21 18:53:44,050 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id | |
2015-07-21 18:53:44,129 INFO [LocalJobRunner Map Task Executor #0]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout | |
2015-07-21 18:53:44,130 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initializeChildren(410)) - Operator 3 FS initialized | |
2015-07-21 18:53:44,130 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:initialize(385)) - Initialization Done 3 FS | |
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:initialize(385)) - Initialization Done 2 SEL | |
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:initialize(385)) - Initialization Done 1 FIL | |
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:initialize(385)) - Initialization Done 0 TS | |
2015-07-21 18:53:44,131 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:initialize(385)) - Initialization Done 4 MAP | |
2015-07-21 18:53:44,164 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (MapOperator.java:cleanUpInputFileChangedOp(480)) - Processing alias rrcube for file file:/Users/rajat.khandelwal/2015-07-18-02 | |
2015-07-21 18:53:44,264 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - Hadoop job information for null: number of mappers: 0; number of reducers: 0 | |
2015-07-21 18:53:44,320 WARN [main]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead | |
2015-07-21 18:53:44,320 INFO [main]: mr.ExecDriver (SessionState.java:printInfo(563)) - 2015-07-21 18:53:44,316 null map = 0%, reduce = 0% | |
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_conceptual_rollover | |
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_conceptual_ron | |
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_tagged_user | |
2015-07-21 18:53:44,657 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_inventory_type | |
2015-07-21 18:53:44,658 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_id | |
2015-07-21 18:53:44,658 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_adgrpincid | |
2015-07-21 18:53:44,659 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_user_features | |
2015-07-21 18:53:44,660 INFO [LocalJobRunner Map Task Executor #0]: serde.LazyNOBColumnarStruct (LazyNOBColumnarStruct.java:castDimValue(169)) - Did not find corresponding type for rq_is_muEst_null | |
2015-07-21 18:53:44,661 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(470)) - Final Path: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_tmp.-ext-10002/000000_0 | |
2015-07-21 18:53:44,661 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(472)) - Writing to temp file: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_task_tmp.-ext-10002/_tmp.000000_0 | |
2015-07-21 18:53:44,662 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (FileSinkOperator.java:createBucketForFileIdx(487)) - New Final Path: FS file:/tmp/hive-rajat.khandelwal/hive_2015-07-21_18-53-36_782_7786845390666999875-2/_tmp.-ext-10002/000000_0 | |
2015-07-21 18:53:44,712 FATAL [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:map(194)) - org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
] | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:550) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:189) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:486) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serializeField(LazySimpleSerDe.java:439) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:423) | |
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:583) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:137) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:92) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:540) | |
... 10 more | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:close(574)) - 4 finished. closing... | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:logStats(838)) - DESERIALIZE_ERRORS:0 | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:close(574)) - 0 finished. closing... | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:close(574)) - 1 finished. closing... | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:logStats(838)) - FILTERED:0 | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:logStats(838)) - PASSED:0 | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:close(574)) - 2 finished. closing... | |
2015-07-21 18:53:44,713 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:close(574)) - 3 finished. closing... | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.FileSinkOperator (Operator.java:close(591)) - 3 Close done | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.SelectOperator (Operator.java:close(591)) - 2 Close done | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.FilterOperator (Operator.java:close(591)) - 1 Close done | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.TableScanOperator (Operator.java:close(591)) - 0 Close done | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: exec.MapOperator (Operator.java:close(591)) - 4 Close done | |
2015-07-21 18:53:44,714 INFO [LocalJobRunner Map Task Executor #0]: mr.ExecMapper (ExecMapper.java:close(249)) - ExecMapper: processed 0 rows: used memory = 131967800 | |
2015-07-21 18:53:44,726 INFO [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete. | |
2015-07-21 18:53:44,727 WARN [Thread-50]: mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local2017936282_0001 | |
java.lang.Exception: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
] | |
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522) | |
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
] | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:195) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:208) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:193) | |
at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:179) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:545) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) | |
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243) | |
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
at java.lang.Thread.run(Thread.java:745) | |
] | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:550) | |
at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:177) | |
... 9 more | |
Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean | |
at org.apache.hadoop.hive.serde2.objectinspector.primitive.JavaBooleanObjectInspector.get(JavaBooleanObjectInspector.java:41) | |
at org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:189) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:486) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serializeField(LazySimpleSerDe.java:439) | |
at org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:423) | |
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:583) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:137) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:92) | |
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793) | |
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:540) | |
... 10 more | |
2015-07-21 18:53:45,365 WARN [main]: mapreduce.Counters (AbstractCounters.java:getGroup(234)) - Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead | |
2015-07-21 18:53:45,366 ERROR [main]: mr.ExecDriver (SessionState.java:printError(572)) - Ended Job = job_local2017936282_0001 with errors | |
2015-07-21 18:53:45,368 ERROR [Thread-259]: mr.ExecDriver (SessionState.java:printError(572)) - Error during job, obtaining debugging information... | |
2015-07-21 18:53:45,368 INFO [Thread-259]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1051)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment