content

hive> SELECT COUNT(bestseller_citations) FROM bowker.bowker WHERE bestseller_citations IS NOT NULL AND length(bestseller_citations) > 0 AND NOT (bestseller_citations LIKE '%New York Times%' OR  bestseller_citations LIKE '%Publishers Weekly%');
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201312242134_25868, Tracking URL = http://dfs001.local:50030/jobdetails.jsp?jobid=job_201312242134_25868
Kill Command = /usr/lib/hadoop/bin/hadoop job  -kill job_201312242134_25868
Hadoop job information for Stage-1: number of mappers: 228; number of reducers: 1
2014-01-08 21:12:55,222 Stage-1 map = 0%,  reduce = 0%
2014-01-08 21:13:02,246 Stage-1 map = 9%,  reduce = 0%, Cumulative CPU 71.92 sec
2014-01-08 21:13:03,257 Stage-1 map = 25%,  reduce = 0%, Cumulative CPU 167.12 sec
2014-01-08 21:13:04,267 Stage-1 map = 61%,  reduce = 0%, Cumulative CPU 343.78 sec
2014-01-08 21:13:05,278 Stage-1 map = 86%,  reduce = 0%, Cumulative CPU 408.99 sec
2014-01-08 21:13:06,290 Stage-1 map = 89%,  reduce = 0%, Cumulative CPU 431.29 sec
2014-01-08 21:13:07,301 Stage-1 map = 90%,  reduce = 0%, Cumulative CPU 436.88 sec
2014-01-08 21:13:08,312 Stage-1 map = 93%,  reduce = 0%, Cumulative CPU 466.73 sec
2014-01-08 21:13:09,324 Stage-1 map = 93%,  reduce = 0%, Cumulative CPU 466.73 sec
2014-01-08 21:13:10,335 Stage-1 map = 97%,  reduce = 0%, Cumulative CPU 519.09 sec
2014-01-08 21:13:11,347 Stage-1 map = 97%,  reduce = 32%, Cumulative CPU 519.09 sec
2014-01-08 21:13:12,359 Stage-1 map = 97%,  reduce = 32%, Cumulative CPU 519.09 sec
2014-01-08 21:13:13,370 Stage-1 map = 97%,  reduce = 32%, Cumulative CPU 519.09 sec
2014-01-08 21:13:14,382 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:15,396 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:16,408 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:17,419 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:18,431 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:19,443 Stage-1 map = 98%,  reduce = 32%, Cumulative CPU 528.51 sec
2014-01-08 21:13:20,454 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:21,466 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:22,477 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:23,488 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:24,500 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:25,511 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:26,523 Stage-1 map = 98%,  reduce = 33%, Cumulative CPU 528.51 sec
2014-01-08 21:13:27,534 Stage-1 map = 99%,  reduce = 33%, Cumulative CPU 561.1 sec
2014-01-08 21:13:28,546 Stage-1 map = 99%,  reduce = 33%, Cumulative CPU 561.1 sec
2014-01-08 21:13:29,558 Stage-1 map = 100%,  reduce = 33%, Cumulative CPU 1202.68 sec
2014-01-08 21:13:30,570 Stage-1 map = 100%,  reduce = 33%, Cumulative CPU 1202.68 sec
2014-01-08 21:13:31,581 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 1206.55 sec
2014-01-08 21:13:32,593 Stage-1 map = 100%,  reduce = 100%, Cumulative CPU 1206.55 sec
MapReduce Total cumulative CPU time: 20 minutes 6 seconds 550 msec
Ended Job = job_201312242134_25868
MapReduce Jobs Launched:
Job 0: Map: 228  Reduce: 1   Cumulative CPU: 1206.55 sec   HDFS Read: 1875163380 HDFS Write: 10 SUCCESS
Total MapReduce CPU Time Spent: 20 minutes 6 seconds 550 msec
OK
_c0
0
Time taken: 41.461 seconds