Jeremy Hanna jeromatron
jeromatron
/ gist:858760
Created
March 7, 2011 16:43
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| W: Failed to fetch http://archive.cloudera.com/debian/dists/DISTRO-cdh3/contrib/binary-amd64/Packages.gz 404 Not Found | |
| W: Failed to fetch http://archive.cloudera.com/debian/dists/DISTRO-cdh3/contrib/source/Sources.gz 404 Not Found | |
| E: Some index files failed to download, they have been ignored, or old ones used instead. |
jeromatron
/ gist:873589
Created
March 17, 2011 00:06
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Pig Stack Trace | |
| --------------- | |
| ERROR 2997: Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 2106: Error while computing count in COUNT | |
| org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias counted. Backend error : Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 2106: Error while computing count in COUNT | |
| at org.apache.pig.PigServer.openIterator(PigServer.java:742) | |
| at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:612) | |
| at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303) | |
| at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165) | |
| at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141) |
jeromatron
/ gist:891651
Created
March 29, 2011 01:13
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Pig Stack Trace | |
| --------------- | |
| ERROR 2120: Internal Error: Unable to determine data type for map key | |
| org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias signals_w_snapshots | |
| at org.apache.pig.PigServer.openIterator(PigServer.java:754) | |
| at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:612) | |
| at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303) | |
| at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165) | |
| at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:141) |
jeromatron
/ gist:893065
Created
March 29, 2011 19:36
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2011-03-29 18:07:39,968 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_1300 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,968 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_1277 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,968 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_1144 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,968 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_2777 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,969 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_1298 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,969 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_201103080244_2771 for user-log deletion with retainTimeStamp:1301508459323 | |
| 2011-03-29 18:07:39,969 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding job_2011030 |
jeromatron
/ gist:1008398
Created
June 4, 2011 21:51
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <property> | |
| <name>hadoop.proxyuser.oozie.hosts</name> | |
| <value>*</value> | |
| </property> | |
| <property> | |
| <name>hadoop.proxyuser.oozie.groups</name> | |
| <value>*</value> | |
| </property> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # jmx/jconsole tunneling shell function - add to .profile | |
| # | |
| # usage: jmx [keypair] [remote host] [remote port] | |
| # example: jmx /keys/keypair.pem root@ec2-10-20-30-40.compute-1.amazonaws.com 8080 | |
| function jmx() { | |
| keypair=$1 | |
| remote_host=$2 | |
| remote_port=$3 | |
| proxy_port=10999 |
jeromatron
/ cassandra-for-cdh4.java
Created
February 16, 2013 17:23
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| // | |
| // Old Hadoop API | |
| // | |
| public org.apache.hadoop.mapred.InputSplit[] getSplits(JobConf jobConf, int numSplits) throws IOException | |
| { | |
| //TaskAttemptContext tac = new TaskAttemptContext(jobConf, new TaskAttemptID()); | |
| TaskAttemptContext tac = new org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl(jobConf, new TaskAttemptID()); | |
| List<org.apache.hadoop.mapreduce.InputSplit> newInputSplits = this.getSplits(tac); | |
| org.apache.hadoop.mapred.InputSplit[] oldInputSplits = new org.apache.hadoop.mapred.InputSplit[newInputSplits.size()]; |
jeromatron
/ gist:5372552
Created
April 12, 2013 14:47
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Class Name | Shallow Heap | Retained Heap | Percentage | |
| ----------------------------------------------------------------------------------------- | |
| java.lang.Object[340186] @ 0x639a368b0 | 1,360,760 | 7,754,588,120 | 98.24% | |
| |- org.apache.cassandra.db.Row @ 0x5fae884a8 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x625f9eb88 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x605d82328 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x6888426f0 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x689d73a00 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x68c49c360 | 24 | 34,704 | 0.00% | |
| |- org.apache.cassandra.db.Row @ 0x68d5ff600 | 24 | 34,704 | 0.00% |
jeromatron
/ SimpleClient.java
Created
May 30, 2013 17:26
Basic encode/decode of composite values with DataStax Java driver
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package org.mostlyharmless; | |
| import com.datastax.driver.core.*; | |
| import org.apache.cassandra.db.marshal.*; | |
| import java.util.ArrayList; | |
| import java.util.List; | |
| public class SimpleClient { |
jeromatron
/ Data modelling
Created
August 7, 2013 14:19
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Part 1: The Data Model is Dead, Long Live the Data Model: | |
| - http://www.youtube.com/watch?v=px6U2n74q3g | |
| - http://www.slideshare.net/patrickmcfadin/the-data-model-is-dead-long-live-the-data-model | |
| Part 2: Become a Super Modeler: | |
| - http://www.youtube.com/watch?v=qphhxujn5Es | |
| - http://www.slideshare.net/patrickmcfadin/become-a-super-modeler | |
| Part 3: The World's Next Top Data Model | |
| - http://www.youtube.com/watch?v=HdJlsOZVGwM |