Wataru Yukawa wyukawa
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Mon Jun 22 2015 18:12:01 GMT+0900 (JST) [ERROR] : Error in app, { [Error: Command failed: ] killed: false, code: 1, signal: null } | |
| Mon Jun 22 2015 18:12:01 GMT+0900 (JST) [ERROR] : Error: Command failed: | |
| at ChildProcess.exithandler (child_process.js:658:15) | |
| at ChildProcess.emit (events.js:98:17) | |
| at maybeClose (child_process.js:766:16) | |
| at Process.ChildProcess._handle.onexit (child_process.js:833:5) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2015-07-01 10:35:49 | |
| Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.25-b02 mixed mode): | |
| "Attach Listener" #294 daemon prio=9 os_prio=0 tid=0x00007fcf60001000 nid=0x14b2b waiting on condition [0x0000000000000000] | |
| java.lang.Thread.State: RUNNABLE | |
| "http-client-shared-290" #290 daemon prio=5 os_prio=0 tid=0x00007fccfc008000 nid=0x1475e waiting on condition [0x00007fccc28b8000] | |
| java.lang.Thread.State: TIMED_WAITING (parking) | |
| at sun.misc.Unsafe.park(Native Method) | |
| - parking to wait for <0x000000041d9b8f80> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| @Nullable | |
| @Description("encode url") | |
| @ScalarFunction | |
| @SqlType(StandardTypes.VARCHAR) | |
| public static Slice urlEncode(@SqlType(StandardTypes.VARCHAR) Slice url, @SqlType(StandardTypes.VARCHAR) Slice enc) | |
| { | |
| if ((url == null) || (enc == null)) { | |
| return null; | |
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import java.util.Optional; | |
| public class A { | |
| public static void main(String[] args) { | |
| Optional<String> aaaOptinal = Optional.ofNullable("aaa"); | |
| aaaOptinal.ifPresent(aaa -> { | |
| try { | |
| hoge(); | |
| } catch (HogeExeption e) { |
wyukawa
/ gist:407bc341ccea68211fab
Created
July 15, 2015 03:08
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| @Test | |
| public void testUrlEncode() | |
| { | |
| assertFunction("url_encode('http://test')", VARCHAR, "http%3A%2F%2Ftest"); | |
| assertFunction("url_encode('http://\u30c6\u30b9\u30c8')", VARCHAR, "http%3A%2F%2F%E3%83%86%E3%82%B9%E3%83%88"); | |
| assertFunction("url_encode('test')", VARCHAR, "test"); | |
| assertFunction("url_encode(null)", VARCHAR, null); | |
| } | |
| @Test |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| com.facebook.presto.ExceededMemoryLimitException: Task exceeded max memory size of 8GB | |
| at com.facebook.presto.operator.TaskContext.reserveMemory(TaskContext.java:163) | |
| at com.facebook.presto.operator.PipelineContext.reserveMemory(PipelineContext.java:203) | |
| at com.facebook.presto.operator.DriverContext.reserveMemory(DriverContext.java:198) | |
| at com.facebook.presto.operator.OperatorContext.reserveMemory(OperatorContext.java:222) | |
| at com.facebook.presto.operator.OperatorContext.setMemoryReservation(OperatorContext.java:294) | |
| at com.facebook.presto.operator.HashBuilderOperator.addInput(HashBuilderOperator.java:166) | |
| at com.facebook.presto.operator.Driver.processInternal(Driver.java:386) | |
| at com.facebook.presto.operator.Driver.processFor(Driver.java:303) | |
| at com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:587) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.lang.IllegalArgumentException: Null user | |
| at org.apache.hadoop.security.UserGroupInformation.createRemoteUser(UserGroupInformation.java:1204) | |
| at org.apache.hadoop.security.UserGroupInformation.createRemoteUser(UserGroupInformation.java:1191) | |
| at org.apache.hive.service.cli.session.HiveSessionImplwithUGI.setSessionUGI(HiveSessionImplwithUGI.java:78) | |
| at org.apache.hive.service.cli.session.HiveSessionImplwithUGI.<init>(HiveSessionImplwithUGI.java:53) | |
| at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:248) | |
| at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:202) | |
| at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:402) | |
| at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:297) | |
| at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.lang.RuntimeException: Failed connecting to Hive metastore: localhost:9083 | |
| at com.facebook.presto.hive.StaticHiveCluster.createMetastoreClient(StaticHiveCluster.java:48) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore.lambda$loadPartitionNamesByParts$21(CachingHiveMetastore.java:585) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore$$Lambda$625/817173694.call(Unknown Source) | |
| at com.facebook.presto.hive.metastore.HiveMetastoreApiStats$1.call(HiveMetastoreApiStats.java:44) | |
| at com.facebook.presto.hive.RetryDriver.run(RetryDriver.java:136) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore.loadPartitionNamesByParts(CachingHiveMetastore.java:584) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore.access$600(CachingHiveMetastore.java:85) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore$7.load(CachingHiveMetastore.java:202) | |
| at com.facebook.presto.hive.metastore.CachingHiveMetastore$7.load(Cachin |
wyukawa
/ gist:eccc27bc64bda607b663
Created
September 1, 2015 06:42
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: ClassCastException org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableVoidObjectInspector cannot be cast to org.apache.hadoop.hive.serde2.objectinspector.primitive.BooleanObjectInspector | |
| at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315) | |
| at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:112) | |
| at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:181) | |
| at org.apache.hive.service.cli.operation.Operation.run(Operation.java:257) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:388) | |
| at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(HiveSessionImpl.java:369) | |
| at org.apache.hive.service.cli.CLIService.executeStatement(CLIService.java:261) | |
| at org.apache.hive.service.cli.thrift.ThriftCLIService |
wyukawa
/ gist:dc4b745857c48c661a97
Last active
January 6, 2016 02:46
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| やりたいことは2つのhadoopクラスタへのdouble write | |
| <match hoge.{aaa.xxx,aaa.yyyy,aaa.zzz}> | |
| type copy | |
| <store> | |
| ... | |
| </store> | |
| <store> | |
| ... | |
| </store> |