Wataru Yukawa wyukawa
wyukawa
/ gist:181599ddb1b923b6d2cb4bb3f0e6f996
Created
February 1, 2018 12:03
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| presto:default> set session iterative_optimizer_enabled = false; | |
| SET SESSION | |
| presto:default> explain ... | |
| - Output[... | |
| - RemoteExchange[GATHER] => | |
| - Project[] => [ | |
| - LeftJoin[( | |
| - Project[] => [ | |
| - Project[] => [ | |
| - LeftJoin[ |
wyukawa
/ gist:1d7ce29449dfdeaff0ce2d6e5e8a8f34
Created
July 5, 2017 06:16
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| yajl | |
| ``` | |
| ================================== | |
| Mode: cpu(1000) | |
| Samples: 18273 (14.76% miss rate) | |
| GC: 5962 (32.63%) | |
| ================================== | |
| TOTAL (pct) SAMPLES (pct) FRAME | |
| 20057 (109.8%) 4698 (25.7%) Fluent::ElasticsearchOutput#write_objects | |
| 4348 (23.8%) 4348 (23.8%) Yajl::Encoder.encode |
wyukawa
/ gist:e2e05151860914cd921772bb702689aa
Created
January 30, 2017 11:06
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <!-- for webhdfs --> | |
| <dependency> | |
| <groupId>javax.ws.rs</groupId> | |
| <artifactId>javax.ws.rs</artifactId> | |
| <version>1.0</version> | |
| </dependency> | |
| <dependency> | |
| <groupId>com.sun.jersey</groupId> | |
| <artifactId>jersey-bundle</artifactId> |
wyukawa
/ gist:0951326be81780377216880958cec9c1
Created
January 30, 2017 11:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.lang.ExceptionInInitializerError | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.jsonParse(WebHdfsFileSystem.java:328) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(WebHdfsFileSystem.java:761) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:625) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:472) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:502) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at javax.security.auth.Subject.doAs(Subject.java:422) | |
| at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:498) |
wyukawa
/ gist:0142e2e18ae97d01bf18567dd85dae8d
Created
January 25, 2017 06:04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| INFO - Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row ... | |
| INFO - at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:172) | |
| INFO - at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) | |
| INFO - at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) | |
| INFO - at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) | |
| INFO - at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) | |
| INFO - at java.security.AccessController.doPrivileged(Native Method) | |
| INFO - at javax.security.auth.Subject.doAs(Subject.java:422) | |
| INFO - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) | |
| INFO - at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) |
wyukawa
/ gist:e3ae28ad332b3ae9ec2bf7947a47ffd6
Created
December 19, 2016 04:03
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # A fatal error has been detected by the Java Runtime Environment: | |
| # | |
| # Internal Error (sharedRuntime.cpp:834), pid=106242, tid=0x00007f8046a4b700 | |
| # fatal error: exception happened outside interpreter, nmethods and vtable stubs at pc 0x00007f83a1052350 | |
| # | |
| # JRE version: Java(TM) SE Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13) | |
| # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops) | |
| # Core dump written. Default location: /usr/local/presto/datadir/core or core.106242 | |
| # |
wyukawa
/ gist:cce22932fd1384bd4122fd5d3f98d89d
Created
December 19, 2016 04:03
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # A fatal error has been detected by the Java Runtime Environment: | |
| # | |
| # Internal Error (sharedRuntime.cpp:834), pid=146189, tid=0x00007f65112ad700 | |
| # fatal error: exception happened outside interpreter, nmethods and vtable stubs at pc 0x00007f6885052350 | |
| # | |
| # JRE version: Java(TM) SE Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13) | |
| # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops) | |
| # Core dump written. Default location: /usr/local/presto/datadir/core or core.146189 | |
| # |
wyukawa
/ gist:818e4804cde9bafd0834b0c6b59d5e7b
Created
November 24, 2016 07:41
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.lang.NoClassDefFoundError: javax/ws/rs/core/MediaType | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.jsonParse(WebHdfsFileSystem.java:328) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(WebHdfsFileSystem.java:761) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:625) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:472) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:502) | |
| at java.security.AccessController.doPrivileged(Native Method) | |
| at javax.security.auth.Subject.doAs(Subject.java:422) | |
| at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) | |
| at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:498) |
wyukawa
/ gist:78ecac304c5309fa0197424576b612b8
Created
August 9, 2016 09:51
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kafka-fluentd-consumerでconsumeしたものをfluentdにpost | |
| それを受けとって、別fluentdにpost。このpostした先のfluentdが8プロセスある。その前は4プロセスだった。 | |
| <match ..> | |
| type forward | |
| flush_interval 1s | |
| buffer_chunk_limit 16M | |
| heartbeat_type tcp | |
| buffer_queue_limit 128 | |
| num_threads 10 |
wyukawa
/ gist:03b973aecd9740d036690888d838b67d
Created
July 27, 2016 05:57
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # | |
| # A fatal error has been detected by the Java Runtime Environment: | |
| # | |
| # SIGSEGV (0xb) at pc=0x00007f50e17083bd, pid=154280, tid=0x00007f4fed7f4700 | |
| # | |
| # JRE version: Java(TM) SE Runtime Environment (8.0_92-b14) (build 1.8.0_92-b14) | |
| # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.92-b14 mixed mode linux-amd64 compressed oops) | |
| # Problematic frame: | |
| # C [libheapstats-engine-avx-2.0.so+0x493bd] TSnapShotContainer::mergeChildren()+0x11d | |
| # |