docker-superset
|__config
| |__superset_config.py
|
|__docker-files
| |__docker-compose.yml
| |__.env
Abhishek Sharma abhioncbr
🐒
abhioncbr
/ docker-pull.sh
Created
January 12, 2019 23:38
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| docker pull abhioncbr/docker-superset:<version-tag> |
abhioncbr
/ docker-run-worker.sh
Created
January 12, 2019 23:36
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd docker-superset && docker run -p 5555:5555 -v config:/home/superset/config/ abhioncbr/docker-superset:<version-tag> cluster worker <superset_metadata_db_url> <redis_url> |
abhioncbr
/ docker-run-server.sh
Created
January 12, 2019 23:32
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd docker-superset && docker run -p 8088:8088 -v config:/home/superset/config/ abhioncbr/docker-superset:<version-tag> cluster server <superset_metadata_db_url> <redis_url> |
abhioncbr
/ docker-compose-prod.sh
Created
January 12, 2019 22:48
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd docker-superset/docker-files/ && SUPERSET_ENV=prod SUPERSET_VERSION=<version-tag> docker-compose up -d |
abhioncbr
/ docker-compose-local.sh
Last active
January 12, 2019 22:48
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cd docker-superset/docker-files/ && docker-compose up -d |
abhioncbr
/ directory-strcture.md
Last active
January 12, 2019 22:42
abhioncbr
/ apache-superset-docker-image.md
Created
January 12, 2019 22:29
Docker image of Apache Superset
A couple of days back, I wrote the post about how to run Apache Superset in the production environment for serving hundreds or thousands of users. Superset community members and users appreciated the post for which I am thankful to them, however over the Superset Slack and Gitter channels; many users asked various questions on setting Superset as a Docker container and how to use/run it. In this post, I am trying to explore more about docker image of a Superset, and I am hoping that after reading the post you will acquire a conceptual understanding of setting Superset as a Docker container and benefits of it.
abhioncbr
/ stream-closure-exception.txt
Created
January 1, 2019 15:46
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| java.io.IOException: Output Stream closed | |
| at org.apache.hadoop.fs.s3a.S3AOutputStream.checkOpen(S3AOutputStream.java:83) ~[hadoop-aws-2.8.3.jar:?] | |
| at org.apache.hadoop.fs.s3a.S3AOutputStream.flush(S3AOutputStream.java:89) ~[hadoop-aws-2.8.3.jar:?] | |
| at java.io.FilterOutputStream.flush(FilterOutputStream.java:140) ~[?:1.8.0_191] | |
| at java.io.DataOutputStream.flush(DataOutputStream.java:123) ~[?:1.8.0_191] |
abhioncbr
/ segment-output.json
Last active
January 2, 2019 01:18
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| "ioConfig" : { | |
| "type" : "hadoop", | |
| "inputSpec" : { | |
| "type" : "static", | |
| "paths" : "s3a://experiment-druid/input_data/wikiticker-2015-09-12-sampled.json.gz" | |
| }, | |
| "metadataUpdateSpec" : null, | |
| "segmentOutputPath" : "s3n://experiment-druid/deepstorage" | |
| }, |
abhioncbr
/ hadoop-index-druid-exception.txt
Created
January 1, 2019 15:42
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Caused by: java.lang.NoSuchMethodError: com.amazonaws.services.s3.transfer.TransferManager.<init>(Lcom/amazonaws/services/s3/AmazonS3;Ljava/util/concurrent/ThreadPoolExecutor;)V | |
| at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:287) ~[?:?] | |
| at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2669) ~[?:?] | |
| at org.apache.hadoop.fs.FileSystem.access00(FileSystem.java:94) ~[?:?] | |
| at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703) ~[?:?] | |
| at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685) ~[?:?] | |
| at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373) ~[?:?] | |
| at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) ~[?:?] |