developer-sdk
/ my_config.h
Created
April 17, 2023 13:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /* Headers we may want to use. */ | |
| #define HAVE_ALLOCA_H 1 | |
| #define HAVE_ARPA_INET_H 1 | |
| #define HAVE_CRYPT_H 1 | |
| #define HAVE_DIRENT_H 1 | |
| /* #undef HAVE_EXECINFO_H */ | |
| #define HAVE_FCNTL_H 1 | |
| #define HAVE_FENV_H 1 | |
| #define HAVE_FLOAT_H 1 |
developer-sdk
/ docker_image_list.sh
Created
April 15, 2023 13:26
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # amd64 버전의 ubuntu 22.04 버전 도커 이미지 다운로드 | |
| docker image pull ubuntu:22.04@sha256:7a57c69fe1e9d5b97c5fe649849e79f2cfc3bf11d10bbd5218b4eb61716aebe6 | |
| # 도커 이미지 실행 | |
| docker run -i -t ubuntu:22.044@sha256:7a57c69fe1e9d5b97c5fe649849e79f2cfc3bf11d10bbd5218b4eb61716aebe6 /bin/bash | |
| # python3, pip 설치 | |
| apt install python3 pip -y | |
| # airflow 설치 |
developer-sdk
/ jupyter_notebook.sh
Created
March 21, 2023 14:52
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # 파이썬 빌드 | |
| sudo apt update | |
| sudo apt install -y build-essential zlib1g-dev libncurses5-dev libgdbm-dev libnss3-dev libssl-dev libreadline-dev libffi-dev libsqlite3-dev wget libbz2-dev | |
| wget -e use_proxy=on https://www.python.org/ftp/python/3.6.9/Python-3.6.9.tgz | |
| tar zxf Python-3.6.9.tgz | |
| cd Python-3.6.9/ | |
| ./configure --enable-optimizations | |
| sudo make altinstall |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo apt update | |
| sudo apt install -y build-essential zlib1g-dev libncurses5-dev libgdbm-dev libnss3-dev libssl-dev libreadline-dev libffi-dev libsqlite3-dev wget libbz2-dev | |
| wget -e use_proxy=on https://www.python.org/ftp/python/3.6.9/Python-3.6.9.tgz | |
| tar zxf Python-3.6.9.tgz | |
| cd Python-3.6.9/ | |
| ./configure --enable-optimizations | |
| sudo make altinstall |
developer-sdk
/ python3_cloudpickle.py
Created
March 16, 2023 09:16
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| This class is defined to override standard pickle functionality | |
| The goals of it follow: | |
| -Serialize lambdas and nested functions to compiled byte code | |
| -Deal with main module correctly | |
| -Deal with other non-serializable objects | |
| It does not include an unpickler, as standard python unpickling suffices. |
developer-sdk
/ kafka_client.go
Created
March 13, 2023 12:53
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| kafkaConfig = kafka.ConfigMap{ | |
| "bootstrap.servers": "ssl-kafka-server:9093", | |
| "security.protocol": "SSL", | |
| "ssl.keystore.location": "keystore.p12", | |
| "ssl.keystore.password": "password", | |
| "ssl.ca.location": "ca.pem", | |
| } |
developer-sdk
/ mysql_dsn.go
Created
March 8, 2023 14:36
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # dsn 설정 예제 | |
| [username[:password]@][protocol[(address)]]/dbname[?param1=value1&...¶mN=valueN] | |
| # 예제 | |
| username:password@tcp(10.0.0.1:3306)/dbname | |
| # tls | |
| username:password@tcp(10.0.0.1:3306)/dbname?tls=skip-verify |
developer-sdk
/ zoo.cfg
Created
March 6, 2023 13:30
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # 파일 정리 시간 간격 | |
| autopurge.purgeInterval=24 | |
| # 저장해 놓을 파일 개수 | |
| autopurge.snapRetainCount=5 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| connector.name=hive | |
| hive.metastore.uri=thrift://10.0.0.2:9083 | |
| hive.config.resources=/etc/hadoop/conf/core-site.xml,/etc/hadoop/conf/hdfs-site.xml |
developer-sdk
/ core-site-s3a.xml
Created
December 3, 2022 02:09
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| <configuration> | |
| <property> | |
| <name>fs.s3a.access.key</name> | |
| <description>AWS access key ID used by S3A file system. Omit for IAM role-based or provider-based authentication.</description> | |
| </property> | |
| <property> | |
| <name>fs.s3a.secret.key</name> | |
| <description>AWS secret key used by S3A file system. Omit for IAM role-based or provider-based authentication.</description> | |
| </property> |