Skip to content

Instantly share code, notes, and snippets.

@taufiqibrahim

taufiqibrahim/serverless-stream-processing-aws-msk-lambda-demo-walkthrough-env-explained.md

Created May 4, 2021 12:10
Show Gist options
  • Save taufiqibrahim/ddab835e4af8929c78902646febd18b3 to your computer and use it in GitHub Desktop.
Save taufiqibrahim/ddab835e4af8929c78902646febd18b3 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
serverless-stream-processing-aws-msk-lambda-demo-walkthrough-env-explained.md
key value description
AWS_S3_DEPLOYMENT_BUCKET my-serverless-deployment S3 bucket name
AWS_LAMBDA_EXECUTION_ROLE arn:aws:iam::<ACCOUNT_ID>:role/AWSLambdaMSKDemoWalkthroughRole AWSLambdaMSKDemoWalkthroughRole ARN
AWS_LAMBDA_EXECUTION_TIMEOUT 300 Lambda execution timeout
AWS_LAMBDA_MSK_BATCH_SIZE 1000 Execution batch size
AWS_VPC_SECURITY_GROUP_ID_1 sg- Lambda security group ID
AWS_VPC_SUBNET_ID_1 <SUBNET_ID_1> Lambda subnet ID 1
AWS_VPC_SUBNET_ID_2 <SUBNET_ID_2> Lambda subnet ID 2
AWS_MSK_CLUSTER_1 <AWS_MSK_CLUSTER_1_ARN> MSK cluster ARN 1
AWS_MSK_BOOTSTRAP_SERVERS_1 <AWS_MSK_BOOTSTRAP_SERVERS_1_URLS> MSK bootstrap server URLs 1
AWS_MSK_CLUSTER_2 <AWS_MSK_CLUSTER_1_ARN> MSK cluster ARN 2
AWS_MSK_BOOTSTRAP_SERVERS_2 <AWS_MSK_BOOTSTRAP_SERVERS_1_URLS> MSK bootstrap server URLs 2
KAFKA_STARTING_POSITION LATEST Lambda MSK Kafka starting position offset [LATEST, TRIM_HORIZON]
ORDERS_TOPIC demo-walkthrough-orders Source topic
SCHEMA_REGISTRY_URL http://schema-registry-url:8081 Confluent Schema Registry URL
MYSQL_CONN_STRING mysql+pymysql://user:password@rds_host:3306/database_name MySQL SQL Alchemy connection string
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment