Skip to content

Instantly share code, notes, and snippets.

@oatmealraisin
Created June 4, 2019 20:59
Show Gist options
  • Save oatmealraisin/02318f3966b281bcc1fdb4e35afc4f42 to your computer and use it in GitHub Desktop.
Save oatmealraisin/02318f3966b281bcc1fdb4e35afc4f42 to your computer and use it in GitHub Desktop.
mkdir test
cd test
python -m virtualenv venv
source venv/bin/activate
pip install pyspark -t python
zip -9 pyspark.zip -r python/
# upload file to s3
aws lambda publish-layer-version --layer-name bacrey-ml-pyspark --content 'S3Bucket=my-bucket,S3Key=pyspark.zip' --debug --profile my_profile
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment