Skip to content

Instantly share code, notes, and snippets.

@haranjackson
Last active May 7, 2022 09:24
Show Gist options
  • Save haranjackson/81ab8dc3ae54bbe91c623d7c4f1e4f14 to your computer and use it in GitHub Desktop.
Save haranjackson/81ab8dc3ae54bbe91c623d7c4f1e4f14 to your computer and use it in GitHub Desktop.
Deploys Python Scrapy library to an AWS Lambda layer. You can specify the region, library version, and runtime.
REGION=eu-west-1
VER=1.7.3
RUNTIME=python3.7
docker run -v $(pwd):/out -it lambci/lambda:build-$RUNTIME \
pip install scrapy==$VER -t /out/build/scrapy/python
cd build/scrapy
zip -r ../../scrapy.zip python/
cd ../..
aws lambda publish-layer-version \
--layer-name Scrapy \
--region $REGION \
--description $VER \
--zip-file fileb://scrapy.zip \
--compatible-runtimes $RUNTIME
rm -rf build *.zip
@xai1983kbu
Copy link

thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment