Last active
March 3, 2021 04:16
-
-
Save miztiik/80a057be292e1e88b7095b3e5a014b74 to your computer and use it in GitHub Desktop.
Installing scrapy in CentOS
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Install deltarpm to reduce the size of download | |
| yum install -y deltarpm \ | |
| && yum install -y python-pip \ | |
| && pip install --upgrade pip | |
| # Scrapy Pre-Requisites | |
| yum install -y gcc libffi-devel python-devel openssl-devel | |
| yum install -y libxslt-devel libxml++-devel libxml2-devel | |
| pip install lxml incremental | |
| # Install Scrapy | |
| pip install scrapy |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment