Skip to content

Instantly share code, notes, and snippets.

@electronicbites
Created April 19, 2018 08:54
Show Gist options
  • Save electronicbites/9564a7b2ac5a5aa8e1137298647322d7 to your computer and use it in GitHub Desktop.
Save electronicbites/9564a7b2ac5a5aa8e1137298647322d7 to your computer and use it in GitHub Desktop.
➜ retailer-scrapers git:(master) ✗ shub deploy 146870
Packing version fe3f096-master
Deploying to Scrapy Cloud project "146870"
Deploy log last 30 lines:
_get_apisettings, commands_module='sh_scrapy.commands')
File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 148, in _run_usercode
_run(args, settings)
File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 103, in _run
_run_scrapy(args, settings)
File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 111, in _run_scrapy
execute(settings=settings)
File "/app/python/lib/python2.7/site-packages/scrapy/cmdline.py", line 141, in execute
cmd.crawler_process = CrawlerProcess(settings)
File "/app/python/lib/python2.7/site-packages/scrapy/crawler.py", line 238, in __init__
super(CrawlerProcess, self).__init__(settings)
File "/app/python/lib/python2.7/site-packages/scrapy/crawler.py", line 129, in __init__
self.spider_loader = _get_spider_loader(settings)
File "/app/python/lib/python2.7/site-packages/scrapy/crawler.py", line 325, in _get_spider_loader
return loader_cls.from_settings(settings.frozencopy())
File "/app/python/lib/python2.7/site-packages/scrapy/spiderloader.py", line 33, in from_settings
return cls(settings)
File "/app/python/lib/python2.7/site-packages/scrapy/spiderloader.py", line 20, in __init__
self._load_all_spiders()
File "/app/python/lib/python2.7/site-packages/scrapy/spiderloader.py", line 28, in _load_all_spiders
for module in walk_modules(name):
File "/app/python/lib/python2.7/site-packages/scrapy/utils/misc.py", line 71, in walk_modules
submod = import_module(fullpath)
File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module
__import__(name)
File "/app/__main__.egg/retailer_scrapers/spiders/adidas_us.py", line 4, in <module>
ImportError: No module named tools
{"message": "shub-image-info exit code: 1", "details": null, "error": "image_info_error"}
{"status": "error", "message": "Internal error"}
Deploy log location: /var/folders/z1/ltshh4ss7b790dgrds_j7_2c0000gn/T/shub_deploy_mvuyt8hv.log
Error: Deploy failed: b'{"status": "error", "message": "Internal error"}'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment