Skip to content

Instantly share code, notes, and snippets.

@gijzelaerr
Created April 3, 2014 11:12
Show Gist options
  • Save gijzelaerr/9952530 to your computer and use it in GitHub Desktop.
Save gijzelaerr/9952530 to your computer and use it in GitHub Desktop.
DISCOMASTER_PORT_22_TCP_ADDR=172.17.0.2
DISCOMASTER_NAME=/nostalgic_wozniak/discomaster
DISCOMASTER_PORT_22_TCP_PORT=22
HOSTNAME=c21c7a8a0799
DISCOMASTER_PORT_22_TCP_PROTO=tcp
HOME=/
DISCO_MASTER_HOST=172.17.0.2
DISCOMASTER_PORT_8989_TCP_ADDR=172.17.0.2
DISCOMASTER_PORT_8999_TCP_ADDR=172.17.0.2
DISCOMASTER_PORT_22_TCP=tcp://172.17.0.2:22
DISCOMASTER_PORT_8989_TCP_PORT=8989
DISCOMASTER_PORT_8989_TCP_PROTO=tcp
DISCOMASTER_PORT_8999_TCP_PORT=8999
DISCOMASTER_PORT_8999_TCP_PROTO=tcp
TERM=xterm
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
DISCOMASTER_PORT_8989_TCP=tcp://172.17.0.2:8989
DISCO_PROXY=http://172.17.0.2:8999
DISCOMASTER_PORT_8999_TCP=tcp://172.17.0.2:8999
DEBIAN_FRONTEND=noninteractive
DISCOMASTER_ENV_DEBIAN_FRONTEND=noninteractive
PWD=/
DISCOMASTER_PORT=tcp://172.17.0.2:22
Job@574:7fa1e:be7e2:
Status: [map] 0 waiting, 1 running, 0 done, 0 failed
2014/04/03 10:59:42 master New job initialized!
2014/04/03 10:59:42 master Created job "Job@574:7fa1e:be7e2"
2014/04/03 10:59:42 master Stage map scheduled with 1 tasks
2014/04/03 10:59:42 master map:0 assigned to localhost
2014/04/03 10:59:42 master New job initialized!
2014/04/03 10:59:42 master Created job "Job@574:7fa1e:be7e2"
2014/04/03 10:59:42 master Stage map scheduled with 1 tasks
2014/04/03 10:59:42 master map:0 assigned to localhost
Status: [reduce] 0 waiting, 0 running, 1 done, 0 failed
Traceback (most recent call last):
File "/disco/examples/util/count_words.py", line 16, in <module>
for word, count in result_iterator(job.wait(show=True)):
File "/usr/local/lib/python2.7/dist-packages/disco/core.py", line 406, in classic_iterator
for input in util.inputlist(urls, settings=settings):
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 283, in inputlist
for input in inputs) if inp]
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 42, in chainify
return list(chain(*iterable))
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 283, in <genexpr>
for input in inputs) if inp]
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 273, in inputexpand
return zip(*(parse_dir(i, label=label) for i in iterify(input)))
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 273, in <genexpr>
return zip(*(parse_dir(i, label=label) for i in iterify(input)))
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 243, in parse_dir
return [url for lab, url, size in sorted(read_index(dir)) if label in (None, lab)]
File "/usr/local/lib/python2.7/dist-packages/disco/util.py", line 258, in read_index
file = open_url(proxy_url(dir, to_master=False))
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 104, in open_url
return open_remote(url, *args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 110, in open_remote
return Connection(urlresolve(url), token)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 146, in __init__
self.read(1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 174, in read
bytes = self._read_chunk(size if size > 0 else CHUNK_SIZE)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 194, in _read_chunk
headers=headers)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 71, in request
return request(method, url, data=data, headers=headers, sleep=sleep + 1)
File "/usr/local/lib/python2.7/dist-packages/disco/comm.py", line 69, in request
raise CommError(errmsg, url, status)
disco.error.CommError: Unable to access resource (http://localhost:8989/disco/localhost/00/Job@574:7fa1e:be7e2/.disco/reduce-2-1396522791143921.results): [Errno 111] Connection refused
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment