Skip to content

Instantly share code, notes, and snippets.

@ppcano
Created March 27, 2013 17:51
Show Gist options
  • Select an option

  • Save ppcano/5256521 to your computer and use it in GitHub Desktop.

Select an option

Save ppcano/5256521 to your computer and use it in GitHub Desktop.
2013-03-27T17:47:39+00:00 heroku[router]: at=info method=HEAD path=/admin/ host=yoin-deploy.herokuapp.com fwd="204.93.223.151" dyno=web.1 connect=5ms service=43ms status=200 bytes=0
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,523: WARNING/MainProcess] Traceback (most recent call last):
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,524: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/gevent/greenlet.py", line 390, in run
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,524: WARNING/MainProcess] result = self._run(*self.args, **self.kwargs)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,524: WARNING/MainProcess] accept_callback(pid or os.getpid(), time.time())
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,524: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/worker/job.py", line 301, in on_accepted
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] self.acknowledge()
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/worker/job.py", line 439, in acknowledge
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] self.on_ack(logger, self.connection_errors)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] self.ack()
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/base.py", line 93, in ack
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] self.channel.basic_ack(self.delivery_tag)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,524: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/concurrency/base.py", line 26, in apply_target
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_celery/iron_mq_transport.py", line 58, in basic_ack
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] self.client.deleteMessage(deli
very_info['ironmq_queue'], delivery_info['ironmq_message_id'])
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_mq.py", line 160, in deleteMessage
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] return self.queue(queue_name).delete(message_id)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_mq.py", line 66, in delete
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,526: WARNING/MainProcess] result = self.client.delete(url)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] retry=retry, body=body)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,525: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/base.py", line 98, in ack_log_error
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 146, in request
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 369, in delete
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] r = self._doRequest(url, method, body, headers)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] return self.request('DELETE', url, **kwargs)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 113, in _doRequest
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] r = self.conn.delete(url, data=body, headers=headers)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 279, in request
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 374, in send
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,529: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/adapters.py", line 209, in send
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,530: WARNING/MainProcess] raise ConnectionError(e)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,530: WARNING/MainProcess] ConnectionError: HTTPSConnectionPool(host='mq-aws-us-east-1.iron.io', port=443): Max retries exceeded with url: /1/projects/511cbc6b8e7d144cb1000970/queues/celery/messages/5860081072625091661 (Caused by <class 'gevent.dns.DNSError'>: [Errno 67] request timed out)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,530: WARNING/MainProcess] <Greenlet at 0x209c5f0: apply_target(<function _fast_trace_task at 0x2d0c0c8>, ('profiles.tasks.task_set_friends', 'ce70adcb-737d, {}, <bound method Request.on_success of <Request ce70a, <bound method Request.on_accepted of <Request ce70, timeout_callback=<bound method Request.on_timeout of <Request ce70a, timeout=None)> failed with ConnectionError
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,532: INFO/MainProcess] Starting new HTTPS connection (13): mq-aws-us-east-1.iron.io
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,541: INFO/MainProcess] Got task from broker: notifications.tasks.task_notify_user[56cc405a-af2d-4515-ada1-5be51b0d1bf9]
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,527: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 227, in delete
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] resp = self.send(prep, stream=stream, timeout=timeout, verify=verify, cert=cert, proxies=proxies)
2013-03-27T17:47:43+00:00 app[web.1]: 18:47:43 celeryd.1 | [2013-03-27 18:47:43,528: WARNING/MainProcess] r = adapter.send(request, **kwargs)
2013-03-27T17:47:57+00:00 heroku[router]: at=info method=HEAD path=/admin/ host=yoin-deploy.herokuapp.com fwd="184.73.237.85" dyno=web.1 connect=1ms service=39ms status=200 bytes=0
2013-03-27T17:47:57+00:00 app[web.1]: 18:47:57 web.1 | [INFO] [ACCESS] 184.73.237.85 - user=-1 - 2013-03-27 18:47:57.535444 "HEAD /admin/" status=200 - "" - "NewRelicPinger/1.0 (185703)" - data={} - content={}
2013-03-27T17:47:57+00:00 app[web.1]: 18:47:57 web.1 | [GUNICORN] 10.8.221.224 - - [27/Mar/2013:18:47:57] "HEAD /admin/ HTTP/1.1" 200 6697 "-" "NewRelicPinger/1.0 (185703)"
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,533: WARNING/MainProcess] Traceback (most recent call last):
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,533: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/gevent/greenlet.py", line 390, in run
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] result = self._run(*self.args, **self.kwargs)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/concurrency/base.py", line 26, in apply_target
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] accept_callback(pid or os.getpid(), time.time())
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/worker/job.py", line 301, in on_accepted
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,535: WARNING/MainProcess] self.on_ack(logger, self.connection_errors)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,535: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/base.py", line 98, in ack_log_error
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,535: WARNING/MainProcess] self.ack()
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,535: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/base.py", line 93, in ack
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,536: WARNING/MainProcess] self.channel.basic_ack(self.delivery_tag)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,536: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_celery/iron_mq_transport.py", line 58, in basic_ack
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] self.client.deleteMessage(delivery_info['ironmq_queue'], delivery_info['ironmq_message_id'])
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_mq.py", line 160, in deleteMessage
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] return self.queue(queue_name).delete(message_id)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_mq.py", line 66, in delete
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] result = self.client.delete(url)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 146, in request
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] r = self._doRequest(url, method, body, headers)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 113, in _doRequest
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] r = self.conn.delete(url, data=body, headers=headers)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 279, in request
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 369, in delete
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] return self.request('DELETE', url, **kwargs)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] resp = self.send(prep, stream=stream, timeout=timeout, verify=verify, cert=cert, proxies=proxies)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/sessions.py", line 374, in send
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/requests/adapters.py", line 209, in send
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] self.acknowledge()
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,534: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/celery/worker/job.py", line 439, in acknowledge
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,539: WARNING/MainProcess] r = adapter.send(request, **kwargs)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,540: WARNING/MainProcess] raise ConnectionError(e)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,541: INFO/MainProcess] Starting new HTTPS connection (14): mq-aws-us-east-1.iron.io
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,540: WARNING/MainProcess] <Greenlet at 0x209c5f0: apply_target(<function _fast_trace_task at 0x2d0c0c8>, ('notifications.tasks.task_new_invitation', 'ed680, {}, <bound method Request.on_success of <Request ed680, <bound method Request.on_accepted of <Request ed68, timeout_callback=<bound method Request.on_timeout of <Request ed680, timeout=None)> failed with ConnectionError
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,537: WARNING/MainProcess] File "/app/.heroku/python/lib/python2.7/site-packages/iron_core.py", line 227, in delete
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,538: WARNING/MainProcess] retry=retry, body=body)
2013-03-27T17:47:58+00:00 app[web.1]: 18:47:58 celeryd.1 | [2013-03-27 18:47:58,540: WARNING/MainProcess] ConnectionError: HTTPSConnectionPool(host='mq-aws-us-east-1.iron.io', port=443): Max retries exceeded with url: /1/projects/511cbc6b8e7d144cb1000970/queues/celery/messages/5860081072625091664 (Caused by <class 'gevent.dns.DNSError'>: [Errno 67] request timed out)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment