stacktrace1.txt

requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')
[2019-05-08 01:57:12,394] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs [2019-05-08 01:57:12,389] {models.py:1760} ERROR - ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
[2019-05-08 01:57:12,395] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,395] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
[2019-05-08 01:57:12,396] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     chunked=chunked)
[2019-05-08 01:57:12,396] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 384, in _make_request
[2019-05-08 01:57:12,396] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     six.raise_from(e, None)
[2019-05-08 01:57:12,396] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "<string>", line 2, in raise_from
[2019-05-08 01:57:12,397] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 380, in _make_request
[2019-05-08 01:57:12,397] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     httplib_response = conn.getresponse()
[2019-05-08 01:57:12,397] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 1331, in getresponse
[2019-05-08 01:57:12,397] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response.begin()
[2019-05-08 01:57:12,397] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 297, in begin
[2019-05-08 01:57:12,398] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     version, status, reason = self._read_status()
[2019-05-08 01:57:12,398] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 258, in _read_status
[2019-05-08 01:57:12,398] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
[2019-05-08 01:57:12,398] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/socket.py", line 586, in readinto
[2019-05-08 01:57:12,398] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self._sock.recv_into(b)
[2019-05-08 01:57:12,399] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs ConnectionResetError: [Errno 104] Connection reset by peer
[2019-05-08 01:57:12,400] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,401] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs During handling of the above exception, another exception occurred:
[2019-05-08 01:57:12,401] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,401] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,402] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
[2019-05-08 01:57:12,402] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     timeout=timeout
[2019-05-08 01:57:12,402] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 638, in urlopen
[2019-05-08 01:57:12,403] {models.py:1789} INFO - All retries failed; marking task as FAILED
[2019-05-08 01:57:12,404] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     _stacktrace=sys.exc_info()[2])
[2019-05-08 01:57:12,404] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/util/retry.py", line 367, in increment
[2019-05-08 01:57:12,405] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise six.reraise(type(error), error, _stacktrace)
[2019-05-08 01:57:12,405] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/packages/six.py", line 685, in reraise
[2019-05-08 01:57:12,405] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise value.with_traceback(tb)
[2019-05-08 01:57:12,405] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
[2019-05-08 01:57:12,405] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     chunked=chunked)
[2019-05-08 01:57:12,406] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 384, in _make_request
[2019-05-08 01:57:12,406] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     six.raise_from(e, None)
[2019-05-08 01:57:12,406] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "<string>", line 2, in raise_from
[2019-05-08 01:57:12,406] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 380, in _make_request
[2019-05-08 01:57:12,406] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     httplib_response = conn.getresponse()
[2019-05-08 01:57:12,408] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 1331, in getresponse
[2019-05-08 01:57:12,408] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response.begin()
[2019-05-08 01:57:12,409] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 297, in begin
[2019-05-08 01:57:12,409] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     version, status, reason = self._read_status()
[2019-05-08 01:57:12,409] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 258, in _read_status
[2019-05-08 01:57:12,409] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
[2019-05-08 01:57:12,409] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/socket.py", line 586, in readinto
[2019-05-08 01:57:12,410] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self._sock.recv_into(b)
[2019-05-08 01:57:12,410] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
[2019-05-08 01:57:12,410] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,410] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs During handling of the above exception, another exception occurred:
[2019-05-08 01:57:12,410] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,411] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,411] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/models.py", line 1654, in _run_raw_task
[2019-05-08 01:57:12,412] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     result = task_copy.execute(context=context)
[2019-05-08 01:57:12,412] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/operators/python_operator.py", line 95, in execute
[2019-05-08 01:57:12,412] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return_value = self.execute_callable()
[2019-05-08 01:57:12,413] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/operators/python_operator.py", line 100, in execute_callable
[2019-05-08 01:57:12,413] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.python_callable(*self.op_args, **self.op_kwargs)
[2019-05-08 01:57:12,413] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/home/airflow/gcs/dags/build_export_dag.py", line 158, in export_receipts_and_logs_command
[2019-05-08 01:57:12,414] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     logs_output=os.path.join(tempdir, "logs.json"),
[2019-05-08 01:57:12,414] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/cli/export_receipts_and_logs.py", line 65, in export_receipts_and_logs
[2019-05-08 01:57:12,415] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     job.run()
[2019-05-08 01:57:12,415] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/base_job.py", line 30, in run
[2019-05-08 01:57:12,415] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._end()
[2019-05-08 01:57:12,415] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 81, in _end
[2019-05-08 01:57:12,416] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.batch_work_executor.shutdown()
[2019-05-08 01:57:12,417] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 65, in shutdown
[2019-05-08 01:57:12,418] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.executor.shutdown()
[2019-05-08 01:57:12,418] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 39, in shutdown
[2019-05-08 01:57:12,418] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._check_completed_futures()
[2019-05-08 01:57:12,418] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 47, in _check_completed_futures
[2019-05-08 01:57:12,418] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     future.result()
[2019-05-08 01:57:12,419] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 425, in result
[2019-05-08 01:57:12,419] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.__get_result()
[2019-05-08 01:57:12,419] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
[2019-05-08 01:57:12,419] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise self._exception
[2019-05-08 01:57:12,420] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/base_job.py", line 28, in run
[2019-05-08 01:57:12,421] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._export()
[2019-05-08 01:57:12,421] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 63, in _export
[2019-05-08 01:57:12,422] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.batch_work_executor.execute(self.transaction_hashes_iterable, self._export_receipts)
[2019-05-08 01:57:12,422] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 48, in execute
[2019-05-08 01:57:12,422] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.executor.submit(self._fail_safe_execute, work_handler, batch)
[2019-05-08 01:57:12,422] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 31, in submit
[2019-05-08 01:57:12,423] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._check_completed_futures()
[2019-05-08 01:57:12,423] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 47, in _check_completed_futures
[2019-05-08 01:57:12,423] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     future.result()
[2019-05-08 01:57:12,424] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 425, in result
[2019-05-08 01:57:12,425] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.__get_result()
[2019-05-08 01:57:12,425] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
[2019-05-08 01:57:12,425] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise self._exception
[2019-05-08 01:57:12,425] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/thread.py", line 56, in run
[2019-05-08 01:57:12,426] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     result = self.fn(*self.args, **self.kwargs)
[2019-05-08 01:57:12,427] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 61, in _fail_safe_execute
[2019-05-08 01:57:12,427] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     work_handler([item])
[2019-05-08 01:57:12,428] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 67, in _export_receipts
[2019-05-08 01:57:12,428] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response = self.batch_web3_provider.make_request(json.dumps(receipts_rpc))
[2019-05-08 01:57:12,428] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/providers/rpc.py", line 39, in make_request
[2019-05-08 01:57:12,428] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     **self.get_request_kwargs()
[2019-05-08 01:57:12,429] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/web3/utils/request.py", line 26, in make_post_request
[2019-05-08 01:57:12,430] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response = session.post(endpoint_uri, data=data, *args, **kwargs)
[2019-05-08 01:57:12,431] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 581, in post
[2019-05-08 01:57:12,431] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.request('POST', url, data=data, json=json, **kwargs)
[2019-05-08 01:57:12,431] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 533, in request
[2019-05-08 01:57:12,431] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     resp = self.send(prep, **send_kwargs)
[2019-05-08 01:57:12,432] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 646, in send
[2019-05-08 01:57:12,433] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     r = adapter.send(request, **kwargs)
[2019-05-08 01:57:12,433] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
[2019-05-08 01:57:12,434] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise ConnectionError(err, request=request)
[2019-05-08 01:57:12,434] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
[2019-05-08 01:57:12,434] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs [2019-05-08 01:57:12,403] {models.py:1789} INFO - All retries failed; marking task as FAILED
[2019-05-08 01:57:12,743] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs [2019-05-08 01:57:12,743] {sendgrid.py:114} INFO - Email with subject Airflow alert: <TaskInstance: ethereum_export_dag.export_receipts_and_logs 2019-05-07T01:00:00+00:00 [failed]> is successfully sent to recipients: [{'to': [{'email': '[email protected]'}]}]
[2019-05-08 01:57:12,814] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,815] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
[2019-05-08 01:57:12,816] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     chunked=chunked)
[2019-05-08 01:57:12,816] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 384, in _make_request
[2019-05-08 01:57:12,816] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     six.raise_from(e, None)
[2019-05-08 01:57:12,817] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "<string>", line 2, in raise_from
[2019-05-08 01:57:12,817] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 380, in _make_request
[2019-05-08 01:57:12,818] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     httplib_response = conn.getresponse()
[2019-05-08 01:57:12,818] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 1331, in getresponse
[2019-05-08 01:57:12,819] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response.begin()
[2019-05-08 01:57:12,819] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 297, in begin
[2019-05-08 01:57:12,820] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     version, status, reason = self._read_status()
[2019-05-08 01:57:12,820] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 258, in _read_status
[2019-05-08 01:57:12,820] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
[2019-05-08 01:57:12,821] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/socket.py", line 586, in readinto
[2019-05-08 01:57:12,821] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self._sock.recv_into(b)
[2019-05-08 01:57:12,821] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs ConnectionResetError: [Errno 104] Connection reset by peer
[2019-05-08 01:57:12,822] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,822] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs During handling of the above exception, another exception occurred:
[2019-05-08 01:57:12,822] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,822] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,823] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
[2019-05-08 01:57:12,823] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     timeout=timeout
[2019-05-08 01:57:12,823] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 638, in urlopen
[2019-05-08 01:57:12,824] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     _stacktrace=sys.exc_info()[2])
[2019-05-08 01:57:12,824] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/util/retry.py", line 367, in increment
[2019-05-08 01:57:12,825] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise six.reraise(type(error), error, _stacktrace)
[2019-05-08 01:57:12,825] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/packages/six.py", line 685, in reraise
[2019-05-08 01:57:12,825] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise value.with_traceback(tb)
[2019-05-08 01:57:12,826] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen
[2019-05-08 01:57:12,826] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     chunked=chunked)
[2019-05-08 01:57:12,826] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 384, in _make_request
[2019-05-08 01:57:12,827] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     six.raise_from(e, None)
[2019-05-08 01:57:12,827] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "<string>", line 2, in raise_from
[2019-05-08 01:57:12,827] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/urllib3/connectionpool.py", line 380, in _make_request
[2019-05-08 01:57:12,828] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     httplib_response = conn.getresponse()
[2019-05-08 01:57:12,828] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 1331, in getresponse
[2019-05-08 01:57:12,829] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response.begin()
[2019-05-08 01:57:12,829] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 297, in begin
[2019-05-08 01:57:12,830] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     version, status, reason = self._read_status()
[2019-05-08 01:57:12,830] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/http/client.py", line 258, in _read_status
[2019-05-08 01:57:12,830] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
[2019-05-08 01:57:12,831] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/socket.py", line 586, in readinto
[2019-05-08 01:57:12,831] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self._sock.recv_into(b)
[2019-05-08 01:57:12,832] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))
[2019-05-08 01:57:12,832] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,832] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs During handling of the above exception, another exception occurred:
[2019-05-08 01:57:12,832] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs 
[2019-05-08 01:57:12,832] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs Traceback (most recent call last):
[2019-05-08 01:57:12,833] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/bin/airflow", line 7, in <module>
[2019-05-08 01:57:12,833] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     exec(compile(f.read(), __file__, 'exec'))
[2019-05-08 01:57:12,833] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/bin/airflow", line 32, in <module>
[2019-05-08 01:57:12,834] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     args.func(args)
[2019-05-08 01:57:12,834] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/utils/cli.py", line 74, in wrapper
[2019-05-08 01:57:12,834] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return f(*args, **kwargs)
[2019-05-08 01:57:12,835] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/bin/cli.py", line 490, in run
[2019-05-08 01:57:12,836] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     _run(args, dag, ti)
[2019-05-08 01:57:12,836] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/bin/cli.py", line 406, in _run
[2019-05-08 01:57:12,836] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     pool=args.pool,
[2019-05-08 01:57:12,836] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/utils/db.py", line 74, in wrapper
[2019-05-08 01:57:12,837] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return func(*args, **kwargs)
[2019-05-08 01:57:12,837] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/models.py", line 1654, in _run_raw_task
[2019-05-08 01:57:12,837] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     result = task_copy.execute(context=context)
[2019-05-08 01:57:12,838] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/operators/python_operator.py", line 95, in execute
[2019-05-08 01:57:12,839] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return_value = self.execute_callable()
[2019-05-08 01:57:12,839] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/usr/local/lib/airflow/airflow/operators/python_operator.py", line 100, in execute_callable
[2019-05-08 01:57:12,840] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.python_callable(*self.op_args, **self.op_kwargs)
[2019-05-08 01:57:12,840] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/home/airflow/gcs/dags/build_export_dag.py", line 158, in export_receipts_and_logs_command
[2019-05-08 01:57:12,840] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     logs_output=os.path.join(tempdir, "logs.json"),
[2019-05-08 01:57:12,840] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/cli/export_receipts_and_logs.py", line 65, in export_receipts_and_logs
[2019-05-08 01:57:12,841] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     job.run()
[2019-05-08 01:57:12,841] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/base_job.py", line 30, in run
[2019-05-08 01:57:12,842] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._end()
[2019-05-08 01:57:12,843] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 81, in _end
[2019-05-08 01:57:12,843] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.batch_work_executor.shutdown()
[2019-05-08 01:57:12,844] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 65, in shutdown
[2019-05-08 01:57:12,845] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.executor.shutdown()
[2019-05-08 01:57:12,845] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 39, in shutdown
[2019-05-08 01:57:12,845] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._check_completed_futures()
[2019-05-08 01:57:12,845] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 47, in _check_completed_futures
[2019-05-08 01:57:12,845] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     future.result()
[2019-05-08 01:57:12,846] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 425, in result
[2019-05-08 01:57:12,846] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.__get_result()
[2019-05-08 01:57:12,847] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
[2019-05-08 01:57:12,847] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise self._exception
[2019-05-08 01:57:12,848] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/base_job.py", line 28, in run
[2019-05-08 01:57:12,848] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._export()
[2019-05-08 01:57:12,848] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 63, in _export
[2019-05-08 01:57:12,849] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.batch_work_executor.execute(self.transaction_hashes_iterable, self._export_receipts)
[2019-05-08 01:57:12,849] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 48, in execute
[2019-05-08 01:57:12,849] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self.executor.submit(self._fail_safe_execute, work_handler, batch)
[2019-05-08 01:57:12,850] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 31, in submit
[2019-05-08 01:57:12,850] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     self._check_completed_futures()
[2019-05-08 01:57:12,850] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/fail_safe_executor.py", line 47, in _check_completed_futures
[2019-05-08 01:57:12,850] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     future.result()
[2019-05-08 01:57:12,850] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 425, in result
[2019-05-08 01:57:12,851] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.__get_result()
[2019-05-08 01:57:12,851] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
[2019-05-08 01:57:12,851] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise self._exception
[2019-05-08 01:57:12,851] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/concurrent/futures/thread.py", line 56, in run
[2019-05-08 01:57:12,851] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     result = self.fn(*self.args, **self.kwargs)
[2019-05-08 01:57:12,852] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/executors/batch_work_executor.py", line 61, in _fail_safe_execute
[2019-05-08 01:57:12,852] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     work_handler([item])
[2019-05-08 01:57:12,852] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/jobs/export_receipts_job.py", line 67, in _export_receipts
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response = self.batch_web3_provider.make_request(json.dumps(receipts_rpc))
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/ethereumetl/providers/rpc.py", line 39, in make_request
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     **self.get_request_kwargs()
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/web3/utils/request.py", line 26, in make_post_request
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     response = session.post(endpoint_uri, data=data, *args, **kwargs)
[2019-05-08 01:57:12,853] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 581, in post
[2019-05-08 01:57:12,854] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     return self.request('POST', url, data=data, json=json, **kwargs)
[2019-05-08 01:57:12,854] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 533, in request
[2019-05-08 01:57:12,854] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     resp = self.send(prep, **send_kwargs)
[2019-05-08 01:57:12,854] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/sessions.py", line 646, in send
[2019-05-08 01:57:12,854] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     r = adapter.send(request, **kwargs)
[2019-05-08 01:57:12,855] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs   File "/opt/python3.6/lib/python3.6/site-packages/requests/adapters.py", line 498, in send
[2019-05-08 01:57:12,855] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs     raise ConnectionError(err, request=request)
[2019-05-08 01:57:12,855] {base_task_runner.py:101} INFO - Job 35305: Subtask export_receipts_and_logs requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))