Skip to content

Instantly share code, notes, and snippets.

View jlewi's full-sized avatar

Jeremy Lewi jlewi

View GitHub Profile
*** Reading local log.
[2017-11-28 15:58:34,300] {cli.py:379} INFO - Running on host airflow-3161575526-nvrjl
[2017-11-28 15:58:34,318] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2017-11-28 15:58:31 [queued]>
[2017-11-28 15:58:34,323] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2017-11-28 15:58:31 [queued]>
[2017-11-28 15:58:34,323] {models.py:1383} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 2
--------------------------------------------------------------------------------
[2017-11-28 15:58:34,336] {models.py:1404} INFO - Executing <Task(PythonOperator): build_images> on 2017-11-28 15:58:31
*** Reading local log.
[2017-11-28 15:58:34,300] {cli.py:379} INFO - Running on host airflow-3161575526-nvrjl
[2017-11-28 15:58:34,318] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2017-11-28 15:58:31 [queued]>
[2017-11-28 15:58:34,323] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2017-11-28 15:58:31 [queued]>
[2017-11-28 15:58:34,323] {models.py:1383} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 2
--------------------------------------------------------------------------------
[2017-11-28 15:58:34,336] {models.py:1404} INFO - Executing <Task(PythonOperator): build_images> on 2017-11-28 15:58:31
*** Reading local log.
[2017-11-30 16:38:58,267] {cli.py:379} INFO - Running on host airflow-2420667707-h7zd5
[2017-11-30 16:38:58,290] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.setup_cluster 2017-11-30 16:34:35 [queued]>
[2017-11-30 16:38:58,298] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.setup_cluster 2017-11-30 16:34:35 [queued]>
[2017-11-30 16:38:58,298] {models.py:1383} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 2
--------------------------------------------------------------------------------
[2017-11-30 16:38:58,308] {models.py:1404} INFO - Executing <Task(PythonOperator): setup_cluster> on 2017-11-30 16:34:35
@jlewi
jlewi / broken manifest
Created December 29, 2017 00:01
Argo Workflow Causing Segfault
apiVersion: v1
items:
- apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
clusterName: ""
creationTimestamp: 2017-12-28T23:49:03Z
generation: 0
labels:
workflows.argoproj.io/phase: Running
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/app/trainer/task.py", line 193, in <module>
tf.app.run()
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "/app/trainer/task.py", line 188, in main
usermod: no changes
Execute the command as jovyan
[W 2018-01-08 18:10:05.850 SingleUserNotebookApp configurable:168] Config option `open_browser` not recognized by `SingleUserNotebookApp`. Did you mean `browser`?
/opt/conda/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)
[I 2018-01-08 18:10:08.414 SingleUserNotebookApp handlers:46] jupyter_tensorboard extension loaded.
[I 2018-01-08 18:10:08.450 SingleUserNotebookApp extension:38] JupyterLab alpha preview extension loaded from /opt/conda/lib/python3.6/site-packages/jupyterlab
[I 2018-01-08 18:10:08.453 SingleUserNotebookApp extension:88] Running the core application with no additional extensions or settings
[I 2018-01-08 18:10:08.457 SingleUserNotebookApp singleuser:365] Starting jupyterhub-singleuser server version 0.8.1
[I 2018-01-08 18:10:08.466 SingleUserNotebookApp log:122] 302 GET /user/[email protected]
usermod: no changes
Execute the command as jovyan
[W 2018-01-08 18:29:33.482 SingleUserNotebookApp configurable:168] Config option `open_browser` not recognized by `SingleUserNotebookApp`. Did you mean `browser`?
/opt/conda/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6
return f(*args, **kwds)
[I 2018-01-08 18:29:35.106 SingleUserNotebookApp handlers:46] jupyter_tensorboard extension loaded.
[I 2018-01-08 18:29:35.130 SingleUserNotebookApp extension:38] JupyterLab alpha preview extension loaded from /opt/conda/lib/python3.6/site-packages/jupyterlab
[I 2018-01-08 18:29:35.132 SingleUserNotebookApp extension:88] Running the core application with no additional extensions or settings
[I 2018-01-08 18:29:35.135 SingleUserNotebookApp singleuser:365] Starting jupyterhub-singleuser server version 0.8.1
[I 2018-01-08 18:29:35.142 SingleUserNotebookApp log:122] 302 GET /user/no-iap/ → /user
daemon off;
user nginx nginx;
pid /var/run/nginx.pid;
# Worker/connection processing limits
worker_processes 1;
worker_rlimit_nofile 10240;
events { worker_connections 10240; }
@jlewi
jlewi / Airflow
Created January 10, 2018 05:43
Airflow logs
Airflow
DAGs
Data Profiling
Browse
Admin
Docs
About
05:43 UTC
OnOff DAG: tf_k8s_tests schedule: None
Graph View
Airflow
DAGs
Data Profiling
Browse
Admin
Docs
About
11:31 UTC
OnOff DAG: tf_k8s_tests schedule: None
Graph View