Skip to content

Instantly share code, notes, and snippets.

@sub-mod
sub-mod / notebook_logs.txt
Created June 7, 2019 15:33
notebook_logs
$ python build_image.py --tf_version=1.13.1 --platform=cpu tf_notebook
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
INFO|2019-06-06T23:48:38|build_image.py|71| docker daemon ready.
INFO|2019-06-06T23:48:38|build_image.py|25| Running: docker build --pull --build-arg INSTALL_TFMA=yes --build-arg TF_PACKAGE=http://file.rdu.redhat.com/smodeel/thoth/tensorflow-1.13.1-cp36-cp36m-linux_x86_64.whl --build-arg BASE_IMAGE=ubuntu:18.04@sha256:de774a3145f7ca4f0bd144c7d4ffb2931e06634f11529653b23eba85aef8e378 --build-arg TF_PACKAGE_PY_27=http://file.rdu.redhat.com/smodeel/thoth/tensorflow-1.13.1-cp27-none-linux_x86_64.whl -t gcr.io/kubeflow-images-public/tensorflow-1.13.1-notebook-cpu:latest -f Dockerfile .
cwd=/Users/subin/development/kubeflow/kubeflow/components/tensorflow-notebook-image
INFO|2019-06-06T23:48:38|build_image.py|40| Subprocess output:
INFO|2019-06-06T23:48:39|build_image.py|46| Sending build context to Docker daemon 19.9M
@sub-mod
sub-mod / manylinux2010_x86_64.txt
Created June 6, 2019 16:54
manylinux2010_x86_64
bash-4.1# auditwheel show /input/tensorflow-1.13.1-cp27-none-linux_x86_64.whl
tensorflow-1.13.1-cp27-none-linux_x86_64.whl is consistent with the
following platform tag: "manylinux2010_x86_64".
The wheel references external versioned symbols in these system-
provided shared libraries: libc.so.6 with versions {'GLIBC_2.2.5',
'GLIBC_2.3.4', 'GLIBC_2.6', 'GLIBC_2.7', 'GLIBC_2.10', 'GLIBC_2.3',
'GLIBC_2.3.2', 'GLIBC_2.9', 'GLIBC_2.4', 'GLIBC_2.11'}, libstdc++.so.6
with versions {'CXXABI_1.3.3', 'GLIBCXX_3.4.10', 'GLIBCXX_3.4',
@sub-mod
sub-mod / TF_1.13.1_manylinux.patch
Created June 5, 2019 19:25
TF_1.13.1_manylinux.patch
diff --git a/tensorflow/tensorflow.bzl b/tensorflow/tensorflow.bzl
index d93e0df..8825820 100644
--- a/tensorflow/tensorflow.bzl
+++ b/tensorflow/tensorflow.bzl
@@ -377,7 +377,7 @@ def tf_cc_shared_object(
srcs = [],
deps = [],
data = [],
- linkopts = [],
+ linkopts = ['-lrt'],
@sub-mod
sub-mod / centos6_tf_build_pass.txt
Last active June 13, 2019 02:31
centos6_tf_build_pass
bash-4.1# auditwheel show tensorflow-gpu-1.13.1-cp
tensorflow-gpu-1.13.1-cp27-none-linux_x86_64.whl tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl
bash-4.1# auditwheel show tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl
tensorflow-gpu-1.13.1-cp36-cp36m-linux_x86_64.whl is consistent with
the following platform tag: "linux_x86_64".
The wheel references external versioned symbols in these system-
provided shared libraries: librt.so.1 with versions {'GLIBC_2.2.5'},
libgcc_s.so.1 with versions {'GCC_3.0'}, libcudart.so.10.0 with
@sub-mod
sub-mod / kubleflow_thoth_tf.md
Last active May 15, 2019 22:51
kubleflow + thoth TF image

Install kustomize

opsys=linux  # or darwin, or windows
curl -s https://api.github.com/repos/kubernetes-sigs/kustomize/releases/latest |\
  grep browser_download |\
  grep $opsys |\
  cut -d '"' -f 4 |\
  xargs curl -O -L
mv kustomize_*_${opsys}_amd64 kustomize  
chmod u+x kustomize  
@sub-mod
sub-mod / ssd_perf.md
Created April 24, 2019 01:15
SSD performance
/Volumes/Samsung_T5/development/TEST_SSD$ time git clone https://github.com/openshift/origin.git
Cloning into 'origin'...
remote: Enumerating objects: 53, done.
remote: Counting objects: 100% (53/53), done.
remote: Compressing objects: 100% (49/49), done.
remote: Total 533223 (delta 7), reused 9 (delta 4), pack-reused 533170
Receiving objects: 100% (533223/533223), 976.50 MiB | 9.93 MiB/s, done.
Resolving deltas: 100% (339788/339788), done.
Checking connectivity... done.
@sub-mod
sub-mod / pl-tensorflowapp_test.txt
Last active March 11, 2019 19:19
pl-tensorflowapp test
$ docker version
Client: Docker Engine - Community
Version: 18.09.1
API version: 1.39
Go version: go1.10.6
Git commit: 4c52b90
Built: Wed Jan 9 19:33:12 2019
OS/Arch: darwin/amd64
Experimental: false
@sub-mod
sub-mod / centos7_okd311.txt
Created February 28, 2019 05:51
centos7_okd311
#set root password if not set
sudo passwd
sudo yum update -y
sudo vi /etc/ssh/sshd_config
Make sure below 2 lines exists with yes
PermitEmptyPasswords yes
PasswordAuthentication yes
@sub-mod
sub-mod / load_incluster_config.py
Created October 24, 2018 22:35
Remove load_incluster_config
from openshift.dynamic import DynamicClient
from kubernetes.client import Configuration, ApiClient
from kubernetes.config.incluster_config import InClusterConfigLoader
import urllib3
def load_incluster_config(environ):
"""Use the service account kubernetes gives to pods to connect to kubernetes
cluster. It's intended for clients that expect to be running inside a pod
@sub-mod
sub-mod / cmds.md
Last active April 16, 2019 20:49
GPU testing on Openshift 3.10: