| date | 2020-02-29 | |
|---|---|---|
| title | Proper CUDA and cuDNN installation | |
| tags |
|
You're here, so you're probably already hurting because of CUDA and cuDNN compatibility, and I won't have to motivate you, or explain why you'd want to have standalone CUDA and cuDNN installations, if you're going to develop using Tensorflow in the long term.
| #! /bin/sh | |
| # Workaround for broken CUDA/NVENC/NVDEC after suspend. | |
| # This file now lives in /lib/systemd/system-sleep/nvidia-resume . | |
| # Remember to chmod 755 it. | |
| PATH=/sbin:/usr/sbin:/bin:/usr/bin | |
| case $1 in | |
| post) |
| import os | |
| import pathlib | |
| import tensorflow as tf | |
| import logging | |
| ## -------------------------------------------------------------------------------- | |
| # Configure | |
| physical_devices = tf.config.experimental.list_physical_devices('GPU') | |
| assert len(physical_devices) > 0, "No GPUs found" |
| https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=781288;msg=37 | |
| $ apt-get remove light-locker |
| docker run --gpus all -it --rm --shm-size=1g --ulimit memlock=-1 --ulimit stack=67108864 nvcr.io/nvidia/tensorflow:19.10-py3 nvidia-smi |
Environment: AWS P2.xlarge instance with a K80 GPU and CUDA compute capability of 3.7.
Error: "Ignoring visible gpu device [...] The minimum required Cuda capability is 6.0."
Expected: The minimum CUDA compute capability is 3.5, like the documents state, and as the Python packages require.
| [100.079s][info][gc,stats ] === Garbage Collection Statistics ======================================================================================================================= | |
| [100.079s][info][gc,stats ] Last 10s Last 10m Last 10h Total | |
| [100.079s][info][gc,stats ] Avg / Max Avg / Max Avg / Max Avg / Max | |
| [100.079s][info][gc,stats ] Collector: Garbage Collection Cycle 0.000 / 0.000 55.908 / 77.566 55.908 / 77.566 55.908 / 77.566 ms | |
| [100.079s][info][gc,stats ] Contention: Mark Segment Reset Contention 0 / 0 0 / 0 0 / 0 0 / 0 ops/s | |
| [100.079s][info][gc,stats ] Contention: Mark SeqNum Reset Contention 0 / 0 0 / 0 0 / 0 |
| #!/bin/bash | |
| export JAVA_HOME="${HOME}/local/jdk-11" | |
| export PATH="${JAVA_HOME}/bin":$PATH | |
| $@ |
| -Dsuppress.focus.stealing=false | |
| https://youtrack.jetbrains.com/issue/IDEA-196933#focus=streamItem-27-3252588-0-0 |
| import warnings | |
| with warnings.catch_warnings(): | |
| warnings.filterwarnings('ignore', category=FutureWarning) | |
| import h5py | |
| import os | |
| os.environ['TF_CPP_MIN_LOG_LEVEL'] = '1' | |
| import tensorflow as tf |
