install_error.dat

chrissul@nervana-titanxp22 /localdisk/sullivan/projects $ nvidia-smi
Wed Aug  8 08:34:41 2018
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 396.26                 Driver Version: 396.26                    |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  TITAN Xp            Off  | 00000000:06:00.0 Off |                  N/A |
| 23%   28C    P8    17W / 250W |    588MiB / 12196MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   1  TITAN Xp            Off  | 00000000:07:00.0 Off |                  N/A |
| 23%   28C    P8    16W / 250W |    444MiB / 12196MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  TITAN Xp            Off  | 00000000:0C:00.0 Off |                  N/A |
| 35%   58C    P2    85W / 250W |   8973MiB / 12196MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   3  TITAN Xp            Off  | 00000000:0F:00.0 Off |                  N/A |
| 23%   28C    P8    16W / 250W |    442MiB / 12196MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      6048      C   python                                       363MiB |
|    0     78093      C   ...te/home/abhiwand/tensorflow/bin/python3   215MiB |
|    1      6048      C   python                                       217MiB |
|    1     78093      C   ...te/home/abhiwand/tensorflow/bin/python3   215MiB |
|    2      6048      C   python                                       217MiB |
|    2     75389      C   python                                      8529MiB |
|    2     78093      C   ...te/home/abhiwand/tensorflow/bin/python3   215MiB |
|    3      6048      C   python                                       217MiB |
|    3     78093      C   ...te/home/abhiwand/tensorflow/bin/python3   215MiB |
+-----------------------------------------------------------------------------+

chrissul@nervana-titanxp22 /localdisk/sullivan/projects $ sudo apt install nvidia-opencl-icd-396
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  libnvidia-container-tools libnvidia-container1 nvidia-container-runtime nvidia-container-runtime-hook pigz
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
  nvidia-396
The following packages will be upgraded:
  nvidia-396 nvidia-opencl-icd-396
2 upgraded, 0 newly installed, 0 to remove and 192 not upgraded.
Need to get 81.5 MB of archives.
After this operation, 1,481 kB of additional disk space will be used.
Do you want to continue? [Y/n]
Get:1 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu xenial/main amd64 nvidia-396 amd64 396.51-0ubuntu0~gpu16.04.1 [78.0 MB]
Get:2 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu xenial/main amd64 nvidia-opencl-icd-396 amd64 396.51-0ubuntu0~gpu16.04.1 [3,544 kB]
Fetched 81.5 MB in 3min 44s (364 kB/s)
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
(Reading database ... 319057 files and directories currently installed.)
Preparing to unpack .../nvidia-396_396.51-0ubuntu0~gpu16.04.1_amd64.deb ...
Removing all DKMS Modules
Done.
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
Unpacking nvidia-396 (396.51-0ubuntu0~gpu16.04.1) over (396.26-0ubuntu1) ...
Preparing to unpack .../nvidia-opencl-icd-396_396.51-0ubuntu0~gpu16.04.1_amd64.deb ...
Unpacking nvidia-opencl-icd-396 (396.51-0ubuntu0~gpu16.04.1) over (396.26-0ubuntu1) ...
Processing triggers for libc-bin (2.23-0ubuntu10) ...
Processing triggers for ureadahead (0.100.0-19) ...
Processing triggers for man-db (2.7.5-1) ...
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
Setting up nvidia-396 (396.51-0ubuntu0~gpu16.04.1) ...
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
update-alternatives: renaming x86_64-linux-gnu_nvidia_app_profile slave link from /usr/share/nvidia/nvidia-application-profiles-396.26-rc to /usr/share/nvidia/nvidia-application-profiles-396.51-rc
update-alternatives: renaming x86_64-linux-gnu_nvidia_app_profile_keys slave link from /usr/share/nvidia/nvidia-application-profiles-396.26-key-documentation to /usr/share/nvidia/nvidia-application-profiles-396.51-key-documentation
update-alternatives: warning: forcing reinstallation of alternative /usr/lib/nvidia-396/ld.so.conf because link group x86_64-linux-gnu_gl_conf is broken
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
update-initramfs: deferring update (trigger activated)
INFO:Enable nvidia-396
DEBUG:Parsing /usr/share/ubuntu-drivers-common/quirks/dell_latitude
DEBUG:Parsing /usr/share/ubuntu-drivers-common/quirks/lenovo_thinkpad
DEBUG:Parsing /usr/share/ubuntu-drivers-common/quirks/put_your_quirks_here
Loading new nvidia-396-396.51 DKMS files...
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
Building only for 4.4.0-128-generic
Building for architecture x86_64
Building initial module for 4.4.0-128-generic
Done.

nvidia_396:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.4.0-128-generic/updates/dkms/

nvidia_396_modeset.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.4.0-128-generic/updates/dkms/

nvidia_396_drm.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.4.0-128-generic/updates/dkms/

nvidia_396_uvm.ko:
Running module version sanity check.
 - Original module
   - No original module exists within this kernel
 - Installation
   - Installing to /lib/modules/4.4.0-128-generic/updates/dkms/

depmod....

DKMS: install completed.
Setting up nvidia-opencl-icd-396 (396.51-0ubuntu0~gpu16.04.1) ...
Processing triggers for libc-bin (2.23-0ubuntu10) ...
Processing triggers for initramfs-tools (0.122ubuntu8.11) ...
update-initramfs: Generating /boot/initrd.img-4.4.0-128-generic
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied
W: mdadm: /etc/mdadm/mdadm.conf defines no arrays.
dpkg: warning: failed to open configuration file '/nfs/site/home/chrissul/.dpkg.cfg' for reading: Permission denied

chrissul@nervana-titanxp22 /localdisk/sullivan/projects $ nvidia-smi
Failed to initialize NVML: Driver/library version mismatch