How to connect an NVIDIA eGPU to OSX

nvidia_gpu_on_osx.md

Using an NVIDIA eGPU with OSX

Installation Instructions

Connecting the eGPU

Do not connect the eGPU to your Macbook until instructed.

1 . Update to macOS High Sierra, version 10.13.5 Do this by Apple > About This Mac > Software Update...

2. Connect only the eGPU to your Macbook (connect cable then switch on). Ensure no other devices are connected by thunderbolt 3. You should see the Akitio Node under Apple > (holding option) System Information... > Thunderbolt

3. Install the macOS-eGPU drivers. This is done by

   1. restart and hold command + R This boots into recovery mode
   2. open Utilities > Terminal
   3. enter csrutil disable; reboot
   4. after reboot, disconnect the eGPU
   5. open terminal and enter bash <(curl -s https://raw.githubusercontent.com/learex/macOS-eGPU/master/macOS-eGPU.sh) and follow instructions

4. when finished, reconnect the eGPU then restart

5. you should see two new icons at the top of your computer, once which mentions your GPU name when clicked.

6. check the GPU name (e.g. Quadro P6000) appears under Apple > (holding option) System Information... > Graphics/Displays

Say NO to any NVIDIA driver update window

7. Disable auto-NVIDIA updating, which will relentlessly break everything. Click the new NVIDIA icon in the toolbar > Open NVIDIA Driver Manager Preferences > Updates, then disable Automatically check for updates (may have to unlock via bottom left first).

Installing a CUDA compiler

If you want to write programs for the GPU (e.g. use QuEST) you'll need the NVIDIA compiler nvcc, which wraps around an existing compiler on your machine. Unfortunately nvcc doesn't support modern Clang (default compiler on OSX) nor GNU compilers (e.g. gcc 4.9 that non-GPU QuEST recommends)

We'll instead use Clang 3.7. Note Clang doesn't support OpenMP so you won't be able to simultaneously use CPU parallelism. This may mean you'll later need to remove #include <omp.h> from your library code.

If you don't have Homebrew, download it via

/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

Next, try

brew install llvm37

If that fails with an xcrun error, repeat after trying

sudo xcode-select --install

or search for alternate v3 versions with

brew search llvm

Check installation was successful by entering

clang++-3.7 --version

though this may require first adding clang-3.7 to your path. Instructions should be displayed in the brew output, and require closing and reopening a new Terminal after following.

We're now ready to install nvcc.

brew tap caskroom/drivers
brew cask install nvidia-cuda

This will open a dialogue window at some point during installation.

Check nvcc was installed successfully via

/usr/local/cuda/bin/nvcc --version

To make nvcc a recognised command, edit /etc/profile via

sudo nano /etc/profile

and add to the bottom:

# resolving nvcc to use GPU
export PATH=/Developer/NVIDIA/CUDA-9.0/bin${PATH:+:${PATH}}
export DYLD_LIBRARY_PATH=/Developer/NVIDIA/CUDA-9.0/lib\ {DYLD_LIBRARY_PATH:+:$$
export PATH=/usr/local/cuda/bin${PATH:+:${PATH}}
export PATH=/usr/local/bin:$PATH

Exit and save (ctrl-x then y then Enter), then run

source /etc/profile

Test nvcc is recognised

nvcc --version

Usage Instructions

Caution It is important to turn off your computer when connecting or disconnecting the eGPU. Otherwise, applications being rendered by the GPU may crash, including your OS.

Compiling GPU code

When compiling with nvcc, you'll need to tell it to wrap Clang 3.7 using the ccbin flag:

nvcc -ccbin clang++-3.7 ...

Hi there,

I'm certainly no expert, but maybe we can work it out. What version of MacOS are you running?
You should be aware that apple refused to validate NVIDIA drivers for Mojave and later (see here).

Hello, Thank you for your message. I’m on High Sierra 10.13.6 In terminal when I run purge-warnger it does say recognized for the card. As I mentioned it also shows up in the system profiler okay. However it does not seem to be being used at all as it is not showing up under “about this mac”. And it is clear the external monitor is still being powered by the internal card. When i restart with the card not plugged in and open the "Nvidia Cuda” app in system preferences it shows no eogpu. Then after I plug in the egpu this message goes away. There just seems to be no way to select the card to actually use it. Any suggestion would be helpful. Best, Dennis

…

On Oct 26, 2020, at 1:53 AM, Tyson Jones ***@***.***> wrote: @TysonRayJones commented on this gist. Hi there, I'm certainly no expert, but maybe we can work it out. What version of MacOS are you running? You should be aware that apple refused to validate NVIDIA drivers for Mojave and later (see here <https://appleinsider.com/articles/19/02/14/video-nvidia-support-was-abandoned-in-macos-mojave-and-heres-why>). — You are receiving this because you commented. Reply to this email directly, view it on GitHub <https://gist.github.com/29a1f3a4f773dbe3aaae36a65343830b#gistcomment-3503501>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ARQEU7VP5SEBLI7LINGGEDTSMRJZXANCNFSM4S6EXLUA>.

Hi Dennis,

Sounds like everything's actually set up fine. If you're using the eGPU as a GPGPU (like this guide is for), you can run nvidia-smi at the command line to check the GPU is targetable by nvcc.

If you're using the eGPU to render for an external monitor, then be sure to connect the GPU directly to your external monitor (with no connection to your computer), e.g. with a DP cable. It will then be impossible for your internal GPU to render for the external monitor. Note that I don't know whether it's possible for MacOS to continue rendering one monitor using the internal card, and an external monitor using the eGPU - it's certainly seems impossible on Windows (where the internal monitor must be disabled).

Hope this helps!

Hello Tyson, Thank you again for the response. I will try the “nvidia-smi” command and see what it generates. The eGpu is plugged into my external 5K display via a display port cable from the Aikido node. I then have an apple Thunderbolt 3 cable with an apple thunderbolt 2 adapter going into my MacBook. In the system preferences for Display it still shows the internal gpu under the both displays, (internal and external). This is what I can’t understand. It seems to be using the eGpu only as a hub but not the actual graphics card inside. Forgive me if this sounds stupid. Also the egpu is all lit up fine and fans are on slightly. Best, Dennis

…

On Oct 26, 2020, at 9:21 AM, Tyson Jones ***@***.***> wrote: @TysonRayJones commented on this gist. Hi Dennis, Sounds like everything's actually set up fine. If you're using the eGPU as a GPGPU (like this guide is for), you can run nvidia-smi at the command line to check the GPU is targetable by nvcc. If you're using the eGPU to render for an external monitor, then be sure to connect the GPU directly to your external monitor (with no connection to your computer), e.g. with a DP cable. It will then be impossible for your internal GPU to render for the external monitor. Note that I don't know whether it's possible for MacOS to continue rendering one monitor using the internal card, and an external monitor using the eGPU - it's certainly seems impossible on Windows (where the internal monitor must be disabled). Hope this helps! — You are receiving this because you commented. Reply to this email directly, view it on GitHub <https://gist.github.com/29a1f3a4f773dbe3aaae36a65343830b#gistcomment-3503802>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ARQEU7RCOEOFAEWO34WATQTSMS6HBANCNFSM4S6EXLUA>.

Hmm I'm afraid I can't be much more help - I've used the eGPU only as a display driver on Windows through bootcamp (disabling the Macbook display). On MacOS, I've used the eGPU strictly as a workstation for simulations. Good luck!