Skip to content

Instantly share code, notes, and snippets.

@secemp9
Created January 7, 2024 09:09
Show Gist options
  • Save secemp9/c6d346d0575934060f44d75adb4327c4 to your computer and use it in GitHub Desktop.
Save secemp9/c6d346d0575934060f44d75adb4327c4 to your computer and use it in GitHub Desktop.
colab trick to empty gpu memory
# Run this block to make sure you have the full GPU memory.
# See https://medium.com/@oribarel/getting-the-most-out-of-your-google-colab-2b0585f82403.
# memory footprint support libraries/code
!ln -sf /opt/bin/nvidia-smi /usr/bin/nvidia-smi
!pip install gputil
!pip install psutil
!pip install humanize
import psutil
import humanize
import os
import GPUtil as GPU
GPUs = GPU.getGPUs()
# XXX: only one GPU on Colab and isn’t guaranteed
gpu = GPUs[0]
def printm():
process = psutil.Process(os.getpid())
print("Gen RAM Free: " + humanize.naturalsize( psutil.virtual_memory().available ), " | Proc size: " + humanize.naturalsize( process.memory_info().rss))
print("GPU RAM Free: {0:.0f}MB | Used: {1:.0f}MB | Util {2:3.0f}% | Total {3:.0f}MB".format(gpu.memoryFree, gpu.memoryUsed, gpu.memoryUtil*100, gpu.memoryTotal))
printm()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment