Skip to content

Instantly share code, notes, and snippets.

@dogterbox

dogterbox/cuda-memory-reserve.md

Last active July 19, 2023 07:16
Show Gist options
  • Save dogterbox/c106de5f91fb5549a4cec74b7a2c7789 to your computer and use it in GitHub Desktop.
Save dogterbox/c106de5f91fb5549a4cec74b7a2c7789 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
cuda-memory-reserve.md

on node

pip3 install cupy-cuda11x
python3
import cupy as cp
x = [cp.arange(100000000) for _ in range(1000)]

on pod

import torch
x = [torch.randn(1000, 1000, device='cuda') for _ in range(100000)]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment