Skip to content

Instantly share code, notes, and snippets.

View andrei-pokrovsky's full-sized avatar

Andrei Pokrovsky andrei-pokrovsky

15 followers · 30 following
View GitHub Profile
@andrei-pokrovsky
andrei-pokrovsky / commands.md
Created August 16, 2022 14:35 — forked from mcarilli/commands.md
Single- and multiprocess profiling workflow with nvprof and NVVP (Nsight Systems coming soon...)

Ordinary launch commands (no profiling):

Single-process:

python main_amp.py -a resnet50 --b 224 --deterministic --workers 4 --opt-level O1 ./bare_metal_train_val/

Multi-process:

python -m torch.distributed.launch  --nproc_per_node=2 main_amp.py -a resnet50 --b 224 --deterministic --workers 4 --opt-level O1 ./bare_metal_train_val/