Skip to content

Instantly share code, notes, and snippets.

@priyathamkat
priyathamkat / mp_infer.py
Last active February 13, 2025 10:10
Multi GPU inference using `torch.multiprocessing`
import torch
import torch.multiprocessing as mp
from absl import app, flags
from torchvision.models import AlexNet
FLAGS = flags.FLAGS
flags.DEFINE_integer("num_processes", 2, "Number of subprocesses to use")