nvidia-smi (NVIDIA System Management Interface) is a command-line tool that provides monitoring, management, and diagnostic information for NVIDIA GPU devices.
It communicates directly with the NVIDIA driver and GPU, and can:
- Monitor GPU performance, temperature, and utilization
- Manage power, clock speeds, and ECC
- Control persistence mode and compute modes