Emaad Manzoor emaadmanzoor

Train nanochat on 2 NVIDIA DGX Sparks

Last updated: November 3, 2025

This guide is about training nanochat on 2 DGX Sparks linked via QSFP/CX7. I estimate the training to take about 5 days (about half the training time on 1 DGX Spark).

Prerequisites

Follow the following NVIDIA tutorials to link and test your Spark cluster:

	MATCH (source:Place {id: "Amsterdam"}), (destination:Place {id: "London"})
	CALL gds.shortestPath.dijkstra.stream({
	nodeProjection: 'Place',
	relationshipProjection: {
	ROAD: {
	type: 'EROAD',
	properties: 'distance',
	orientation: 'UNDIRECTED'
	}
	},