Skip to content

Instantly share code, notes, and snippets.

@3outeille

3outeille/pipeline-model-parallel-visualization.ipynb

Forked from sighingnow/pipeline-model-parallel-visualization.ipynb
Created June 14, 2024 19:58
Show Gist options
  • Save 3outeille/a96118081ebb054a6288fd6f87879c74 to your computer and use it in GitHub Desktop.
Save 3outeille/a96118081ebb054a6288fd6f87879c74 to your computer and use it in GitHub Desktop.
Download ZIP
Visualizing various different pipeline model parallel scheduling algorithms: GPipe, Pipedream(1F1B), Pipedream-2BW(async, no-flushes), and eager-1F1B
Display the source blob
Display the rendered blob
Raw
pipeline-model-parallel-visualization.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment