Skip to content

Instantly share code, notes, and snippets.

@bigsnarfdude

bigsnarfdude/gist:2b05be835f983fc46c643ea4d80ea634

Last active August 4, 2026 19:36
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save bigsnarfdude/2b05be835f983fc46c643ea4d80ea634 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save bigsnarfdude/2b05be835f983fc46c643ea4d80ea634 to your computer and use it in GitHub Desktop.
Download ZIP
Getting Unsloth DeepSeek-V4-Flash-0731 GGUF running losslessly on a single rented A100 and 2xH100
Raw
gistfile1.md

162 billion parameters (8 bit quant) on one 40 GB card and tested on 2xH100 (2x80gb cards)

@bigsnarfdude

bigsnarfdude commented Aug 4, 2026

Copy link
Copy Markdown
Author 

  ┌───────────────────────────────────────────────────────────┬──────────────────────────────────────┐
  │                         Decision                          │              Difficulty              │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ rails 6.1.7.10 → 7.0.10 → 7.1.6, stepwise                 │ easy                     │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ ruby 2.7.8 → 3.2.8                                        │ easy                     │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ puma ~> 6.0 — Puma 5 refuses Rack 3                       │ moderate, well-known                 │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ concurrent-ruby unpinned — pin only needed below 7.1      │ moderate (the Gemfile comment hints) │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ deep_cloneable ~> 3.2 — 3.1 caps ActiveRecord < 7         │ hard, gemspec trivia                 │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ liquid 3 → 4 — liquid 3 taint-checks, dead on Ruby 3.2    │ hard, obscure                     │
  ├───────────────────────────────────────────────────────────┼──────────────────────────────────────┤
  │ tinymce-rails 5.10.2 → 5.10.9 — 5.10.2 calls File.exists? │ very hard, deeptrivia               │
  └───────────────────────────────────────────────────────────┴──────────────────────────────────────┘

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment