Credit/source: here
how to use unsloth grad checkpointing
To integrate the provided monkey patch for offloading gradient checkpointing into the Hugging Face transformers library, you need to follow these steps:
| { config, pkgs, ... }: | |
| { | |
| # Fingerprint | |
| services.fprintd = { | |
| enable = true; | |
| package = pkgs.fprintd-tod; | |
| tod.enable = true; | |
| tod.driver = pkgs.libfprint-2-tod1-goodix; | |
| }; |
Credit/source: here
how to use unsloth grad checkpointing
To integrate the provided monkey patch for offloading gradient checkpointing into the Hugging Face transformers library, you need to follow these steps: