Abhinav Moudgil amoudgl
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
amoudgl
/ output.log
Created
May 30, 2025 17:10
Sweeping over dataloader seed in modula hello GPT tutorial from 0 to 100
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Input shape: (12, 64) | |
| Target shape: (12, 64) | |
| First input sequence: [41 53 50 42 1 40 50 53 53 42] ... | |
| First target sequence: [53 50 42 1 40 50 53 53 42 1] ... | |
| Decoded input: cold blood no spark of honour bides. | |
| NORTHUMBERLAND: | |
| Be thou a |
amoudgl
/ hello-gpt.py
Last active
May 30, 2025 18:38
modula GPT tutorial script with seed exposed as a command line argument
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Adapted from modula's Hello GPT tutorial: | |
| https://github.com/modula-systems/modula/blob/ede2ba72a1b9de3e1f44156db058b5c32c682941/examples/hello-gpt.ipynb | |
| This script simply exposes dataloader seed as command line argument to test | |
| training sensitivity to seed. | |
| Usage: | |
| python hello-gpt.py --seed 0 |
OlderNewer