% Title % Name % Date
List
Erick Matsen matsen
airalcorn2
/ hook_transformer_attn.py
Last active
April 15, 2025 13:21
A simple script for extracting the attention weights from a PyTorch Transformer.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Inspired by: https://towardsdatascience.com/the-one-pytorch-trick-which-you-should-know-2d5e9c1da2ca. | |
| # Monkey patching idea suggested by @kklemon here: | |
| # https://gist.github.com/airalcorn2/50ec06517ce96ecc143503e21fa6cb91?permalink_comment_id=4407423#gistcomment-4407423. | |
| import torch | |
| from torch import nn | |
| def patch_attention(m): |
ilblackdragon
/ seq2seq.py
Last active
May 22, 2022 21:42
Example of Seq2Seq with Attention using all the latest APIs
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import logging | |
| import numpy as np | |
| import tensorflow as tf | |
| from tensorflow.contrib import layers | |
| GO_TOKEN = 0 | |
| END_TOKEN = 1 | |
| UNK_TOKEN = 2 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| openssl rsa -in ~/.ssh/id_rsa -outform pem > id_rsa.pem | |
| chmod 600 id_rsa.pem |
aaronwolen
/ slides.md
Last active
November 11, 2022 23:57
Pandoc template to generate reveal.js slideshows.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env -S uv run --script --quiet | |
| # /// script | |
| # requires-python = ">=3.13" | |
| # dependencies = [] | |
| # /// | |
| """A simple python script template. | |
| """ |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #~/.mutt/aliases | |
| alias nick Nicholas Levandoski <[email protected]> | |
| alias tim Timothy Pitt <[email protected]> | |
| alias steven Steven Jackson <[email protected]> | |
| alias kaleb Kaleb Hornsby <[email protected]> | |
| alias alug-admin nick, tim, steven |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # ~/.tmux.conf | |
| # | |
| # See the following files: | |
| # | |
| # /opt/local/share/doc/tmux/t-williams.conf | |
| # /opt/local/share/doc/tmux/screen-keys.conf | |
| # /opt/local/share/doc/tmux/vim-keys.conf | |
| # | |
| # URLs to read: | |
| # |