Erick Matsen matsen

airalcorn2 / hook_transformer_attn.py

Last active July 15, 2024 19:38

A simple script for extracting the attention weights from a PyTorch Transformer.

	# Inspired by: https://towardsdatascience.com/the-one-pytorch-trick-which-you-should-know-2d5e9c1da2ca.
	# Monkey patching idea suggested by @kklemon here:
	# https://gist.github.com/airalcorn2/50ec06517ce96ecc143503e21fa6cb91?permalink_comment_id=4407423#gistcomment-4407423.

	import torch

	from torch import nn


	def patch_attention(m):

ilblackdragon / seq2seq.py

Last active May 22, 2022 21:42

Example of Seq2Seq with Attention using all the latest APIs

	import logging

	import numpy as np
	import tensorflow as tf
	from tensorflow.contrib import layers


	GO_TOKEN = 0
	END_TOKEN = 1
	UNK_TOKEN = 2

mingfang / convert id_rsa to pem

Last active October 2, 2024 14:21

Convert id_rsa to pem file

	openssl rsa -in ~/.ssh/id_rsa -outform pem > id_rsa.pem
	chmod 600 id_rsa.pem

aaronwolen / slides.md

Last active November 11, 2022 23:57

Pandoc template to generate reveal.js slideshows.

% Title % Name % Date

My first slide

List

nhoffman / pyscript.py

Last active May 8, 2024 14:26

Python script template

	#!/usr/bin/env python3

	"""A simple python script template.

	"""

	import os
	import sys
	import argparse

kaleb / aliases

Created October 15, 2011 15:51

Gmail on Mutt

	#~/.mutt/aliases
	alias nick Nicholas Levandoski <[email protected]>
	alias tim Timothy Pitt <[email protected]>
	alias steven Steven Jackson <[email protected]>
	alias kaleb Kaleb Hornsby <[email protected]>
	alias alug-admin nick, tim, steven

shinzui / tmux.conf

Created March 12, 2011 01:08 — forked from bryanl/tmux.conf

tmux.conf

	# ~/.tmux.conf
	#
	# See the following files:
	#
	# /opt/local/share/doc/tmux/t-williams.conf
	# /opt/local/share/doc/tmux/screen-keys.conf
	# /opt/local/share/doc/tmux/vim-keys.conf
	#
	# URLs to read:
	#