Mehdi Cherti mehdidc

tmux cheatsheet

As configured in my dotfiles.

start new:

tmux

start new with session name:

A Tour of PyTorch Internals (Part I)

The fundamental unit in PyTorch is the Tensor. This post will serve as an overview for how we implement Tensors in PyTorch, such that the user can interact with it from the Python shell. In particular, we want to answer four main questions:

How does PyTorch extend the Python interpreter to define a Tensor type that can be manipulated from Python code?
How does PyTorch wrap the C libraries that actually define the Tensor's properties and methods?
How does PyTorch cwrap work to generate code for Tensor methods?
How does PyTorch's build system take all of these components to compile and generate a workable application?

Extending the Python Interpreter

PyTorch defines a new package torch. In this post we will consider the ._C module. This module is known as an "extension module" - a Python module written in C. Such modules allow us to define new built-in object types (e.g. the Tensor) and to call C/C++ functions.

	#!/bin/bash
	#
	# Download the Large-scale CelebFaces Attributes (CelebA) Dataset
	# from their Google Drive link.
	#
	# CelebA: http://mmlab.ie.cuhk.edu.hk/projects/CelebA.html
	#
	# Google Drive: https://drive.google.com/drive/folders/0B7EVK8r0v71pWEZsZE9oNnFzTm8

	python3 get_drive_file.py 0B7EVK8r0v71pZjFTYXZWM3FlRnM celebA.zip

	import keras
	import numpy as np

	timesteps = 60
	input_dim = 64
	samples = 10000
	batch_size = 128
	output_dim = 64

	# Test data.


	#Evolution Strategies with Keras
	#Based off of: https://blog.openai.com/evolution-strategies/
	#Implementation by: Nicholas Samoray

	#README
	#Meant to be run on a single machine
	#APPLY_BIAS is currently not working, keep to False
	#Solves Cartpole as-is in about 50 episodes
	#Solves BipedalWalker-v2 in about 1000

	"""
	Example TensorFlow script for finetuning a VGG model on your own data.
	Uses tf.contrib.data module which is in release v1.2
	Based on PyTorch example from Justin Johnson
	(https://gist.github.com/jcjohnson/6e41e8512c17eae5da50aebef3378a4c)

	Required packages: tensorflow (v1.2)
	Download the weights trained on ImageNet for VGG:
	```
	wget http://download.tensorflow.org/models/vgg_16_2016_08_28.tar.gz

	"""
	Simple policy gradient in Keras

	"""
	import gym
	import numpy as np

	from keras import layers
	from keras.models import Model
	from keras import backend as K

	# Author: Kyle Kastner
	# License: BSD 3-Clause
	# See core implementations here http://geekyisawesome.blogspot.ca/2016/10/using-beam-search-to-generate-most.html
	# Also includes a reduction of the post by Yoav Goldberg to a script
	# markov_lm.py
	# https://gist.github.com/yoavg/d76121dfde2618422139

	# These datasets can be a lot of fun...
	#
	# https://github.com/frnsys/texts