This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ls -lt |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
git clone --recursive https://github.com/dmlc/mxnet | |
cd mxnet; cp make/config.mk . | |
echo "USE_CUDA=1" >>config.mk | |
echo "USE_CUDA_PATH=/usr/local/cuda" >>config.mk | |
echo "USE_CUDNN=1" >>config.mk | |
echo "USE_BLAS=atlas" >> config.mk | |
echo "USE_DIST_KVSTORE = 1" >>config.mk | |
echo "USE_S3=1" >>config.mk |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
aws ec2 cancel-spot-instance-requests --spot-instance-request-ids sir-02g004p9 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
aws ec2 cancel-spot-fleet-requests --spot-fleet-request-ids sir-02g004p9 --terminate-instances | at now + 2hours |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Note – this is not a bash script (some of the steps require reboot) | |
# I named it .sh just so Github does correct syntax highlighting. | |
# | |
# This is also available as an AMI in us-east-1 (virginia): ami-cf5028a5 | |
# | |
# The CUDA part is mostly based on this excellent blog post: | |
# http://tleyden.github.io/blog/2014/10/25/cuda-6-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/ | |
# Install various packages | |
sudo apt-get update |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
export CUDA_HOME=/usr/local/cuda-7.0 | |
export LD_LIBRARY_PATH=${CUDA_HOME}/lib64 | |
PATH=${CUDA_HOME}/bin:${PATH} | |
export PATH |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sudo mkfs.ext4 /dev/xvdb | |
sudo mkdir -m 000 /mnt # isnt required if /mnt exists. | |
echo "/dev/xvdb /mnt auto noatime 0 0" | sudo tee -a /etc/fstab | |
sudo mount /mnt |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
f = lambda x: x.max() - x.min() | |
frame.apply(f) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
aws s3 ls --summarize --human-readable --recursive s3://kagglept |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sudo ldconfig /usr/local/cuda/lib64 |