This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ls -lt |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| git clone --recursive https://github.com/dmlc/mxnet | |
| cd mxnet; cp make/config.mk . | |
| echo "USE_CUDA=1" >>config.mk | |
| echo "USE_CUDA_PATH=/usr/local/cuda" >>config.mk | |
| echo "USE_CUDNN=1" >>config.mk | |
| echo "USE_BLAS=atlas" >> config.mk | |
| echo "USE_DIST_KVSTORE = 1" >>config.mk | |
| echo "USE_S3=1" >>config.mk |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| aws ec2 cancel-spot-instance-requests --spot-instance-request-ids sir-02g004p9 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| aws ec2 cancel-spot-fleet-requests --spot-fleet-request-ids sir-02g004p9 --terminate-instances | at now + 2hours |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Note – this is not a bash script (some of the steps require reboot) | |
| # I named it .sh just so Github does correct syntax highlighting. | |
| # | |
| # This is also available as an AMI in us-east-1 (virginia): ami-cf5028a5 | |
| # | |
| # The CUDA part is mostly based on this excellent blog post: | |
| # http://tleyden.github.io/blog/2014/10/25/cuda-6-dot-5-on-aws-gpu-instance-running-ubuntu-14-dot-04/ | |
| # Install various packages | |
| sudo apt-get update |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| export CUDA_HOME=/usr/local/cuda-7.0 | |
| export LD_LIBRARY_PATH=${CUDA_HOME}/lib64 | |
| PATH=${CUDA_HOME}/bin:${PATH} | |
| export PATH |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo mkfs.ext4 /dev/xvdb | |
| sudo mkdir -m 000 /mnt # isnt required if /mnt exists. | |
| echo "/dev/xvdb /mnt auto noatime 0 0" | sudo tee -a /etc/fstab | |
| sudo mount /mnt |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| f = lambda x: x.max() - x.min() | |
| frame.apply(f) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| aws s3 ls --summarize --human-readable --recursive s3://kagglept |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sudo ldconfig /usr/local/cuda/lib64 |