| # WARNING: These steps seem to not work anymore! | |
| #!/bin/bash | |
| # Purge existign CUDA first | |
| sudo apt --purge remove "cublas*" "cuda*" | |
| sudo apt --purge remove "nvidia*" | |
| # Install CUDA Toolkit 10 | |
| wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-repo-ubuntu1804_10.0.130-1_amd64.deb |
| # tested on AWS p2.xlarge August 29, 2018 | |
| # install CUDA | |
| sudo apt-get update && sudo apt-get install wget -y --no-install-recommends | |
| CUDA_URL="https://developer.nvidia.com/compute/cuda/9.2/Prod2/local_installers/cuda-repo-ubuntu1604-9-2-local_9.2.148-1_amd64" | |
| wget -c ${CUDA_URL} -O cuda.deb | |
| sudo dpkg --install cuda.deb | |
| sudo apt-key add /var/cuda-repo-9-2-local/7fa2af80.pub | |
| sudo apt-get update | |
| sudo apt-get install -y cuda |
| #!/bin/bash | |
| # A bash script to update a Cloudflare DNS A record with the external IP of the source machine | |
| # Used to provide DDNS service for my home | |
| # Needs the DNS record pre-creating on Cloudflare | |
| # Proxy - uncomment and provide details if using a proxy | |
| #export https_proxy=http://<proxyuser>:<proxypassword>@<proxyip>:<proxyport> | |
| # Cloudflare zone is the zone which holds the record |
| # Make sure you grab the latest version | |
| curl -OL https://github.com/google/protobuf/releases/download/v3.2.0/protoc-3.2.0-linux-x86_64.zip | |
| # Unzip | |
| unzip protoc-3.2.0-linux-x86_64.zip -d protoc3 | |
| # Move protoc to /usr/local/bin/ | |
| sudo mv protoc3/bin/* /usr/local/bin/ | |
| # Move protoc3/include to /usr/local/include/ |
##VGG16 model for Keras
This is the Keras model of the 16-layer network used by the VGG team in the ILSVRC-2014 competition.
It has been obtained by directly converting the Caffe model provived by the authors.
Details about the network architecture can be found in the following arXiv paper:
Very Deep Convolutional Networks for Large-Scale Image Recognition
K. Simonyan, A. Zisserman
| #!/public/spark-0.9.1/bin/pyspark | |
| import os | |
| import sys | |
| # Set the path for spark installation | |
| # this is the path where you have built spark using sbt/sbt assembly | |
| os.environ['SPARK_HOME'] = "/public/spark-0.9.1" | |
| # os.environ['SPARK_HOME'] = "/home/jie/d2/spark-0.9.1" | |
| # Append to PYTHONPATH so that pyspark could be found |
For this configuration you can use web server you like, i decided, because i work mostly with it to use nginx.
Generally, properly configured nginx can handle up to 400K to 500K requests per second (clustered), most what i saw is 50K to 80K (non-clustered) requests per second and 30% CPU load, course, this was 2 x Intel Xeon with HyperThreading enabled, but it can work without problem on slower machines.
You must understand that this config is used in testing environment and not in production so you will need to find a way to implement most of those features best possible for your servers.
| # This file is part of VISVIS. This file may be distributed | |
| # seperately, but under the same license as VISVIS (LGPL). | |
| # | |
| # images2gif is free software: you can redistribute it and/or modify | |
| # it under the terms of the GNU Lesser General Public License as | |
| # published by the Free Software Foundation, either version 3 of | |
| # the License, or (at your option) any later version. | |
| # | |
| # images2gif is distributed in the hope that it will be useful, | |
| # but WITHOUT ANY WARRANTY; without even the implied warranty of |
| ## | |
| # A non-root installation of the latest Ruby with chruby | |
| # Install chruby (https://github.com/postmodern/chruby#readme) | |
| mkdir -p $HOME/src | |
| cd $HOME/src | |
| wget -O chruby-0.3.9.tar.gz https://github.com/postmodern/chruby/archive/v0.3.9.tar.gz | |
| tar -xzvf chruby-0.3.9.tar.gz | |
| cd chruby-0.3.9/ | |
| PREFIX=$HOME/.chruby make install |