Vagrant - Docker - Shipyard experiments

gistfile1.txt

# Vagrant, Docker and Shipyard

## Goals

Goals of this howto are getting docker setup, with shipyard managing it, all running on a local vagrant instance.

## Install Virtualbox

https://www.virtualbox.org/wiki/Downloads

## Install Virtualbox Extentions/Guest package

http://download.virtualbox.org/virtualbox/4.3.12/Oracle_VM_VirtualBox_Extension_Pack-4.3.12-93733.vbox-extpack

## Install Vagrant

http://www.vagrantup.com/downloads.html

## Vagrant create box

*Create base directory*

    mkdir ubuntu1404; cd ubuntu1404

*Create Vagrantfile*

VAGRANTFILE_API_VERSION = "2"
Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
  config.vm.box = "ubuntu1404"
  config.vm.box_url = "https://cloud-images.ubuntu.com/vagrant/trusty/current/trusty-server-cloudimg-amd64-vagrant-disk1.box"
  config.vm.network "forwarded_port", guest: 80, host: 8080
  config.vm.network "private_network", ip: "192.168.50.4", :bridge => 'en1: Wi-Fi (AirPort)'
  config.vm.provider :virtualbox do |vb|
        vb.customize ["modifyvm", :id, "--memory", "2048", "--cpus", "2"]
        vb.gui = false
  end
end

*Create Vagrant instance*

    vagrant up

*Login to Vagrant instance*
    
    vagrant ssh
    
## Inside Vagrant/Ubuntu 14.04

    sudo su -
    
### update

    apt-get update; apt-get upgrade -yy; apt-get dist-upgrade -yy; 

### install Docker

    apt-get install docker.io -yy

### Configure shipyard

*Modify /etc/default/docker.io by echoing in this line*
    
    echo "DOCKER_OPTS="-H tcp://127.0.0.1:4243 -H unix:///var/run/docker.sock"" >> /etc/default/docker.io

*Restart docker to pickup config changes*

     service docker.io restart\

*Set docker to start on boot*

    update-rc.d docker.io defaults

*To work inside of the corp network, follow the docs here http://ec-gitlab-t/DDCLEI/docs/blob/master/docker/shipyard_setup.md
*Now use docker to deploy a local Shipyard stack

    docker.io run -i -t -v /var/run/docker.sock:/docker.sock shipyard/deploy setup

*Next...*

## Other hints

Through testing I've built up quite a bit of cruft from docker fs downloads, clean them out with commands like this

    docker rmi `docker ps --no-trunc -a -q`
    docker rmi $(docker images -q)

If container isn't running, may need to run this 1st

    sudo docker ps -a | grep Exit | awk '{print $1}' | sudo xargs docker rm

Example of errors when containers/images are out of whack...


Usage: docker rmi IMAGE [IMAGE...]

Remove one or more images

  -f, --force=false: Force
➜  vagrant  docker rmi `docker ps --no-trunc -a -q`
Error: No such image: 27ab4c82b5bcd16872dfdd3fbc4cb7125dd57efa77d01b6780862b37211e7f04
Error: No such image: e26a3a536ade0c8b9f20763c9c1c06aaa021eba85da93ea27324282cee93ef8d
Error: No such image: 4c1c3d8a6830cf785d374017fc7154ed6e996c8354b6aff3dda29d8e8e6fe290
Error: No such image: d2053270a26674e626a6287b1057b261bced6c439da632070a75594c73d1db44
2014/06/10 09:45:54 Error: failed to remove one or more images
➜  vagrant  
➜  vagrant  docker ps
CONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS               NAMES
➜  vagrant  docker ps --no-trunc
CONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS               NAMES
➜  vagrant  docker ps --no-trunc -a -q
27ab4c82b5bcd16872dfdd3fbc4cb7125dd57efa77d01b6780862b37211e7f04
e26a3a536ade0c8b9f20763c9c1c06aaa021eba85da93ea27324282cee93ef8d
4c1c3d8a6830cf785d374017fc7154ed6e996c8354b6aff3dda29d8e8e6fe290
d2053270a26674e626a6287b1057b261bced6c439da632070a75594c73d1db44
➜  vagrant    docker rmi $(docker images -q)
Error: Conflict, cannot delete ad892dd21d60 because the container 4c1c3d8a6830 is using it
Error: Conflict, cannot delete bc62aa0fb727 because the container e26a3a536ade is using it
Untagged: shipyard/agent:0.3.1
Untagged: shipyard/agent:latest
Deleted: 468111bb2c656efbc7fd0666334b1cd6e750d207f155da932c045b9969ce299a
Deleted: 547d5d56c3ef5e6c244bc77c711fdb6bc2f7a0e3d5da3a9451e6dd8f11a6c1b5
Deleted: 3dd48f841db3ac9241bfe2d153dd610162274dc8d54e95b66fe50ce2a77ff484
Deleted: bd781ffdb0619dfa6971805fffc7ffdcbb007d47aa6ad8af84fae3764d6625ed
Error: No such image: 468111bb2c65
Untagged: shipyard/agent:0.3.0
Deleted: fc0e9956e61b0ed76356b7e4327e4f016c2062cb4b9a31e93a48ea04efe1ded5
Deleted: 97cc4aaf8cfdb36f0f7bc4de470e10f9012d490177a165b7a7eb2cfb6664b06d
Deleted: 77a891cd22f0c1d0ab50801d7e555598479f5c4735304a10346256941c9cf331
Deleted: a0f506aa046e1b2201d7deaa0da73fdf4e56ad18cb878a75cd08b0a30bd5bbe8
Deleted: 9bb2137709ea3e28405d4c20296498dc8d1e9992ececd659167e58b70d17940b
Deleted: a5ecfcb0c3abb543377b60bc808bbaacbbc775ad45312e4d8233c27cc4d1242c
Untagged: shipyard/db:latest
Deleted: 626eb587cec1e260825fa4ead65a7ccbbcd9d2ffd41c2b0efcdc8589f8907e5a
Deleted: 308a7d86416bd49b0b9bd9e665d3fd8ef2f6980485c424c7426f3e44a844276b
Deleted: bf3a7ac8465af31521813a8eacba4a3fe35374c5bc166236d6334be559a5d4bc
Deleted: 2c5c7914e64aba017697848d102a64b360f4da6376b66c375c0d5aea38004d2d
Deleted: 08727a4a04b19b8d5bed153d2a01746f4355caa69258762809aeeb112efc3258
Deleted: 45595970b329ea0ba93c90b2def899047ff1e271bbf0d02efac85452f3cc6e46
Deleted: 7d0cb1c16e4496ee36ab6c9aec33c6472152954cae2bf37c07268777089ef779
Deleted: 1c3a839723df69be0cc9f0cdc252083a8ed95a2e7151c9ef040ce05d4845e7f2
Deleted: f3057fb2fcc903193bf972e1b04791246841e9f2a7a46f060c83409cb6753ebf
Deleted: 35cd8364220617418c276e313daaf5b96e0c26a01b9f1fd42006cc0a0b6eb417
Deleted: ad836046302b2636d6ade1b85325834355fecc899a6c157a7d003f327bb774fb
Deleted: 19292ddcb8b3437b9201f4f0268797379087369e055ae47cdc735b029d7ce8ff
Deleted: 3933d6efb2a69af370f0fea8a179fdeac4b9e647b21b375f22f602e5201137fa
Deleted: 3460b1ba3f7d0768294c12d3029083cf3f2563f60bb07ff15a4ef3c8286cc8be
Deleted: 3aa646e4f1d2bd718c20174a38a87ac33a223ccd70fde655185197541ab6fcab
Deleted: b74728ce6435943c0ace1a90649f136c904b1c412f556a95bb1b812457aabd76
Error: Conflict, cannot delete b48b681ac984 because the container 27ab4c82b5bc is using it
2014/06/10 09:46:28 Error: failed to remove one or more images


➜  vagrant  docker rmi `docker ps --no-trunc -a -q`
Error: No such image: 27ab4c82b5bcd16872dfdd3fbc4cb7125dd57efa77d01b6780862b37211e7f04
Error: No such image: e26a3a536ade0c8b9f20763c9c1c06aaa021eba85da93ea27324282cee93ef8d
Error: No such image: 4c1c3d8a6830cf785d374017fc7154ed6e996c8354b6aff3dda29d8e8e6fe290
Error: No such image: d2053270a26674e626a6287b1057b261bced6c439da632070a75594c73d1db44
2014/06/10 09:47:27 Error: failed to remove one or more images
➜  vagrant  sudo su -
root@stlwxabprd003l:~#  docker rmi `docker ps --no-trunc -a -q`
Error: No such image: 27ab4c82b5bcd16872dfdd3fbc4cb7125dd57efa77d01b6780862b37211e7f04
Error: No such image: e26a3a536ade0c8b9f20763c9c1c06aaa021eba85da93ea27324282cee93ef8d
Error: No such image: 4c1c3d8a6830cf785d374017fc7154ed6e996c8354b6aff3dda29d8e8e6fe290
Error: No such image: d2053270a26674e626a6287b1057b261bced6c439da632070a75594c73d1db44
2014/06/10 09:47:34 Error: failed to remove one or more images
root@stlwxabprd003l:~#   docker rmi $(docker images -q)