CI / CD benchmark

gistfile1.txt

August 2015

circleci
  * pros:
    - full docker support
    - fast UI and build
    - SSH mode to debug the build
  * cons:
    - no way to put secure ENV variable in the yml

quay.io
  * pros:
    - can build docker
    - nice and simple UI

hub.docker
  * pros:
    - official repository
    - can build docker
  * cons:
    - confusing UI/UX

shippable
  * pros:
    - docker support
    - good support
    - integration platform
    - can store secure ENV variable in the yml
  * cons:
    - confusing UI/UX
    - slow UI
    - slow build

wercker
  * pros:
    - fast UI
    - fast build
    - basic docker support (subset of functionalities)
    - really flexible
    - docker pull/push built in
    - can run locally
    - can run locally in developper / autoreload mode
  * cons:
    - deploy ENV var are in the UI instead of config file
    - beta
    - support can be slow

travis
  * pros:
    - current solution
    - most famous
    - can store secure ENV variable in the yml
  * cons:
    - no built in docker support (https://github.com/moul/travis-docker)

codeship
  * pros:
    - nice UI
    - easy to starts with
    - no yml, everything is in the UI
  * cons:
    - no docker support(?)