Other CI systems already have a good idea of how this should be done. Jenkins has excellent support for configuration changes and the Travis console output is pretty much incredible. Something that they both lack is performance. Taking more than quarter of a second to load a page is unacceptable an infuriating.
A good command line interface has been missing from all CI systems I've used. It