WebFaction is a great hosting service for everyone, it's as easy as shared hosting, and as powerful as VPS. SSH is allowed, and built in git, so you can install anything you want.
WebFaction uses CentOS 64bit, here is the installation guide with PHP 5.5