Bamboo (at least the instance I have to work with) is using a Java implementation of git (JGit) that has problems reading the new SSH key-file format.
In earlier versions, ssh-keygen generated private keys that looked like:
-----BEGIN RSA PRIVATE KEY-----
...
-----END RSA PRIVATE KEY-----