First restart the ssh agent killall ssh-agent; eval `ssh-agent` You should see something along the lines of: Agent pid 59566 Now just add your "new" user .ssh key ssh-add ~/.ssh/id_rsa