RVM, which is a rather heavy-weight solution to gem conflicts, has been chafing on me so here's a tutorial on getting going with rbenv instead, which just manages Ruby and leaves gem version dependencies to Bundler.
NOTE: Just because I'm switching, doesn't mean rbenv is necessarily "better" than RVM. I'm often switching between technologies to try them out and I could end up hating rbenv in a month (though I don't anticipate it). RVM is still a fine piece of work and you'll get along with it just fine.
If you have RVM installed, you can delete it easily with:
rvm implode