-
-
Save njvitto/362873 to your computer and use it in GitHub Desktop.
#Deploy and rollback on Heroku in staging and production | |
task :deploy_staging => ['deploy:set_staging_app', 'deploy:push', 'deploy:restart', 'deploy:tag'] | |
task :deploy_production => ['deploy:set_production_app', 'deploy:push', 'deploy:restart', 'deploy:tag'] | |
namespace :deploy do | |
PRODUCTION_APP = 'YOUR_PRODUCTION_APP_NAME_ON_HEROKU' | |
STAGING_APP = 'YOUR_STAGING_APP_NAME_ON_HEROKU' | |
task :staging_migrations => [:set_staging_app, :push, :off, :migrate, :restart, :on, :tag] | |
task :staging_rollback => [:set_staging_app, :off, :push_previous, :restart, :on] | |
task :production_migrations => [:set_production_app, :push, :off, :migrate, :restart, :on, :tag] | |
task :production_rollback => [:set_production_app, :off, :push_previous, :restart, :on] | |
task :set_staging_app do | |
APP = STAGING_APP | |
end | |
task :set_production_app do | |
APP = PRODUCTION_APP | |
end | |
task :push do | |
puts 'Deploying site to Heroku ...' | |
puts `git push -f [email protected]:#{APP}.git` | |
end | |
task :restart do | |
puts 'Restarting app servers ...' | |
puts `heroku restart --app #{APP}` | |
end | |
task :tag do | |
release_name = "#{APP}_release-#{Time.now.utc.strftime("%Y%m%d%H%M%S")}" | |
puts "Tagging release as '#{release_name}'" | |
puts `git tag -a #{release_name} -m 'Tagged release'` | |
puts `git push --tags [email protected]:#{APP}.git` | |
end | |
task :migrate do | |
puts 'Running database migrations ...' | |
puts `heroku rake db:migrate --app #{APP}` | |
end | |
task :off do | |
puts 'Putting the app into maintenance mode ...' | |
puts `heroku maintenance:on --app #{APP}` | |
end | |
task :on do | |
puts 'Taking the app out of maintenance mode ...' | |
puts `heroku maintenance:off --app #{APP}` | |
end | |
task :push_previous do | |
prefix = "#{APP}_release-" | |
releases = `git tag`.split("\n").select { |t| t[0..prefix.length-1] == prefix }.sort | |
current_release = releases.last | |
previous_release = releases[-2] if releases.length >= 2 | |
if previous_release | |
puts "Rolling back to '#{previous_release}' ..." | |
puts "Checking out '#{previous_release}' in a new branch on local git repo ..." | |
puts `git checkout #{previous_release}` | |
puts `git checkout -b #{previous_release}` | |
puts "Removing tagged version '#{previous_release}' (now transformed in branch) ..." | |
puts `git tag -d #{previous_release}` | |
puts `git push [email protected]:#{APP}.git :refs/tags/#{previous_release}` | |
puts "Pushing '#{previous_release}' to Heroku master ..." | |
puts `git push [email protected]:#{APP}.git +#{previous_release}:master --force` | |
puts "Deleting rollbacked release '#{current_release}' ..." | |
puts `git tag -d #{current_release}` | |
puts `git push [email protected]:#{APP}.git :refs/tags/#{current_release}` | |
puts "Retagging release '#{previous_release}' in case to repeat this process (other rollbacks)..." | |
puts `git tag -a #{previous_release} -m 'Tagged release'` | |
puts `git push --tags [email protected]:#{APP}.git` | |
puts "Turning local repo checked out on master ..." | |
puts `git checkout master` | |
puts 'All done!' | |
else | |
puts "No release tags found - can't roll back!" | |
puts releases | |
end | |
end | |
end |
The problem is that you can have a lag beetwen the time of code pushed/server restarted and the migration executed (so for some seconds there can be some users navigating parts of your app with the new code that requires new data structure giving 500 errors).
Got, and used. Great stuff.
Shouldn't you turn off the app before the push, since the push will have code that requires the new schema?
Thanks for sharing, I looked at the heroku_san gem and release management add-on but this seems to be the most elegant solution.
Do you use the task :deploy_staging or deploy:staging_migrations ?
Yes it's safer and faster to generally use the :deploy_staging task if you haven't new migrations or if the code is backward compatible.
So use the deploy:staging_migrations only if you have new migrations to run.
Anyone is really welcome to upgrade the script :)
Anyway is not a problem to run deploy:staging_migrations at every deploy if you are afraid to forget the migrations...
Is there a reason you put the app into maintenance mode when pushing?
@jksilliman - i think you could test if the migrations have changed by doing
if `git diff origin/HEAD HEAD`.include?("/db/migrate/")
and then decide whether you wanted to put it into maintenance mode during the push.
Hi cj, no it isn't and you haven't (if you see the deploy_staging and deploy_production tasks, they are without migrations).
As for the process to deploy the code I think that the safest way is something like this:
- Commit/Push your safe code on git/Github DEVELOP (after merging from a specific branch, if needed) with only the migrations that will be subsequently useful
- Deploy (without migrations) on Heroku STAGING your safe code with only the migrations that will be subsequently useful. You can use this script on the root:
"rake deploy_staging"
-
Run heroku rake db:migrate on STAGING
-
Commit/Push your safe code on git/Github MASTER (after merging from DEVELOP branch) with only the migrations that will be subsequently useful
-
Deploy (without migrations) on Heroku PRODUCTION your safe code with only the migrations that will be subsequently useful. You can use this script on the root:
"rake deploy_production"
-
Run heroku rake db:migrate on PRODUCTION (WARNING: for critical migrations, such as ALTER TABLE, please consider to start an "Heroku Follower", as rollback in bad cases and to drop after the migration was run)
-
Back to the code: now is the moment to commit/push on git/Github DEVELOP the new code that uses the new migrations
-
Deploy (without migrations) on Heroku STAGING your safe code that uses the new migrations run in step 3
-
Commit/Push your safe code on git/Github MASTER (after merging from DEVELOP branch) the new code that uses the new migrations
-
Deploy (without migrations) on Heroku PRODUCTION your safe code that uses the new migrations run in step 6
Please note that this process is safe in every moment. For instance:
- There isn't any kind of downtime deploying code that must use new migrations (waiting for rake timing of running or that heroku restarts the servers)
- If another developer pushes new code all should be good
Hope this helps..
Bye,
Nicola.
For the Cedar stack, you need to modify the deploy:migrate task as follows:
task :migrate do
puts 'Running database migrations ...'
puts heroku run rake db:migrate --app #{APP}
end
Note the word run inserted between "heroku" and "rake".
Hey, thanks for the nice gist.
I stumbled upon a problem with new bundler 1.2.0.pre. (I'm using rbenv for ruby 1.9.3 installing). When I try the run heroku commands from within the rake task, I got an bundler error: our Ruby version is 1.9.2, but your Gemfile specified 1.9.3.
I know, that is not problem specific to this gist, but maybe you have an idea to solve this?
Best,
benni
Very convenient, thanks for sharing!
thank you :)
nice gist! there's a rollback feature in heroku (maybe this is new). heroku rollback --app app_name, so you don't actually need to tag the releases yourself now. heroku releases --app app_name
here are my mods if you're curious: https://gist.github.com/4410411
I try running heroku run rake deploy but i get an error on my app:
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/task_manager.rb:49:in []' /app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:142:in
invoke_task'
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:101:in block (2 levels) in top_level' /app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:101:in
each'
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:101:in block in top_level' /app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:110:in
run_with_threads'
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:95:in top_level' /app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:73:in
block in run'
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:160:in standard_exception_handling' /app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/lib/rake/application.rb:70:in
run'
/app/vendor/bundle/ruby/1.9.1/gems/rake-10.0.4/bin/rake:33:in <top (required)>' /app/vendor/bundle/ruby/1.9.1/bin/rake:19:in
load'
/app/vendor/bundle/ruby/1.9.1/bin/rake:19:in `
Would you know what should I do to fix this ?
Made a few abstractions, additions, protections https://gist.github.com/jphenow/5694169
Extracting the tasks into a class for easier extension:
https://gist.github.com/jfeaver/9820478
Thanks for the great foundation work @njvitto!
I added Rspec testing, improved Heroku toolbelt support, and post-deploy rake task running on my fork.
Great task! :)
A interesting thing happened the other day while I was using it to deploy code and run migrations.
Heroku Toolbelt detected that there is an update available and started updating itself in the middle of a running task. This resulted in maintenance mode being turned on, code being deployed and all other tasks cancelled because of the "update in progress" status. This left the environment down and its DB "unmigrated".
I recommend adding another task that is run first:
task :update_toolbelt do
puts 'Checking for Heroku Toolbelt updates ...'
puts `heroku update`
puts `heroku plugins:update`
end
And you probably want to run it first when deploying to production. For example:
task :deploy_production => ['deploy:update_toolbelt', 'deploy:set_production_app', 'deploy:push', 'deploy:restart', 'deploy:tag']
namespace :deploy do
...
task :production_migrations => [:update_toolbelt, :set_production_app, :push, :off, :migrate, :restart, :on, :tag]
Hope this helps!
EDIT: Added the plugin update check.
You don't need to restart manually after a push, nor do you need to turn on/off maintenance mode. Heroku will auto-restart your app servers upon deploy.