-
-
Save kartik1225/cff1ba2c671cc1385dfd9f5297bf78c0 to your computer and use it in GitHub Desktop.
Automatically backup a MongoDB database to S3 using mongodump, tar, and awscli (Ubuntu 14.04 LTS)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/bin/sh | |
# Make sure to: | |
# 1) Name this file `backup.sh` and place it in /home/ubuntu | |
# 2) Run sudo apt-get install awscli to install the AWSCLI | |
# 3) Run aws configure (enter s3-authorized IAM user and specify region) | |
# 4) Fill in DB host + name | |
# 5) Create S3 bucket for the backups and fill it in below (set a lifecycle rule to expire files older than X days in the bucket) | |
# 6) Run chmod +x backup.sh | |
# 7) Test it out via ./backup.sh | |
# 8) Set up a daily backup at midnight via `crontab -e`: | |
# 0 0 * * * /home/ubuntu/backup.sh > /home/ubuntu/backup.log | |
# DB host (secondary preferred as to avoid impacting primary performance) | |
HOST=db.example.com | |
# DB name | |
DBNAME=my-db | |
# DB port | |
PORT=27017 | |
# S3 bucket name | |
BUCKET=s3-bucket-name | |
# Linux user account | |
USER=ubuntu | |
# Current time | |
TIME=`/bin/date +%d-%m-%Y-%T` | |
# Backup directory | |
DEST=/home/$USER/tmp | |
# Tar file of backup directory | |
TAR=$DEST/../$TIME.tar | |
# Create backup dir (-p to avoid warning if already exists) | |
/bin/mkdir -p $DEST | |
# Log | |
echo "Backing up $HOST/$DBNAME to s3://$BUCKET/ on $TIME at port $PORT"; | |
# Dump from mongodb host into backup directory | |
/usr/bin/mongodump -h $HOST -d $DBNAME -o $DEST --port $PORT | |
# Create tar of backup directory | |
/bin/tar cvf $TAR -C $DEST . | |
# Upload tar to s3 | |
/usr/bin/aws s3 cp $TAR s3://$BUCKET/ | |
# Remove tar file locally | |
/bin/rm -f $TAR | |
# Remove backup directory | |
/bin/rm -rf $DEST | |
# All done | |
echo "Backup available at https://s3.amazonaws.com/$BUCKET/$TIME.tar" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment