Skip to content

Instantly share code, notes, and snippets.

@sneak

sneak/movedailies.sh

Created February 15, 2017 02:33
Show Gist options
  • Save sneak/00c4c758a8b953caf834042c81f9ff5f to your computer and use it in GitHub Desktop.
Save sneak/00c4c758a8b953caf834042c81f9ff5f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
movedailies.sh
#!/bin/bash
DESTPREFIX="papertrail/logs/12345"
BUCKET="org-global-papertrail-archive"
for FN in $(cat dailies.txt); do
ORIGPATH="old/$FN"
NEWDT=$(echo $FN | awk -F- '{print $1 "-" $2 "-" $3}')
NEWDT=$(echo $NEWDT | awk -F. '{print $1}')
NEWPATH="$DESTPREFIX/dt=$NEWDT/$FN"
echo aws s3 mv s3://$BUCKET/$ORIGPATH s3://$BUCKET/$NEWPATH
done
Raw
movehourlies.sh
#!/bin/bash
DESTPREFIX="papertrail/logs/12345"
BUCKET="org-global-papertrail-archive"
for FN in $(cat hourlies.txt); do
ORIGPATH="old/$FN"
NEWDT=$(echo $FN | awk -F- '{print $1 "-" $2 "-" $3}')
NEWPATH="$DESTPREFIX/dt=$NEWDT/$FN"
echo aws s3 mv s3://$BUCKET/$ORIGPATH s3://$BUCKET/$NEWPATH
done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment