Skip to content

Instantly share code, notes, and snippets.

@mariocesar

mariocesar/README.md

Last active June 30, 2025 13:42
Show Gist options
  • Save mariocesar/8ff18a2580e44a9a04653611de587314 to your computer and use it in GitHub Desktop.
Save mariocesar/8ff18a2580e44a9a04653611de587314 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
README.md

Usage

export AWS_BUCKET_ARN=...
export WEBSITE_DOMAIN=tugerente.com
./sync-bank.sh

Make sure

Raw
sync-bank.sh
#!/usr/bin/env bash
set -eux -o pipefail
wget \
--mirror \
--page-requisites \
--adjust-extension \
--convert-links \
--span-hosts \
--domains=webflow.com,${WEBSITE_DOMAIN} \
--execute robots=off \
--no-parent \
--content-disposition \
--user-agent="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36" \
--wait=4 \
--random-wait \
--no-check-certificate \
-P ./site \
https://${DOMAIN}
test -d site
aws s3 sync ./site ${AWS_BUCKET_ARN} \
--delete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment