Created
November 4, 2020 19:23
-
-
Save JustinTimperio/ae695eef5fda1f1590a685a017bbb5ec to your computer and use it in GitHub Desktop.
Download a File to Minio with Curl and Zero External Libraries or Programs
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env sh | |
# Example: ./download_minio.sh example.url.com username password bucket-name minio/path/to/file.txt.zst /download/path/to/file.txt.zst | |
if [ -z $1 ]; then | |
echo "You have NOT specified a MINIO URL!" | |
exit 1 | |
fi | |
if [ -z $2 ]; then | |
echo "You have NOT specified a USERNAME!" | |
exit 1 | |
fi | |
if [ -z $3 ]; then | |
echo "You have NOT specified a PASSWORD!" | |
exit 1 | |
fi | |
if [ -z $4 ]; then | |
echo "You have NOT specified a BUCKET!" | |
exit 1 | |
fi | |
if [ -z $5 ]; then | |
echo "You have NOT specified a MINIO FILE PATH!" | |
exit 1 | |
fi | |
if [ -z $6 ]; then | |
echo "You have NOT specified a DOWNLOAD PATH!" | |
exit 1 | |
fi | |
# User Minio Vars | |
URL=$1 | |
USERNAME=$2 | |
PASSWORD=$3 | |
BUCKET=$4 | |
MINIO_PATH="/${BUCKET}/$5" | |
OUT_FILE=$6 | |
# Static Vars | |
DATE=$(date -R --utc) | |
CONTENT_TYPE='application/zstd' | |
SIG_STRING="GET\n\n${CONTENT_TYPE}\n${DATE}\n${MINIO_PATH}" | |
SIGNATURE=`echo -en ${SIG_STRING} | openssl sha1 -hmac ${PASSWORD} -binary | base64` | |
curl -o "${OUT_FILE}" \ | |
-H "Host: $URL" \ | |
-H "Date: ${DATE}" \ | |
-H "Content-Type: ${CONTENT_TYPE}" \ | |
-H "Authorization: AWS ${USERNAME}:${SIGNATURE}" \ | |
https://$URL${MINIO_PATH} |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I got the following error:
<Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your key and signing method.</Message><Key>
The problem was that my implementation of
echo
did not accept-en
as arguments and instead printed them. My solution was to use bash, whoseecho
-implementation supports-en
. To do this, just replacesh
in the first line withbash
. If you don't want/can't use bash, the better solution would be to switch fromecho
toprintf