Created
November 4, 2020 19:23
-
-
Save JustinTimperio/ae695eef5fda1f1590a685a017bbb5ec to your computer and use it in GitHub Desktop.
Download a File to Minio with Curl and Zero External Libraries or Programs
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env sh | |
# Example: ./download_minio.sh example.url.com username password bucket-name minio/path/to/file.txt.zst /download/path/to/file.txt.zst | |
if [ -z $1 ]; then | |
echo "You have NOT specified a MINIO URL!" | |
exit 1 | |
fi | |
if [ -z $2 ]; then | |
echo "You have NOT specified a USERNAME!" | |
exit 1 | |
fi | |
if [ -z $3 ]; then | |
echo "You have NOT specified a PASSWORD!" | |
exit 1 | |
fi | |
if [ -z $4 ]; then | |
echo "You have NOT specified a BUCKET!" | |
exit 1 | |
fi | |
if [ -z $5 ]; then | |
echo "You have NOT specified a MINIO FILE PATH!" | |
exit 1 | |
fi | |
if [ -z $6 ]; then | |
echo "You have NOT specified a DOWNLOAD PATH!" | |
exit 1 | |
fi | |
# User Minio Vars | |
URL=$1 | |
USERNAME=$2 | |
PASSWORD=$3 | |
BUCKET=$4 | |
MINIO_PATH="/${BUCKET}/$5" | |
OUT_FILE=$6 | |
# Static Vars | |
DATE=$(date -R --utc) | |
CONTENT_TYPE='application/zstd' | |
SIG_STRING="GET\n\n${CONTENT_TYPE}\n${DATE}\n${MINIO_PATH}" | |
SIGNATURE=`echo -en ${SIG_STRING} | openssl sha1 -hmac ${PASSWORD} -binary | base64` | |
curl -o "${OUT_FILE}" \ | |
-H "Host: $URL" \ | |
-H "Date: ${DATE}" \ | |
-H "Content-Type: ${CONTENT_TYPE}" \ | |
-H "Authorization: AWS ${USERNAME}:${SIGNATURE}" \ | |
https://$URL${MINIO_PATH} |
I got the following error:
<Error><Code>SignatureDoesNotMatch</Code><Message>The request signature we calculated does not match the signature you provided. Check your key and signing method.</Message><Key>
The problem was that my implementation of echo
did not accept -en
as arguments and instead printed them. My solution was to use bash, whose echo
-implementation supports -en
. To do this, just replace sh
in the first line with bash
. If you don't want/can't use bash, the better solution would be to switch from echo
to printf
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
for list buckets : https://stackoverflow.com/a/78060710/2294168