AWS S3 Bucket - List records by date

aws-s3-bucket-ls-date.md

AWS S3 Bucket - List files by date

With s3 ls

ls-s3.sh:

#!/bin/bash
DATE=$1 || $(date +%Y-%m-%d)
echo "List records for date $DATE"
aws s3 ls s3://bucket-name/directory/ | grep ${DATE}

Usage

• ./ls-s3.sh - Defaults to todays date ./ls-s3.sh 2019-07-15 - Argument date

With s3api --query

All records for a specific date

aws s3api list-objects-v2 --bucket "bucket-name" --prefix "record-prefix" --query "Contents[?contains(LastModified, '2019-07-15')].{key: Key, date: LastModified}"

All records on and after a specific date

aws s3api list-objects-v2 --bucket "bucket-name" --prefix "record-prefix" --query "Contents[?LastModified>='2019-07-15'].{key: Key, date: LastModified}"

it helped.

will this query will also works when you have large numbers of objects( crossing the limit where s3 will stop sorting in s3 bucket in GUI mode) ?

@pandeyvinod Yes it will work for large number of objects.