Skip to content

Instantly share code, notes, and snippets.

@mindyyy-hsu
Last active February 22, 2023 16:38
Show Gist options
  • Save mindyyy-hsu/7d19ecdecde8626eadaca785c9fb7c0a to your computer and use it in GitHub Desktop.
Save mindyyy-hsu/7d19ecdecde8626eadaca785c9fb7c0a to your computer and use it in GitHub Desktop.
AWS Simple-Storage-Service (S3) objects list and export to csv.
import boto3
import pandas
AWS_ACCESS_KEY_ID = 'YOUR_AWS_ACCESS_KEY_ID'
AWS_SECRET_ACCESS_KEY = 'YOUR_AWS_SECRET_ACCESS_KEY'
# connect to s3
s3 = boto3.client(
's3',
aws_access_key_id=AWS_ACCESS_KEY_ID,
aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
)
listOfObject = []
resp = s3.list_objects_v2(Bucket='your-bucket-name')
for obj in resp['Contents']:
# list key of object
listOfObject.append(obj['Key'])
print(obj['Key'])
print(listOfObject)
# list to DataFrame
listDataFrame = pandas.DataFrame(listOfObject)
# export to csv
listDataFrame.to_csv('list.csv')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment