Last active
October 11, 2023 14:27
-
-
Save gleicon/2b8acb9f9c0f22753eaac227ff997b34 to your computer and use it in GitHub Desktop.
How to use boto3 with google cloud storage and python to emulate s3 access.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from boto3.session import Session | |
from botocore.client import Config | |
from botocore.handlers import set_list_objects_encoding_type_url | |
import boto3 | |
ACCESS_KEY = "xx" | |
SECRET_KEY = "yy" | |
boto3.set_stream_logger('') | |
session = Session(aws_access_key_id=ACCESS_KEY, | |
aws_secret_access_key=SECRET_KEY, | |
region_name="US-CENTRAL1") | |
session.events.unregister('before-parameter-build.s3.ListObjects', | |
set_list_objects_encoding_type_url) | |
s3 = session.resource('s3', endpoint_url='https://storage.googleapis.com', | |
config=Config(signature_version='s3v4')) | |
bucket = s3.Bucket('yourbucket') | |
for f in bucket.objects.all(): | |
print(f.key) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Awesome, thanks for sharing !