Skip to content

Instantly share code, notes, and snippets.

@vishcious
Created December 6, 2016 22:31
Show Gist options
  • Save vishcious/627e8755aff2b087c78049d80afbdd49 to your computer and use it in GitHub Desktop.
Save vishcious/627e8755aff2b087c78049d80afbdd49 to your computer and use it in GitHub Desktop.
Errors accessing S3 files with rasterio
>>> import rasterio
>>> src = rasterio.open("s3://utwrap-lambdastats/foa_UT.tif")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/osboxes/envs/rasterio/local/lib/python2.7/site-packages/rasterio/__init__.py", line 193, in open
s.start()
File "rasterio/_base.pyx", line 76, in rasterio._base.DatasetReader.start (rasterio/_base.c:2969)
rasterio.errors.RasterioIOError: '/vsis3/utwrap-lambdastats/foa_UT.tif' does not exist in the file system, and is not recognised as a supported dataset name.
AWS_ACCESS_KEY_ID=XXXXXXXXXXXXXX AWS_SECRET_ACCESS_KEY=XXXXXXXXXXXXXXXXX rio -vvv info s3://utwrap-lambdastats/foa_UT.tif
DEBUG:rasterio.env:Environment <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> exists
DEBUG:rasterio.env:Got a copy of environment <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> options
DEBUG:rasterio._drivers:Set option CPL_DEBUG=True in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio.env:Updated existing <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> with options {'CPL_DEBUG': True}
DEBUG:rasterio.env:Entering env <rasterio.env.Env object at 0x7f2cc426ec90> context
DEBUG:rasterio.env:Environment <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> exists
DEBUG:botocore.credentials:Looking for credentials via: env
INFO:botocore.credentials:Found credentials in environment variables.
DEBUG:rasterio.env:Environment <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> exists
DEBUG:rasterio._drivers:Set option aws_region=us-east-1 in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Set option aws_access_key_id=****** in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Set option aws_secret_access_key=****** in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio:AWS credentials have been obtained
ERROR:rasterio._gdal:CPLE_OpenFailed in `/vsis3/utwrap-lambdastats/foa_UT.tif' does not exist in the file system,
and is not recognised as a supported dataset name.
DEBUG:rasterio._drivers:Unset option CHECK_WITH_INVERT_PROJ in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Unset option aws_region in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Unset option CPL_DEBUG in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Unset option aws_secret_access_key in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio._drivers:Unset option aws_access_key_id in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio.env:Cleared existing <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> options
DEBUG:rasterio._drivers:Set option CHECK_WITH_INVERT_PROJ=True in env <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360>
DEBUG:rasterio.env:Updated existing <rasterio._drivers.GDALEnv object at 0x7f2cc9fe9360> with options {'CHECK_WITH_INVERT_PROJ': True}
DEBUG:rasterio.env:Exiting env <rasterio.env.Env object at 0x7f2cc426ec90> context
Aborted!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment