Marco Goldin marcogoldin
marcogoldin
/ fetchall_athena.py
Created
February 15, 2020 14:11
— forked from schledererj/fetchall_athena.py
Using boto3 and paginators to query an AWS Athena table and return the results as a list of tuples as specified by .fetchall in PEP 249
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Does NOT implement the PEP 249 spec, but the return type is suggested by the .fetchall function as specified here: https://www.python.org/dev/peps/pep-0249/#fetchall | |
| import time | |
| import boto3 | |
| # query_string: a SQL-like query that Athena will execute | |
| # client: an Athena client created with boto3 | |
| def fetchall_athena(query_string, client): | |
| query_id = client.start_query_execution( | |
| QueryString=query_string, |