Skip to content

Instantly share code, notes, and snippets.

@sergiolucero
Created October 2, 2017 14:26
Show Gist options
  • Save sergiolucero/b1070a33db80e8050f7394cccd79a0e1 to your computer and use it in GitHub Desktop.
Save sergiolucero/b1070a33db80e8050f7394cccd79a0e1 to your computer and use it in GitHub Desktop.
Panda dreams
import pandas as pd
from pandasqlutils import * # to easily cross tables
bikes = pd.read_url('http://quant.cl/db/bikes') # serving from quant via sqlite
airquality = pd.read_url('s3://amazonxyz.aws.com/sdakjldajds') # using an S3 bucket
weather = pd.read_url('quant.cl/postgres/weather' # running on a docker (Rad?)
airvsclimate = cross(airquality, weather)
print(airvsclimate.head())
@sergiolucero
Copy link
Author

The work that needs to be done:

  1. create mypandas(pandas) class
  2. find a reliable weather source
  3. implement reading from s3 (using boto3: https://stackoverflow.com/questions/37703634/how-to-import-a-text-file-on-aws-s3-into-pandas-without-writing-to-disk)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment