Skip to content

Instantly share code, notes, and snippets.

@springcoil

springcoil/ETL_python.md

Last active October 26, 2015 18:42
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save springcoil/0e3492e037a135f9b82d to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save springcoil/0e3492e037a135f9b82d to your computer and use it in GitHub Desktop.
Download ZIP
What data pipelines are there in python?
Raw
ETL_python.md

I want to do ETL and I want to do it in python. What tools do I have access to?

@erikbern

erikbern commented Oct 26, 2015

Copy link
Copy Markdown

I wouldn't say Luigi is "very heavy weight" but it's certainly aimed at for production ETL with a bunch of features for automation, monitoring, retries, and stuff.

@msure

msure commented Oct 26, 2015

Copy link
Copy Markdown

You might be interested in bubbles (http://bubbles.databrewery.org/) and cubes (http://cubes.databrewery.org/)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment