Skip to content

Instantly share code, notes, and snippets.

@seandavi

seandavi/airflow_getting_started.md

Last active May 3, 2019 19:34
Show Gist options
  • Save seandavi/53ca25c56b157f098029d2bcf1ec31ee to your computer and use it in GitHub Desktop.
Save seandavi/53ca25c56b157f098029d2bcf1ec31ee to your computer and use it in GitHub Desktop.
Download ZIP
Raw
airflow_getting_started.md

Apache Airflow setup

base installations

sudo apt-get update
sudo apt-get install python3 python3-pip virtualenv
# sudo apt-get install emacs tmux

use a virtualenv

virtualenv --python=python3 virtairflow
source virtairflow/bin/activate

Install airflow

pip install apache-airflow[s3,gcp_api,postgres,celery,kubernetes,rabbitmq]

Once installed, run airflow once and the config file will be created.

configure

airflow

Edit the airflow config (~/airflow/airflow.cfg) to include your database config.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment