Skip to content

Instantly share code, notes, and snippets.

@tankhuu
Last active July 29, 2019 15:16
Show Gist options
  • Save tankhuu/fb5bd58a8979c4e6f3f00419ac185729 to your computer and use it in GitHub Desktop.
Save tankhuu/fb5bd58a8979c4e6f3f00419ac185729 to your computer and use it in GitHub Desktop.
MorphL Installation
sudo yum install -y python3 python3-devel python3-pip gcc gcc-c++ git
python3 -V
sudo pip3 install apache-airflow[jdbc,s3,slack,oracle,postgres,ssh]
sudo pip3 install flask
airflow initdb
mkdir github
cd github/
git clone https://github.com/apache/airflow.git
sudo cp -p airflow/scripts/systemd/airflow-*.service /usr/lib/systemd/system
sudo cp -p airflow/scripts/systemd/airflow.conf /usr/lib/tmpfiles.d/
sudo systemd-tmpfiles --create # create /run/airflow
sudo cp -p airflow/scripts/systemd/airflow /etc/sysconfig/
vi /etc/sysconfig/airflow
vi /usr/lib/tmpfiles.d/airflow.conf
vi /usr/lib/systemd/system/airflow-webserver.service
ll /run/airflow/
sudo systemctl stop airflow-webserver
sudo systemctl start airflow-webserver
apt-get install --no-install-recommends -y gnupg krb5-user ldap-utils less lsb-release net-tools openjdk-8-jdk openssh-client openssh-server postgresql-client python-selinux sqlite3 tmux unzip vim python3-distutils python3-dev
curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py
ln -s /usr/bin/python3 /usr/bin/python
python get-pip.py
pip install flask
pip install apache-airflow[postgres,s3]
airflow --help
cd /opt/
git clone https://github.com/apache/airflow.git
cd airflow/scripts/systemd/
cp airflow /etc/default/
cp airflow-*.service /lib/systemd/system/
cp airflow.conf /usr/lib/tmpfiles.d/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment