Airflow v2 on Docker Compose

About

Official Apache Airflow local docker compose setup

Airflow Official documentation for docker compose deployment

Quickstart

1. Clone repo git clone https://github.com/datafuel/airflow_docker.git
2. Run cd airflow_docker
3. Run echo -e "AIRFLOW_UID=$(id -u)" > .env (only on first use)
4. Run cd docker_build and run docker compose build
5. Run cd .. and run docker-compose -f datafuel.docker-compose.yml up airflow-init (only on first use)
6. Run docker compose -f datafuel.docker-compose.yml up then access airflow on http://localhost:8080

Default Credentials

• Airflow username : airflow
• Airflow password : airflow

Add python libraries to the datafuel/airflow docker image

1. Add your libraries to the /docker_build/requirements.txt file
2. Run cd docker_build and run docker compose build to rebuild the datafuel/airflow docker image
3. Your python libraries are now added to the datafuel/airflow docker image