For more information, see Architecture Overview.

It is available at All these services allow you to run Airflow with CeleryExecutor. docker compose up flower.įlower - The flower app for monitoring the environment. docker compose -profile flower up, or by explicitly specifying it on the command line e.g. Optionally, you can enable flower by adding -profile flower option, e.g. Redis - The redis - broker that forwards messages from scheduler to worker. Īirflow-worker - The worker that executes the tasks given by the scheduler.Īirflow-init - The initialization service.Task instances once their dependencies are complete.Īirflow-webserver - The webserver is available at This file contains several service definitions:Īirflow-scheduler - The scheduler monitors all tasks and DAGs, then triggers the Environment variables supported by Docker Compose.ModuleNotFoundError: No module named 'XYZ'.Export dynamic environment variables available for operators to use.(Optional) Adding IDE auto-completion support.Customize view of Apache from Airflow web UI.Customizing DAG Scheduling with Timetables.Add tags to DAGs and use it for filtering in the UI.

How to upgrade docker on mac