Dags Python Packages

dag-factory

Construct Apache Airflow DAGs Declaratively via YAML configuration files

astro-sdk-python

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task

burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

dagma

A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"

astro-provider-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

airflowctl

A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects.

gcp-airflow-foundations-dev

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

astro-extras

Additional Astro SDK operators

airflow-parse-bench

Stop creating bad DAGs! Use this tool to measure and compare the parse time of your DAGs, identify bottlenecks, and optimize your Airflow environment for better performance.

custom-deferrable-dataflow-operator

Start your Dataflow jobs execution directly from the Triggerer without going to the Worker!

dagsmith

A YAML-driven Apache Airflow DAG generator with schema validation, operator/sensor registry, and BigQuery/GCP support.

apache-airflow-provider-transfers

This project provides the Universal Transfer Operator to seamlessly transfer data from source to destination Datasets via a single operator invocation within DAGs.

gcp-airflow-foundations

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

dag-factory-hotfix

Construct Apache Airflow DAGs Declaratively via YAML configuration files

gcp-airflow-foundations-dev-jiny

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

airconditioner

YAML-based generic DAG builder for Apache Airflow

universal-transfer-operator

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

uto

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

astro-providers-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows