metadata-driven
The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
DataCoolie — A Python data pipeline framework for Polars and Spark, across Local, AWS, Microsoft Fabric, and Databricks.
Provide an easy way with Python to protect your data sources by searching its metadata. 🛡️