Dataproc Python Packages

bigflow

A Python framework for data processing on GCP.

biggerquery

A Python framework for data processing on GCP.

save-gcp-local

Run Airflow DAGs locally and execute Dataproc/Spark jobs in local Docker instead of creating GCP clusters. Generic, zero DAG edits, pluggable test-data providers.

dataprocxy

opens a chrome browser to a dataproc cluster

debussy-concert

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.