Data Transformation Python Packages

glom

☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️

xorq

Git-native executable catalog for agentic data work.

duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

tubular

Python package implementing ML feature engineering and pre-processing for polars or pandas dataframes.

tikray

A compact data transformation engine.

commons-codec

Data decoding, encoding, conversion, and translation utilities.

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

csv-refine

Configurable Python CLI for cleaning, validating and normalizing CSV files using YAML data contracts.

adtl

Another data transformation language

tukuy

Tukuy is a robust, extensible data transformation library that leverages a flexible plugin system. It simplifies the manipulation, validation, and extraction of data across multiple formats (text, HTML, JSON, dates, numbers, and more), making it an ideal tool for building data pipelines and cleaning workflows.

glide

Easy ETL

csvsmith

Python utilities for cleaning, deduplicating, searching, organizing, concentrating, and converting CSV data—with reusable APIs and a practical CLI.

dsr-feature-eng-ml

Machine learning model evaluation and feature engineering framework with hyperparameter tuning, data balancing, and feature importance analysis.

ciaren

Open-source, local-first visual ETL and data pipeline builder. Drag-and-drop data prep and ML workflows, preview every step, schedule runs, and export clean pandas or Polars Python code. Self-hosted, no lock-in.

ciaren-client

Open-source, local-first visual ETL and data pipeline builder. Drag-and-drop data prep and ML workflows, preview every step, schedule runs, and export clean pandas or Polars Python code. Self-hosted, no lock-in.

pyoptimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

smelt-ai

LLM-powered structured data transformation. Batch process rows through any LLM, get back strictly typed Pydantic models.

etherealogic-aetheriaforge

Databricks-native intelligent data transformation engine — coherence-scored Bronze/Silver/Gold with entity resolution and temporal reconciliation in a single deployable product.

df-and-order

Using df-and-order your interactions with dataframes become very clean and predictable.

tidychef

Python framework for transforming tabulated data with visual relationships into tidy data

pymdt2json

pymdt2json is a Python CLI and library for converting markdown tables into structured JSON: ideal for data pipelines, LLM preprocessing, and web/API integration.

customer-segmentation-toolkit

Data transformations toolkit made from jupyter notebook: https://www.kaggle.com/fabiendaniel/customer-segmentation

pythistic

Frequency Table Conversion, Descriptive Statistics and Data Transformation Calculation Tool in Python

vptstools

Python library to transfer and convert vertical profile time series data