Data Wrangling Python Packages

skrub

Machine learning with dataframes

monggregate

Library to make MongoDB aggregation framework and pipelines easy to use in python.

desbordante

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

datagrunt

Datagrunt is a Python library designed to simplify the way you work with CSV, Excel, Parquet, and PDF files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.

padawan

Wrangle partitioned data with polars.

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

exform

Reshape text by example: show it a couple of before⇒after lines, it infers the transform and applies it to the whole file/stream — or emits a portable awk/python one-liner. Deterministic, offline, no regex, no LLM.

data-toolz

simple python library for handling data-io tasks

omnipy

Omnipy is a high level Python library for type-driven data wrangling and scalable workflow orchestration (under development)

hypertools

A Python toolbox for gaining geometric insights into high-dimensional data

pydata-wrangler

Wrangle messy numerical, image, and text data into consistent well-organized formats

kenze

Big-file data prep that never runs out of memory - an interactive shell and CLI, powered by DuckDB.

csvsmith

Python utilities for cleaning, deduplicating, searching, organizing, concentrating, and converting CSV data—with reusable APIs and a practical CLI.

csv-trimming

Package python to remove common ugliness from a csv-like file

whyqd

data wrangling simplicity, complete audit transparency, and at speed

pyoptimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

dataclean-csv

Dependency-free Python CLI that cleans messy CSV files — normalizes headers, removes duplicates, fills missing values — and writes a JSON data-quality report. Stdlib only, no pandas.

skloverlay

This repository is the official location of the SKLOverlay Project. Here, it will hold everything used for the package on Py Pi, including source files.

anonymized-fraud-detection

Deploying Classification Model on GCP for detecting anomalous behavior in credit-card transactions. A crucial aspect for credit-card companies to recognize fraudulent activity and not charge customers for items they didn't purchase. A subtle line needs to be drawn and my main focus here is to reduce blocked-transactions of legitimate customers.

fathom-json

Fathom first. Then parse. See what is in a JSON document before you parse it — one vocabulary, in R and in Python, over one Rust core.

frameon

🐼✨ Frameon - enhances pandas DataFrames with analysis methods while preserving all native functionality

excel-toolkit-cwd

A powerful command-line toolkit for Excel and CSV data manipulation, analysis, and transformation.

prosto

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

datasetops

Fluent dataset operations, compatible with your favorite libraries