Data Wrangling Python Packages

skrub

Machine learning with dataframes

181K 2K 218

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

4K 2K 232

desbordante

Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.

3K 478 100

omnipy

Omnipy is a high level Python library for type-driven data wrangling and scalable workflow orchestration (under development)

2K 26 1

data-toolz

simple python library for handling data-io tasks

2K 7 0

datagrunt

Datagrunt is a Python library designed to simplify the way you work with CSV files. It provides a streamlined approach to reading, processing, and transforming your data into various formats, making data manipulation efficient and intuitive.

1K 10 2

anonymized-fraud-detection

A small package to parse and train an ML model for anonymized credit card transactions. Refer to github wikis for more details. Package was built for PythonVirtualenvOperator() on GCP Airflow.

1K 2 1

hypertools

A Python toolbox for gaining geometric insights into high-dimensional data

1K 2K 162

whyqd

data wrangling simplicity, complete audit transparency, and at speed

1K 35 1

csv-trimming

Package python to remove common ugliness from a csv-like file

736 106 0

monggregate

MongoDB aggregation pipelines made easy. Joins, grouping, counting and much more...

682 22 3

datasetops

Fluent dataset operations, compatible with your favorite libraries

663 11 0

pyoptimus

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

620 2K 233

skloverlay

This repository is the official location of the SKLOverlay Project. Here, it will hold everything used for the package on Py Pi, including source files.

486 0 0

pydata-wrangler

Wrangle messy numerical, image, and text data into consistent well-organized formats

394 10 2

excel-toolkit-cwd

Command-line toolkit for Excel data manipulation and analysis

282 0 0

databroom

Databroom is a cross-language data cleaning tool with CLI, GUI, and API. Clean CSV, Excel, or JSON files and generate reproducible scripts in Python (pandas) or R (tidyverse). Now supports saving and loading cleaning pipelines as JSON for fully automated, shareable workflows.

248 7 0

data-cleaning

Data Cleaning is a python package for data preprocessing. This cleans the CSV file and returns the cleaned data frame. It does the work of imputation, removing duplicates, replacing special characters, and many more.

245 9 4