Data Processing Pipelines Python Packages

convtools

convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation

wxdata

A Python package of end-to-end weather data clients & raw data clients with VPN/PROXY support, data processors that decode variable keys from GRIB format into a plain-language format & various tools for assisting Python automated workflows, querying meteorological datasets and filling gaps in meteorological data.

graphbook

Visual AI development framework for training and inference of ML models, scaling pipelines, and automating workflows with Python

artifician

Artifician is an event-driven framework designed to simplify and accelerate the process of preparing datasets for Artificial Intelligence models.

filter-stations

Making it easier to navigate and clean TAHMO weather station data for ML development

graphbook-huggingface

Visual AI development framework for training and inference of ML models, scaling pipelines, and automating workflows with Python

thepipe

A simplistic, general purpose pipeline framework.

invisible-rabbit

Scalable data pre processing and curation toolkit for LLMs

invisible-unicorn

Scalable Data Preprocessing Tool for Training Large Language Models

lava-ray

Scalable data pre processing and curation toolkit for LLMs