Data Processing Pipelines Python Packages

convtools

convtools is a specialized Python library for dynamic, declarative data transformations with automatic code generation

filter-stations

Making it easier to navigate and clean TAHMO weather station data for ML development

wxdata

A Python package of end-to-end weather data clients & raw data clients with VPN/Proxy Server support, data processors that decode variable keys from GRIB format into a plain-language format & various tools for assisting Python automated workflows, querying meteorological datasets and filling gaps in meteorological data.

artifician

Artifician is an event-driven framework designed to simplify and accelerate the process of preparing datasets for Artificial Intelligence models.

graphbook

Visual AI development framework for training and inference of ML models, scaling pipelines, and automating workflows with Python

thepipe

A simplistic, general purpose pipeline framework.

graphbook-huggingface

Visual AI development framework for training and inference of ML models, scaling pipelines, and automating workflows with Python

invisible-rabbit

Scalable data pre processing and curation toolkit for LLMs

invisible-unicorn

Scalable data pre processing and curation toolkit for LLMs

lava-ray

Scalable data pre processing and curation toolkit for LLMs