Dataset Generation Python Packages

nfstream

NFStream: a Flexible Network Data Analysis Framework.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

lightningrod-ai

Python SDK for dataset generation on LightningRod platform ⚡

kiln-ai

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

ragscore

⚡️ The "1-Minute RAG Audit" — Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, async, visual reports.

modeyolo

ModeYOLO: Elevate image processing with this Python package. Seamlessly perform color space transformations, simplify dataset modification for deep learning, and leverage OpenCV and NumPy. Ideal for YOLO projects, computer vision tasks, and efficient machine learning workflows.

bpycv

Computer vision utils for Blender.

kiln-server

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

nlptoolkit-datagenerator

Classification dataset generator library for high level Nlp tasks

rackfocus

Schedulable command line utility to download and compile IMDb datasets in a highly browsable SQLite database file

scalexi

The scalexi package is a versatile open-source Python library that focuses on facilitating low-code development and fine-tuning of diverse Large Language Models (LLMs). It extends beyond its initial OpenAI models integration, offering a scalable framework for various LLMs.

datasetgpt

A command-line interface to generate textual and conversational datasets with LLMs.

nlptoolkit-datagenerator-cy

Classification dataset generator library for high level Nlp tasks

human-eval-rust

SigilDERG Data Production is an enterprise-grade Rust pipeline that crawls crates, runs rigorous scans (Clippy, Geiger, license checks), and generates instruction-style JSONL shards. It features semantic chunking, configurable splits, observability, and seamless SigilDERG ecosystem integration.

chatette

A dataset generator for Rasa NLU

data-seed-ph

A Python library for generating realistic, synthetic Philippine-based datasets.

pyreports

pyreports is a python library that allows you to create complex report from various sources

autosynth

Agentic synthetic-data generation framework inspired by Meta FAIR's Autodata / Agentic Self-Instruct.

stopes

Large-Scale Translation Data Mining.

d-arth

DATASETS FOR WHOLE E-ARTH

bio-dataset-manager

This tool facilitates the encoding of these sequences into tensors, which can then be used for AI computations and complex model implementations

tempdataset

A lightweight Python library for generating realistic temporary datasets for testing and development. Generate 40+ different dataset types including business, financial, IoT, healthcare, and technology data!

ks-llm-ranker

Ranking Large Language Models using the Principle of Least Action! Built during my time at Knit Space, Hubbali under the guidance Prof. Prakash Hegade.

financial-scraper

Get data of stocks and funds that compose the Brazilian stock market.