Data Ingestion Python Packages

oneagent-sdk

Enables custom tracing of Python applications in Dynatrace

ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

bruin-sdk

Bruin Python SDK — eliminate boilerplate in Bruin Python assets

druid-to-pinot-migrator

Migrate Apache Druid ingestion specs to Apache Pinot artifacts.

tracebloc-ingestor

tracebloc data pipeline for training/test dataset setup

dataforge-dfg

Data Forge is a high-performance, CLI-first data integration tool designed to streamline the lifecycle of data from ingestion to transformation. Built with Python, it provides a robust framework for handling both ETL and ELT workflows with a focus on automation, reliability, and developer experience.

llm-markdownify

Convert documents, images to high-quality Markdown using Vision LLMs. Built for RAG ingestion pipelines.

bors

A highly flexible and versatile service integration framework.

nanostream

Small-scale stream processing for ETL

sequor

SQL-centric API integration platform

metalpipe

Modules for ETL Pipelines

feedunify

A high-performance, unifying library for data ingestion pipelines from multiple sources.

skeem

Infer SQL DDL statements from tabular data

sdmxflow

SDMX ingestion for statistical data warehouses: reproducible datasets, metadata history, and exported codelists in an append-only structure.

ragpipe-ai

RAG in 3 functions. Ingest any data source into vector databases.