Data Loading Python Packages

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

dlt-cratedb

dlt destination adapter for CrateDB

dlt-core

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

omniload

omniload is a polyglot data loader based on dlt. Copy data between any source and any destination.

pytest-data-loader

Pytest plugin for loading test data for data-driven testing (DDT)

podium-nlp

Podium: a framework agnostic Python NLP library for data loading and preprocessing

dlt-source-personio

A DLT source for personio

m2data

A package for reading .m2 files commonly used in GEC tasks

datavolt

Reusable data engineering toolkit My personal data infrastructure

dlt-dataops

dlt is an open-source python-first scalable data loading library that does not require any backend to run.

spltr

`Spltr` is a simple PyTorch-based data loader and splitter. It may be used to load arrays and matrices or Pandas DataFrames and CSV files containing numerical data with subsequent split it into train, test (validation) subsets in the form of PyTorch DataLoader objects.

bp-storage

Helper Library for various Dataset formats