Data Python Packages

glom

☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️

pooch

A friend to fetch your data files

pypika

PyPika is a python SQL query builder that exposes the full richness of the SQL language using a syntax that reflects the resulting query. PyPika excels at all sorts of SQL queries but is especially useful for data analysis.

prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

metricflow

MetricFlow allows you to define, build, and maintain metrics in code.

llama-index-core

LlamaIndex is the document processing platform for AI

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

llama-index-instrumentation

LlamaIndex is the document processing platform for AI

datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

llama-index

LlamaIndex is the document processing platform for AI

dataproperty

A Python library for extract property from data.

mcap

MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

prefect-aws

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

mimesis

Mimesis is a Python library for generating fake but realistic data in multiple languages and locales.

dvc-data

DVC's data management subsystem

prefect-gcp

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

llama-index-legacy

LlamaIndex is the document processing platform for AI

akshare

AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库

tentaclio

Single repository regrouping IO connectors used in the data world.

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

prefect-github

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

mcap-protobuf-support

MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

prefect-docker

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

pytest-cases

Separate test code from test cases in pytest.