Datalake Python Packages

lakefs-sdk

lakeFS - Data version control for your data lake | Git for data

lakefs

lakeFS - Data version control for your data lake | Git for data

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

deeplake

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

pandasai

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

lakefs-client

lakeFS - Data version control for your data lake | Git for data

pandasai-openai

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

pan-cortex-data-lake

Python idiomatic SDK for Cortex™ Data Lake.

pandasai-litellm

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

zingg

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

apache-gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

pancloud

Python idiomatic SDK for Cortex™ Data Lake.

dlt-iceberg

An Iceberg destination for DLT that supports REST catalogs

aws-orbit-overprovisioning

Launch a Pod for the team space that executes a script given by the user

tarn

An insanely customizable framework for key-value storage 💾

aws-insurancelake-etl

A CDK Python app for deploying ETL jobs that operate data pipelines for InsuranceLake in AWS

aws-orbit

Data & ML Unified Development and Production Environment.

aws-orbit-team-script-launcher

Launch a Pod for the team space that executes a script given by the user

aws-orbit-code-commit

Orbit Workbench CodeCommit Plugin.

aws-orbit-custom-cfn

Launch a CloudFormation stack for the team space

aws-orbit-redshift

Orbit Workbench Redshift Plugin.

aws-orbit-sdk

AWS Orbit Workbench SDK

aws-orbit-hello-world

Minimal Orbit Workbench Plugin.

aws-orbit-emr-on-eks

Allow users to run EMR jobs on their EKS namespace