Big Data Analytics Python Packages

ydata-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

659K 14K 2K

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud ☁️🚀

128K 368 119

pandas-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

118K 14K 2K

vineyard

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

83K 964 134

vineyard-bdist

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

75K 964 134

fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

17K 14K 2K

vineyard-ml

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

8K 964 134

airflow-provider-vineyard

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

2K 964 134

vineyard-io

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

1K 964 134

crypto-trader-analysis

A Spring Boot web app that buys and sells cryptocurrencies from API data sources. Its quick trading and other features allow users to leverage computer power to outperform the market.

928 1 0

yirabot

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ideal for research, SEO, and data collection.

691 17 0

pywren-ibm-cloud

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud ☁️🚀

660 368 119

vineyard-dask

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

644 964 134

vineyard-llm

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

583 964 134

rapticoressvc

SSVC Ore Miner - www.rapticore.com

267 9 1

vineyard-kedro

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

239 964 134

vineyard-migrate

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

228 964 134

vineyard-pyspark

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

148 964 134

datakit-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

70 14K 2K

test-new-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

61 14K 2K

haiqv-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

57 14K 2K

vineyard-ray

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

23 964 134

pandata

The Pandata scalable open-source analysis stack

0 69 1