Big Data Analytics Python Packages

ydata-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

2M 14K 2K

pandas-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

482K 14K 2K

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

197K 366 121

vineyard

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

33K 961 132

vineyard-bdist

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

29K 961 132

fg-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

22K 14K 2K

vineyard-ml

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

4K 961 132

airflow-provider-vineyard

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

3K 961 132

vineyard-io

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

1K 961 132

vineyard-llm

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

1K 961 132

vineyard-dask

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

816 961 132

yirabot

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ideal for research, SEO, and data collection.

750 17 0

pywren-ibm-cloud

Run many jobs over IBM Cloud

622 366 121

vineyard-kedro

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

321 961 132

vineyard-migrate

Object migration drivers for vineyard

319 961 132

datakit-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

280 14K 2K

rapticoressvc

Rapticore SSVC

272 9 1

crypto-trader-analysis

Analysis and ML components for the Crypto Trader platform (news sentiment, training, utilities).

257 2 0

vineyard-pyspark

Vineyard integration with PySpark

245 961 132

test-new-data-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

237 14K 2K

haiqv-profiling

Generate profile report for pandas DataFrame

182 14K 2K

vineyard-ray

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

74 961 132