Scala Python Packages | PyRank

pyspark

Apache Spark - A unified analytics engine for large-scale data processing

48.6M 44K 29K

papermill

📚 Parameterize, execute, and analyze notebooks

18.7M 6K 464

sparkmeasure

This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.

2.5M 830 161

tree-sitter-scala

Scala grammar for tree-sitter

1.9M 199 70

dbl-tempo

API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation

1.8M 346 60

mleap

MLeap: Deploy ML Pipelines to Production

1.8M 2K 313

pyspark-client

Apache Spark - A unified analytics engine for large-scale data processing

1.5M 44K 29K

apache-sedona

A cluster computing framework for processing large-scale geospatial data

1.4M 2K 787

synapseml

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

1.2M 5K 868

pyspark-hnsw

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

374K 303 59

pyspark-extension

A library that provides useful extensions to Apache Spark and PySpark.

68K 241 31

h2o-pysparkling-3-1

Sparkling Water provides H2O functionality inside Spark cluster

51K 982 357

hsfs

Python - Java/Scala API for the Hopsworks feature store

34K 57 42

sagemaker-pyspark

A Spark library for Amazon SageMaker.

34K 301 127

pantsbuild-pants

The Pants Build System

27K 4K 727

h2o-pysparkling-3-5

Sparkling Water provides H2O functionality inside Spark cluster

22K 982 357

h2o-pysparkling-3-4

Sparkling Water provides H2O functionality inside Spark cluster

20K 982 357

h2o-pysparkling-3-3

Sparkling Water provides H2O functionality inside Spark cluster

12K 982 357

pyspark-connect

Apache Spark - A unified analytics engine for large-scale data processing

8K 44K 29K

tensorflowonspark

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

7K 4K 934

h2o-pysparkling-2-4

Sparkling Water provides H2O functionality inside Spark cluster

6K 982 357

neverblink-linkml

A fast, portable (JS/JVM/native), and robust implementation of LinkML for cross-language data modeling

5K 59 6

geospark

A cluster computing framework for processing large-scale geospatial data

5K 2K 787

pantsbuild-pants-testutil

The Pants Build System

3K 4K 727