Glue Python Packages

sparksnake

Improving the development of Spark applications deployed as jobs on AWS services like Glue and EMR

21K 10 2

airflow-provider-overture

Airflow provider to interact with various services used by Overture.

8K 1 0

tasksource

Datasets collection and preprocessings framework for NLP extreme multitask learning

2K 218 12

torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

743 2K 143

aws-insurancelake-etl

This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, AWS Glue for data transformation, and AWS CDK Pipelines. It is originally based on the AWS blog Deploy data lake ETL jobs using CDK Pipelines, and complements the InsuranceLake Infrastructure project

690 38 16

adamix-gpt2

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

356 139 11

keras-xlnet

Implementation of XLNet that can load pretrained checkpoints

310 169 26

pycup

An open-source python package for (environmental) model calibration and uncertainty analysis based on elite opposition modified heuristic algorithms and the GLUE framework.

279 19 3