Glue Python Packages

sparksnake

Improving the development of Spark applications deployed as jobs on AWS services like Glue and EMR

torchdistill

A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

tasksource

Datasets collection and preprocessings framework for NLP extreme multitask learning

aws-insurancelake-etl

A CDK Python app for deploying ETL jobs that operate data pipelines for InsuranceLake in AWS

adamix-gpt2

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

datajob

Build and deploy a serverless data pipeline on AWS with no effort.

keras-xlnet

Implementation of XLNet that can load pretrained checkpoints

gluettalax

Glue ETL without constipation

cloudio-glue-python

cloud.iO endpoint glue

pycup

An auto-calibration tool for environmental models based on heuristic algorithms and uncertainty estimation theory.

aws-glue-artifact

AWS Glue Artifact versioning and alias Management for blue/green, canary deployment, and roll back for production failure.

benchformer

Transformers Language Models benchmarking tool

glue-jupyterlab

A JupyterLab extension for glue-viz

embeval

A framework for word embedding evaluation automation and visualization.

gluepyter

Glue JupyterLab Extension

gluesnake

Improving the development of Spark applications deployed as jobs on AWS services like Glue and EMR