PyRank

Activation Functions Python Packages

Python packages with the GitHub topic activation-functions. Sorted by monthly downloads, with stars and forks.
lucidrains
siren-pytorch

Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function

689 513 54
kaintels
torchact

TorchAct, collection of activation function for PyTorch. https://pypi.org/project/torchact/

164 3 0
densechen
activations

AReLU: Attention-based-Rectified-Linear-Unit

137 64 8
tbox98
freegrad

PyTorch extension for alternative backward rules and gradient transforms (STE, gradient jamming, non-standard activations).

105 1 0
pouyaardehkhani
acttensor-tf

ActTensor: Activation Functions for TensorFlow. https://pypi.org/project/ActTensor-tf/ Authors: Pouya Ardehkhani, Pegah Ardehkhani

99 27 4
Rishit-dagli
glu-tf

An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.

82 20 3
dalmia
siren-torch

PyTorch implementation of Sinusodial Representation networks (SIREN)

78 267 10
poopingface
sigmoidcolon

:poop: Sigmoid Colon: The biologically inspired activation function.

71 25 1
NonlinearArtificialIntelligenceLab
jaxdiversity

Jax implementation of metalearning diversity paper

71 2 0
DalhousieAI
pytorch-logit-logic

Logit-space logical activation functions for pytorch

46 1 0