PyRank

Activation Functions Python Packages

Python packages with the GitHub topic activation-functions. Sorted by relevance, with stars and monthly downloads.
densechen
activations

AReLU: Attention-based-Rectified-Linear-Unit

5K 62 8
lucidrains
siren-pytorch

Pytorch implementation of SIREN - Implicit Neural Representations with Periodic Activation Function

2K 506 53
kaintels
torchact

TorchAct, collection of activation function for PyTorch.

860 3 0
dalmia
siren-torch

PyTorch implementation of Sinusodial Representation networks (SIREN)

355 267 10
DalhousieAI
pytorch-logit-logic

Logit-space logical activation functions for pytorch

219 1 0
Rishit-dagli
glu-tf

An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.

144 20 4
tbox98
freegrad

PyTorch extension for alternative backward rules and gradient transforms (STE, gradient jamming, non-standard activations).

138 0 0
pouyaardehkhani
acttensor-tf

ActTensor: Activation Functions for TensorFlow. https://pypi.org/project/ActTensor-tf/ Authors: Pouya Ardehkhani, Pegah Ardehkhani

119 27 4
NonlinearArtificialIntelligenceLab
jaxdiversity

Jax implementation of metalearning diversity paper

117 2 0
poopingface
sigmoidcolon

The biologically inspired sigmoid activation function.

100 25 1