Positional Encoding Python Packages

rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

rotary-spatial-embeddings

PyTorch implementation of Rotary Spatial Embeddings

rotary-embedding-tensorflow

Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow

learnable-fourier-positional-encoding

Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding