Sentence Embeddings Python Packages

flagembedding

Retrieval and Retrieval-augmented LLMs

bertopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

sent2vec

How to encode sentences in a high-dimensional vector space, a.k.a., sentence embedding.

text2vec

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

encoderfile

Distribute and run transformer encoders with a single file.

similar-sentences

Similar sentence Prediction with more accurate results with your dataset on top of pertained model. #BERT

xmnlp

xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能

inltk

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

vectordb

A Python vector database you just need - no more, no less.

easybert

A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)

txtai-minimal

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

ne-embed

Multilingual sentence embeddings for 10 Northeast Indian languages

lm-cocktail

Retrieval and Retrieval-augmented LLMs

jee-data-base

Tool to access and manage 14k+ jee main pyqs with semantic clustering

pysentence-similarity

PySentence-Similarity is a tool designed to identify and find similarities between sentences and a base sentence, expressed as a percentage 📊.

sentence-similarity

Package to calculate the similarity score between two sentences

afterthoughts

Sentence-aware embeddings using late chunking with transformers.

wisse-sentence

A sentence embedding method based on weighted series

simcse

[EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821

opposite-score

A lightweight toolkit for measuring how “opposite” two texts are when they share the same context.

deepse

Sentence Embeddings using Deep Nerual Networks in PRODUCTION!

c-mteb

Retrieval and Retrieval-augmented LLMs

smiles-featurizers

A python library for extracting molecular SMILES embeddings from language models pre-trained with various objectives and/or architectures.