Sentence Embeddings Python Packages

flagembedding

Retrieval and Retrieval-augmented LLMs

bertopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

txtai

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

sent2vec

How to encode sentences in a high-dimensional vector space, a.k.a., sentence embedding.

text2vec

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

similar-sentences

Similar sentence Prediction with more accurate results with your dataset on top of pertained model. #BERT

xmnlp

xmnlp：提供中文分词, 词性标注, 命名体识别，情感分析，文本纠错，文本转拼音，文本摘要，偏旁部首，句子表征及文本相似度计算等功能

inltk

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

vectordb

A Python vector database you just need - no more, no less.

easybert

A Dead Simple BERT API for Python and Java (https://github.com/google-research/bert)

encoderfile

Distribute and run transformer encoders with a single file.

lm-cocktail

Retrieval and Retrieval-augmented LLMs

txtai-minimal

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

pysentence-similarity

PySentence-Similarity is a tool designed to identify and find similarities between sentences and a base sentence, expressed as a percentage.

jee-data-base

Tool to access and manage 14k+ jee main pyqs with semantic clustering

afterthoughts

Sentence-aware embeddings using late chunking with transformers.

sentence-similarity

Package to calculate the similarity score of two sentences

wisse-sentence

Sentence embeddings (WISSE) with SBERT-like API for downstream NLP applications.

simcse

A sentence embedding tool based on SimCSE

deepse

Sentence Embeddings using Deep Nerual Networks in PRODUCTION!

c-mteb

Retrieval and Retrieval-augmented LLMs

simplests

Exploring the simple sentence similarity measurements using word embeddings

smiles-featurizers

Extract Molecular SMILES embeddings from language models pre-trained with various objectives architectures.

wikit-chatintents

Clustering sentence embeddings to extract message intent