Back to directory

Sentence Transformers

A Python framework for computing, using and training embedding and reranking models, including sentence embeddings, cross-encoder reranking, sparse embeddings and ColBERT-style multi-vector retrieval, for semantic search and similarity tasks.

Sentence Transformers

Sentence Transformers is a framework for computing embeddings with pretrained Sentence Transformer models, calculating similarity scores with Cross-Encoder reranker models, generating sparse embeddings with Sparse Encoder models, and computing token-level embeddings for ColBERT-style late-interaction retrieval with Multi-Vector Encoder models.

These building blocks support applications such as semantic search, semantic textual similarity and paraphrase mining. More than 15,000 pretrained models are available on Hugging Face, and the framework can also train or fine-tune custom embedding, reranker, sparse encoder or multi-vector encoder models for a specific use case.

It installs from PyPI, requires Python 3.10 or newer, PyTorch 2.2 or newer and Transformers 5.0 or newer, and offers optional extras for image, audio, video, training, ONNX and OpenVINO support.

More in RAG

See all 540
  • ai·rete·rag

    ai-rete-rag.com

    A platform that pairs a Rete rule engine with retrieval-augmented generation, so deterministic rules decide an outcome and grounded retrieval explains the decision in plain language.

  • Xtriever

    github.com

    A hybrid retrieval engine for retrieval-augmented generation, written in Rust to run on-device on a phone or a laptop, combining lexical BM25 search, dense embedding search, reciprocal-rank fusion and cross-encoder re-ranking with no server.

  • FileFlux

    github.com

    A .NET library that turns PDF, DOCX, HWP and other documents into optimized chunks for RAG systems, through a five-stage pipeline built on high-performance Rust FFI readers.