Back to directory

Semantic Search Engine

A hybrid semantic search engine, built during an internship, that combines dense embedding search with sparse keyword matching, cross-encoder reranking, and Redis caching, served through a FastAPI backend.

Semantic Search Engine

Semantic Search Engine retrieves context-aware results by meaning rather than exact keyword matches, combining dense embeddings from a BAAI BGE model with sparse SPLADE keyword matching for hybrid retrieval, then reranking the combined candidates with a cross-encoder model before returning results. Embeddings are stored and queried in Qdrant, and a Redis cache sits in front of the pipeline to speed up repeated queries.

The project is served through a FastAPI backend with interactive Swagger documentation, and is set up with a small number of commands: starting Qdrant and Redis containers, installing dependencies, building the index from source data, and starting the API. Reported evaluation on a set of 25 queries shows reranking reducing average query latency by roughly a third versus hybrid search alone, while cache hits cut latency by about four hundred times compared with a cache miss.

More in RAG

See all 540
  • ai·rete·rag

    ai-rete-rag.com

    A platform that pairs a Rete rule engine with retrieval-augmented generation, so deterministic rules decide an outcome and grounded retrieval explains the decision in plain language.

  • Xtriever

    github.com

    A hybrid retrieval engine for retrieval-augmented generation, written in Rust to run on-device on a phone or a laptop, combining lexical BM25 search, dense embedding search, reciprocal-rank fusion and cross-encoder re-ranking with no server.

  • FileFlux

    github.com

    A .NET library that turns PDF, DOCX, HWP and other documents into optimized chunks for RAG systems, through a five-stage pipeline built on high-performance Rust FFI readers.