Back to directory

All-in-RAG

A full-stack, hands-on tutorial on retrieval-augmented generation for large-model application developers, covering data preparation, index construction, advanced retrieval, generation and evaluation.

Visit website (opens in a new tab)datawhalechina.github.io
All-in-RAG

All-in-RAG is a full-stack tutorial on retrieval-augmented generation aimed at developers building large-model applications, teaching a systematic path from fundamentals to production practice rather than a scattered set of unconnected tips. It moves through RAG concepts and use cases, a complete data-preparation pipeline covering document loading, cleaning and text chunking, index construction and optimization covering vector and multimodal embeddings and vector-database construction, advanced retrieval techniques including hybrid dense-and-sparse retrieval, query construction and translating natural language into SQL, and generation integration and evaluation methodology.

Later chapters walk through complete, practical RAG projects built from the earlier material, including one built on a knowledge graph, and an extra-chapter section invites community-contributed material on related RAG and vector-database topics. It assumes basic Python, basic Docker and basic Linux command-line skills, and covers both text and image retrieval.

More in RAG

See all 540
  • ai·rete·rag

    ai-rete-rag.com

    A platform that pairs a Rete rule engine with retrieval-augmented generation, so deterministic rules decide an outcome and grounded retrieval explains the decision in plain language.

  • Xtriever

    github.com

    A hybrid retrieval engine for retrieval-augmented generation, written in Rust to run on-device on a phone or a laptop, combining lexical BM25 search, dense embedding search, reciprocal-rank fusion and cross-encoder re-ranking with no server.

  • FileFlux

    github.com

    A .NET library that turns PDF, DOCX, HWP and other documents into optimized chunks for RAG systems, through a five-stage pipeline built on high-performance Rust FFI readers.