Back to directory

Sidekick

A native macOS app for chatting with a local large language model that can answer using files, folders and websites on the Mac, entirely offline, with an optional bring-your-own-key mode.

Sidekick

Sidekick is a native macOS app that lets a user chat with a local large language model that can respond using information from files, folders and websites on the Mac, without installing any other software. It runs entirely offline by default, using a built-in llama.cpp inference engine, and supports modern GGUF models such as Qwen3.5 out of the box.

Retrieval-augmented generation lets a user configure collections of files, folders and websites, called experts, around a specific area of interest; activating an expert lets Sidekick fetch and cite relevant material, including direct quotes with page numbers that open the source in a viewer, and files can also be dragged directly into the input field. A web search option lets it use current information, and users can bring their own API key for OpenAI-compatible remote providers, including OpenAI, Anthropic, Google AI Studio, DeepSeek, Groq, MiniMax, Mistral and xAI, while keeping a primarily local-first workflow.

It is written in Swift and released under the MIT license.

More in RAG

See all 540
  • ai·rete·rag

    ai-rete-rag.com

    A platform that pairs a Rete rule engine with retrieval-augmented generation, so deterministic rules decide an outcome and grounded retrieval explains the decision in plain language.

  • Xtriever

    github.com

    A hybrid retrieval engine for retrieval-augmented generation, written in Rust to run on-device on a phone or a laptop, combining lexical BM25 search, dense embedding search, reciprocal-rank fusion and cross-encoder re-ranking with no server.

  • FileFlux

    github.com

    A .NET library that turns PDF, DOCX, HWP and other documents into optimized chunks for RAG systems, through a five-stage pipeline built on high-performance Rust FFI readers.