Rig
A Rust library for building modular, scalable LLM-powered applications, with a unified interface across more than 20 model providers and 10 vector stores.
Rig is a Rust library for building LLM-powered applications, providing agentic workflows that handle multi-turn streaming and prompting, and a classic agent runtime enabled by default. It offers support for completion, embedding, transcription, audio generation and image generation workflows.
The library separates portable provider and backend contracts from agent orchestration: rig-core holds provider-neutral messages, completion models, tool contracts and memory and vector-store contracts, while rig-agent holds the classic builder, streaming traits, the tool registry and a serializable agent-run state machine. The root rig crate re-exports both.
It supports more than 20 model providers and more than 10 vector store integrations behind unified interfaces, and its portable core and classic runtime compile to Browser WASM, though WASI and its MCP integration are native-only.