Back to directory

Awesome Voice Agents

A curated, bilingual list of frameworks, tools and resources for building voice AI agents, covering voice activity detection, turn-taking, real-time speech recognition and speech synthesis.

Awesome Voice Agents

This list is organized by the pieces that make up a voice AI agent: comprehensive frameworks and platforms for conversational voice agents, voice activity detection, turn detection and endpointing, speech-to-text, text-to-speech, end-to-end speech models, voice MCP integrations and coding-agent voice tools, and toolkits for wake words and voice conversion, alongside developer communities and learning resources.

Listed frameworks include open-source projects for multimodal conversational voice agents with vision and avatar support, modular voice and multimodal pipelines with pluggable speech and language model services, real-time voice agent frameworks built on WebRTC with semantic turn detection, and examples of advanced agentic patterns built on realtime voice APIs with multi-agent handoffs and tool use.

Entries are written in both English and Chinese, and the list carries a CC0-1.0 license.

More in Speech

See all 119
  • ELI v2.0

    geteli.tech

    A private AI assistant and local runtime that runs entirely on the user's own hardware: it holds conversations by voice or text, controls the desktop, reads the screen, writes code, and builds a private model of the user over time.

  • VoiceAssistant

    github.com

    A fully local, full-duplex voice assistant for Windows that lets a user interrupt it mid-sentence and answers using visual context captured from the desktop the instant the user speaks.

  • vibe

    github.com

    A cross-platform desktop application for transcribing audio and video offline using OpenAI's Whisper models on the user's own machine, with an optional OpenAI backend when a user supplies an API key.