Speech

An extension of OpenAI's Whisper speech-recognition model that adds accurate word-level timestamps and per-word confidence scores.

• Speech

A self-hosted, offline application that transcribes audio for people who run their own infrastructure and want to keep recordings private rather than use a cloud service.

• Speech

A self-hosted web application that transcribes audio or video to text, translates it, and edits subtitles entirely on your own machine using Whisper models.

• Speech

A cross-platform on-device AI app for phone and Mac that runs GGUF language models, vision, Whisper speech-to-text and Stable Diffusion image generation entirely offline, with tool calling.

• Inference
• Speech
• Generative media

A cross-platform Python framework for real-time voice AI, vision-language tasks and IoT device control, evolved from the xiaozhi-esp32 firmware project.

• Speech
• Libraries

A highly accurate, lightweight, on-device wake-word engine for building always-listening voice-enabled applications.

• Speech

A self-hostable, open-source alternative to Vapi and Retell for building voice AI agents with a visual workflow builder, letting a team bring their own LLM, speech-to-text and text-to-speech providers.

• Speech

A collection of open-source, on-device text-to-speech models with instant voice cloning from a few seconds of audio, distributed in GGUF format for phones, laptops, and Raspberry Pis.

• Speech

A Swift package of on-device inference frameworks for Apple platforms covering speech-to-text, speaker diarization, and text-to-speech.

• Speech

An audio-processing library built on Apple's MLX framework for fast text-to-speech, speech-to-text, speech-to-speech and music generation on Apple Silicon.

• Speech

An open-source framework for building real-time, multimodal conversational voice AI agents, with example agents, voice activity detection, turn detection and deployment tooling.

• Agent frameworks
• Speech

An open-source PyTorch toolkit for conversational AI, covering speech recognition, speaker recognition, speech enhancement and separation, and language modeling, with more than 200 training recipes.

• Speech

A Python framework for building realtime, multimodal voice AI agents that run on servers, mixing speech-to-text, language models, text-to-speech and telephony into conversational participants.

• Agent frameworks
• Speech

An open-source Python framework for building real-time voice and multimodal conversational AI agents, from a single voice assistant to a multi-agent system that hands off and coordinates work over a shared bus.

• Agent frameworks
• Speech

A generative AI framework for researchers and developers building automatic speech recognition, text-to-speech, speaker diarization and speech translation models, with tools to create, customize and deploy new models from existing code and pretrained checkpoints.

• Speech

An industrial speech recognition toolkit for training and running offline, streaming and edge automatic speech recognition, voice activity detection, punctuation restoration and speaker diarization models, with OpenAI-compatible and MCP serving.

• Speech

An open source WebRTC platform for building realtime voice, video and AI agent applications, with a distributed media server, client SDKs for many platforms, and an agents framework for voice AI.

• Speech
• Backend

A multilingual large voice generation model with a full pipeline for inference, training and deployment, supporting zero-shot multilingual and cross-lingual voice cloning.

• Speech

A voice-enabled autonomous AI assistant that runs entirely on local hardware, browsing the web, writing and running code, and planning multi-step tasks without a cloud dependency.

• Agent frameworks
• Speech

Firmware for building a voice-controlled AI chatbot on ESP32 hardware, using large language models for conversation and the Model Context Protocol for both device-side and cloud-side tool control.

• Speech

A text-to-speech model built for dialogue scenarios such as an LLM assistant, generating multi-speaker conversational speech with control over prosody, laughter, pauses and interjections.

• Speech

whisper.cpp is a dependency-free C and C++ port of OpenAI's Whisper speech-recognition model, built to run efficiently from phones to servers with no external libraries.

• Speech

Voicebox is a local-first, open-source voice studio that clones voices, generates speech across seven TTS engines, transcribes dictation into any app, and gives MCP-aware AI agents a voice of the user's choosing.

• Speech