Back to directory

whisper_ros

ROS 2 packages that bring whisper.cpp speech-to-text and Silero voice-activity detection into a robot's software stack, so a robot can listen for and transcribe speech.

whisper_ros

whisper_ros integrates GGML-based whisper.cpp for speech recognition and Silero VAD for detecting when someone is speaking into ROS 2 through the audio_common package, providing the speech-to-text half of a voice pipeline for a robot. A related project, chatbot_ros, combines it with llama_ros for response generation and a state machine to build a complete spoken chatbot running on ROS 2.

It builds with CUDA support for both whisper.cpp and Silero when the CUDA toolkit and cuDNN are installed, and ships a Docker build with optional CUDA and a chosen CUDA version, launched through a single ROS 2 launch file that starts both voice-activity detection and transcription together. The package supports ROS 2 distributions from Humble through the current Rolling release.

It is written in C++ and licensed under MIT.

More in Speech

See all 119
  • ELI v2.0

    geteli.tech

    A private AI assistant and local runtime that runs entirely on the user's own hardware: it holds conversations by voice or text, controls the desktop, reads the screen, writes code, and builds a private model of the user over time.

  • VoiceAssistant

    github.com

    A fully local, full-duplex voice assistant for Windows that lets a user interrupt it mid-sentence and answers using visual context captured from the desktop the instant the user speaks.

  • vibe

    github.com

    A cross-platform desktop application for transcribing audio and video offline using OpenAI's Whisper models on the user's own machine, with an optional OpenAI backend when a user supplies an API key.