Back to directory

Parlor

A research-preview, fully on-device real-time multimodal voice assistant with features similar to OpenAI's GPT-Live, using hands-free turn-taking detection and sentence-by-sentence streamed replies, with an optional cloud research step.

Parlor

Parlor is an early research-preview project for fully on-device, real-time multimodal voice interaction, built to approach the experience of OpenAI's GPT-Live while running entirely on a local machine such as an Apple Silicon MacBook. After an attempt to fine-tune a model directly into a full-duplex voice model did not succeed, it uses a classic cascade of separate speech, language and speech-synthesis stages instead.

Turn-taking is hands-free: browser-side voice activity detection with a short silence cutoff decides when audio has stopped, and a separate turn-detection model judges whether the user has actually finished a thought rather than paused mid-sentence, so it can wait through pauses instead of interrupting. Replies stream as they are generated: a transcript of what was heard appears immediately, and the response is spoken sentence by sentence while later sentences are still being produced. An optional background-research mode can hand a query to a cloud-based frontier model with web search while the local conversation continues, but stays off, keeping everything on-device, unless a corresponding API key is configured.

It is written in Python, released under the Apache-2.0 license, and documented as an early experiment with expected rough edges.

More in Speech

See all 119
  • ELI v2.0

    geteli.tech

    A private AI assistant and local runtime that runs entirely on the user's own hardware: it holds conversations by voice or text, controls the desktop, reads the screen, writes code, and builds a private model of the user over time.

  • VoiceAssistant

    github.com

    A fully local, full-duplex voice assistant for Windows that lets a user interrupt it mid-sentence and answers using visual context captured from the desktop the instant the user speaks.

  • vibe

    github.com

    A cross-platform desktop application for transcribing audio and video offline using OpenAI's Whisper models on the user's own machine, with an optional OpenAI backend when a user supplies an API key.