Back to directory

LIRA: Local Inference tool for Realtime Audio

A CLI-first tool for running and serving automatic speech recognition models locally, with a Ryzen AI NPU backend as well as CPU and GPU, for developers integrating local speech recognition into their own apps.

LIRA: Local Inference tool for Realtime Audio

LIRA is a command-line tool for local, efficient speech recognition. Its lira run command runs, exports or benchmarks a model directly, and lira serve launches an OpenAI-compatible server so applications can call local speech recognition the same way they would call a hosted API.

It supports several ASR model architectures, including different Whisper sizes and the Zipformer streaming encoder, across CPU, GPU and, on AMD Ryzen AI 300 series laptops, NPU acceleration through Vitis AI export artifacts. Installation is a pip-based editable install into a conda environment set up for Ryzen AI.

More in Speech

See all 119
  • ELI v2.0

    geteli.tech

    A private AI assistant and local runtime that runs entirely on the user's own hardware: it holds conversations by voice or text, controls the desktop, reads the screen, writes code, and builds a private model of the user over time.

  • VoiceAssistant

    github.com

    A fully local, full-duplex voice assistant for Windows that lets a user interrupt it mid-sentence and answers using visual context captured from the desktop the instant the user speaks.

  • vibe

    github.com

    A cross-platform desktop application for transcribing audio and video offline using OpenAI's Whisper models on the user's own machine, with an optional OpenAI backend when a user supplies an API key.