Back to directory

MLX-Audio

An audio-processing library built on Apple's MLX framework for fast text-to-speech, speech-to-text, speech-to-speech and music generation on Apple Silicon.

MLX-Audio

MLX-Audio is an audio-processing library built on Apple's MLX framework, providing text-to-speech, speech-to-text, speech-to-speech and music generation with inference optimized for Apple Silicon's M-series chips.

It supports multiple model architectures across these tasks, multilingual voices, voice customization and cloning, and adjustable speech speed, alongside an interactive web interface with 3D audio visualization and an OpenAI-compatible REST API. Model weights can be quantized to 3, 4, 6 or 8 bits for smaller and faster inference, and a Swift package integrates it into iOS and macOS apps.

It installs with pip or uv, and can be used from the command line or from a Python API that loads a model and generates audio from text.

More in Speech

See all 119
  • ELI v2.0

    geteli.tech

    A private AI assistant and local runtime that runs entirely on the user's own hardware: it holds conversations by voice or text, controls the desktop, reads the screen, writes code, and builds a private model of the user over time.

  • VoiceAssistant

    github.com

    A fully local, full-duplex voice assistant for Windows that lets a user interrupt it mid-sentence and answers using visual context captured from the desktop the instant the user speaks.

  • vibe

    github.com

    A cross-platform desktop application for transcribing audio and video offline using OpenAI's Whisper models on the user's own machine, with an optional OpenAI backend when a user supplies an API key.