LitServe Examples
A collection of self-contained example applications that show how to deploy AI models at scale with Lightning AI's LitServe model-serving engine.
LitServe Examples packages self-contained applications demonstrating how to deploy AI models with LitServe, from speech recognition to multimodal LLMs, with each example living in its own folder alongside its own complete setup guide. Speech and audio examples cover a Whisper speech-recognition API, a Parler text-to-speech API, and a Chatterbox TTS example with voice cloning and emotion control, alongside separate examples for conversational AI and multimodal LLMs.
Each example demonstrates LitServe's built-in request batching, streaming and auto-scaling, aimed at handling many concurrent requests with a small amount of serving code. A typical example is started by installing its requirements and running its server script, which exposes a local HTTP API that can be tested immediately with a simple request.