Submit a resource

Navigation

Back to directory

Bodhi App

A macOS app that runs open-source large language models locally through llama.cpp, offering both an OpenAI-compatible API for developers and a built-in chat UI for non-technical users.

Visit website (opens in a new tab)getbodhi.app
Bodhi App

Bodhi App runs open-source large language models locally, using the Hugging Face ecosystem to discover and download GGUF model weights and llama.cpp to run them. It targets both technical and non-technical users: developers get OpenAI-compatible chat completions and models API endpoints with OpenAPI documentation and a built-in SwaggerUI for exploring and testing endpoints live, while non-technical users get a built-in chat interface for getting started quickly.

It manages downloaded GGUF models from Hugging Face, generates and manages API tokens for external integrations, and lets a user adjust application settings such as the execution variant and idle timeout on the fly, with a responsive layout across desktop and mobile.

It is currently released for macOS, installable from a GitHub release or via Homebrew.

More in Inference

See all 770

  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.

Cookies

We use necessary cookies to run the site. Measurement and marketing are optional; neither is used today. Privacy policy