Back to directory

Camelid

A Rust-native local inference application for chat, file work, and coding with GGUF models on your own hardware, shipping as a single binary with a desktop app, browser UI, terminal, and OpenAI-compatible API, and no Python or Node.js at runtime.

Camelid

Camelid packages a language-model inference engine and its web UI into one Rust binary, using Metal on Apple Silicon, CUDA on supported NVIDIA setups, or CPU fallback elsewhere, and validates supported model files and quantizations against a pinned llama.cpp reference with documented limits per configuration. Everyday chat supports streaming replies with markdown, code highlighting, math, and diagrams, editing and resending messages, and organizing conversations into projects with shared instructions and reference files.

Its code-in-chat feature works in a local project with a live plan, read-only helper agents, individually approved commands and checks, and a managed local preview server for Chrome, with the ability to pause, steer, queue a follow-up, or return to a saved session. Local or remote MCP servers can be connected with tool choice and approval per conversation, and a web-research mode does research with sourced replies.

It also offers a mobile-browser chat mode where inference stays on the desktop machine while the phone acts as a thin client, and runs entirely offline once model files are downloaded.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.