Back to directory

Local Agents

A Godot 4.5 plugin that runs a local LLM inside a game through a bundled llama.cpp backend, giving an in-game agent node both a text reply and an action a creature or NPC can act on.

Local Agents

Local Agents is a Godot game engine plugin that runs a local large language model inside a game, using llama.cpp as the backend so it runs entirely on the player's machine with no cloud service, API key or internet connection needed. A node loads a .gguf model and produces both a text reply and an action a creature or NPC can act on, so the model can write dialogue live during play and decide what a character does next.

It has three parts: a .gguf model, such as the default quantized Qwen3-4B-Instruct build, a native C++ GDExtension wrapping llama.cpp for text generation, whisper.cpp for transcription and Piper for speech, and the Godot-side plugin itself, which includes the agent node, a memory graph resource and an editor panel for downloading models.

Neither the native extension nor the model is committed to the repository, so a fresh clone needs a downloaded or self-built extension binary plus a model before it will run.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.