Back to directory

Horizon

A verification-first layer for local LLMs that adds hard test execution, symbolic math checking, and an agentic repair loop on top of a small open-weight model, aiming to match a much larger teacher model's accuracy on checkable tasks.

Horizon

Horizon is a research project arguing that the model itself is not the differentiator for local coding assistance; the verification layer around it is. It wraps an open-weight language model running on a 16 gigabyte consumer machine with a metacognitive router, an execution harness that runs sandboxed tests and symbolic math checks, best-of-N answer selection, and an agentic repair loop for code, so that every answer ships with evidence that it was actually tested rather than only generated.

On tasks where correctness can be mechanically checked, such as code with tests or verifiable math problems, the project reports a 7-billion-parameter model reaching parity with, and on a newer base model exceeding, its own 671-billion-parameter teacher model on a code-generation benchmark, while running at about 13 tokens per second on ordinary desktop hardware. The layer is training-free at inference time and is designed to reapply to any open base model without modification, so results are also replicated across additional model families.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.