Back to directory

jevos

jevos is an open-source, self-hosted alternative to a hosted yes/no decision service called Jev: it answers a yes/no question about a piece of text on a laptop CPU in 50 to 220 milliseconds and speaks the same wire format so existing client code keeps working.

jevos

jevos answers yes/no questions about a piece of text on a laptop CPU, returning the probability that the answer is yes in 50 to 220 milliseconds. It is downloaded as a GGUF model file and served locally with a small command-line tool built on llama.cpp, with a context window of 8,192 tokens.

Its HTTP API speaks the same wire format as a hosted service called Jev, so code already written against Jev's SDK works unchanged for yes/no questions, though jevos does not yet support multiple-choice or scored questions. A request can bundle several named yes/no questions against the same input text, which is read once and answered for all of them together, and every response includes a timing header showing the inference time.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.