Back to directory

Future AGI

An open-source, self-hostable platform for evaluating, tracing, simulating and guarding LLM and AI agent applications in one feedback loop, with a low-latency Go gateway and OpenTelemetry-native observability.

Future AGI

Future AGI is an open-source platform for the full lifecycle of shipping AI agents: simulating edge cases before launch, evaluating what happens once an agent is in production, protecting users with runtime guardrails, monitoring live behavior, and feeding every trace back as a signal for the next version, instead of stitching together separate tracing, evaluation and guardrail tools.

Its core is Apache-2.0 licensed and every evaluator, prompt and trace is inspectable rather than a black-box score, and a project's own tracing, evaluation or guardrail stack can be dropped in at any layer through OpenTelemetry or an OpenAI-compatible HTTP interface. Its gateway is written in Go for low-latency, high-throughput routing, and traces are OpenTelemetry-native with instrumentors for more than fifty frameworks.

It can be used as a managed cloud service with a free tier and SOC 2 Type II and HIPAA compliance, installed in Python with a single package, or self-hosted with Docker Compose using published images. It is written in Python and released under the Apache-2.0 license.

More in AI evals

See all 269
  • Provenance gate

    github.com

    A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.

  • JevBench

    benchmarkheaven.com

    A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.

  • A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.