Back to directory

Binex

An open-source, local runtime for debugging AI agent workflows built as DAG pipelines, with tracing, replay and artifact lineage rather than a framework for building agents.

Binex

Binex is a local, open-source runtime for AI agent workflows built as directed acyclic graph pipelines. Rather than a framework for building agents, it focuses on what happens after a pipeline runs: tracing every step, tracking per-call cost, comparing runs, replaying and stepping back through a pipeline, and catching regressions against a saved golden run.

It ships a visual editor and a command-line interface, supports any model through LiteLLM including OpenAI, Anthropic, Google, Ollama, OpenRouter and DeepSeek, and can attach its observer to an existing LangChain, CrewAI or AutoGen pipeline to add the same debugging without migrating away from those tools. It installs from pip, with optional extras for LangChain, CrewAI, AutoGen, OpenTelemetry tracing and a colored CLI, and can also run in Docker.

More in AI evals

See all 269
  • Provenance gate

    github.com

    A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.

  • JevBench

    benchmarkheaven.com

    A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.

  • A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.