Back to directory

Awesome Harness Engineering

A curated list of articles, playbooks, benchmarks, specifications, and open-source projects for harness engineering: shaping the environment around AI agents so they work reliably.

Awesome Harness Engineering

Awesome Harness Engineering is a curated list of resources for harness engineering, defined as the practice of shaping the environment around AI agents so they can work reliably. It sits at the intersection of context engineering, evaluation, observability, orchestration, safe autonomy, and software architecture, and focuses on resources that make agents more dependable in long-running coding and research workflows; generic agent tooling is out of scope unless it directly covers harness design, context management, evaluation, runtime control, or other reliability-critical primitives.

Its sections cover courses and learning resources, context and memory design, constraints and guardrails including tool execution boundaries and security and authorization, specs and agent instruction file formats, evaluation and observability including benchmarks for coding, terminal, web, GUI, and multi-agent tasks, and runtimes and reference implementations spanning sandboxes, coding-agent harnesses, multi-agent orchestration, and browser and MCP tool integration.

More in AI evals

See all 269
  • Provenance gate

    github.com

    A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.

  • JevBench

    benchmarkheaven.com

    A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.

  • A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.