Back to directory

AgentInspect

A local-first debugging and CI toolkit for TypeScript AI agents that turns raw execution traces into readable execution trees, deterministic trajectory checks for catching wrong tool paths, and shareable offline evidence bundles.

Visit website (opens in a new tab)agentinspect.vercel.app
AgentInspect

AgentInspect captures a TypeScript agent's run as local JSONL and reuses that one trace for three purposes. For debugging, it renders nested steps, tool calls, model calls, durations, errors, and the first causal failure without sending anything to an external service. For CI, its trajectory checks are deterministic and provider-free -- the same trace and rules always produce the same result -- and can require a specific tool to have been called or fail when an explicit outcome event is recorded; a passing check exits with success and a rule failure exits with an error code. For sharing, dedicated commands produce a reviewable, offline evidence package that can later be checked for integrity.

It works with manual instrumentation, official adapters, or logs already emitted by frameworks like LangChain, LangGraph, or Vercel AI, and needs no account, collector, or default upload.

It installs with npm and is run through its own CLI.

More in Testing

See all 69
  • Canary

    runcanary.ai

    An independent testing service, backed by Y Combinator, that runs an application and tries to break every change an AI coding agent makes, reporting what would have reached production.

  • MoEWatch

    github.com

    A diagnostic and audit library for Mixture-of-Experts models in HuggingFace Transformers that instruments router modules to catch expert collapse, routing entropy collapse and load imbalance during training.

  • Mockwave

    github.com

    An open-source, multi-protocol mock server for HTTP, GraphQL, SOAP, and gRPC, with weighted traffic splitting, dynamic JavaScript responses, chaos-testing fault injection, and an MCP server so an AI assistant can generate mock rules directly.