PandaProbe

An open-source agent engineering platform that traces, evaluates and monitors AI agents so a team can debug them together, available as a managed cloud service or self-hosted with Docker.

AI evals

Visit website pandaprobe.com

PandaProbe is an open-source agent engineering platform that helps a team collaboratively trace, evaluate, monitor and debug AI agents. It integrates with agent frameworks including LangGraph, CrewAI and the Claude Agent SDK, among others.

It can be used as a managed cloud service with a free tier, or self-hosted with a single Docker command that starts a Next.js dashboard, a FastAPI application server, Celery worker and scheduler processes, PostgreSQL and Redis. Once running, the dashboard and an API reference are reachable over local ports.

It is built with Python and TypeScript, and is licensed under Apache 2.0.

More in AI evals

See all 269

Provenance gate
github.com
A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.
- Agent skills
- AI evals
JevBench
benchmarkheaven.com
A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.
- AI evals
LIFE FORGE - The Autonomous Flight Simulator for AI Agents
github.com
A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.
- AI evals
- Security

More in AI evals

Provenance gate

JevBench

LIFE FORGE - The Autonomous Flight Simulator for AI Agents

Cookies