Testing

A snapshot-testing tool for AI agents that records the tools an agent calls, in what order and with what output, then flags any drift from that recorded baseline in CI, working with LangGraph, CrewAI, OpenAI Assistants and Anthropic-based agents.

• AI evals
• Testing

An autonomous system that pairs coverage-guided fuzzing with LLM agents to find, verify and patch vulnerabilities in open-source projects, built on the OSS-Fuzz toolchain.

• Testing
• Security

A cross-platform desktop app for building, testing and validating MCP tools in a controlled local sandbox before exposing them to an agent, backed by a built-in MCP server, an agentic chat interface with RAG and human-in-the-loop approval, and detailed observability dashboards.

• MCP servers
• Testing

An open-source, generic MCP client for testing and evaluating MCP servers and agents from an interactive command-line or web chat interface.

• MCP servers
• Testing

A GitHub Action that turns natural-language test steps written in a pull request description into generated, executed, and committed Playwright test code, using multi-agent orchestration.

• Testing
• CI/CD

A Harbor-compatible framework for evaluating coding agents such as Claude Code, Codex and Cursor CLI in sandboxed Docker or Modal environments, with support for installing agents in air-gapped tasks and a trajectory viewer.

• AI evals
• Testing

A single Rust binary that tracks a project's specification as a flat list of atomic, taggable claims, some backed by a shell command, so an AI coding agent and a developer can verify what is actually built.

• CLI tools
• Testing

A Python tool that runs, mocks, and tests fake Snowflake databases locally, either by patching the Snowflake connector in-process or by running a standalone HTTP server for any language.

• Testing
• Databases

A free, open-source coding pipeline that turns a ticket into a reviewed pull request on your machine: it plans before writing code, has a second model adversarially review the result, and will not claim a fix works unless its tests fail on the old code and pass on the new one.

• Coding agents
• Testing

An MIT-licensed MCP server that lets AI assistants like Claude Code, Cursor, and GitHub Copilot operate directly inside a running Unity Editor project, creating scenes, generating scripts, and driving play-mode testing from a single prompt.

• MCP servers
• Testing

An AI QA agent for VS Code that reads a pull request's diff, generates a test plan, opens a real browser to click through the app, and reports whether the change is safe to merge.

• Testing

A local-first debugging and CI toolkit for TypeScript AI agents that turns raw execution traces into readable execution trees, deterministic trajectory checks for catching wrong tool paths, and shareable offline evidence bundles.

• Testing
• Debugging

A command-line tool that turns a plain-English objective into a real Chrome browser automation run and returns structured results, used both as a standalone browser automation CLI and as a validation layer AI coding agents call to check their own work in a real browser.

• Testing
• Browser automation

Dropshots is a Gradle plugin and library that runs Android screenshot assertions on-device, inside your instrumentation tests, instead of pulling screenshots to a host machine for separate comparison.

• Testing

The Lean CLI is a cross-platform command-line tool for developing, backtesting, debugging and optimizing trading-strategy code against the open-source LEAN engine, locally or in the cloud.

• CLI tools
• Testing

An MCP skill that turns video, audio and screen recordings into searchable, timestamped evidence for AI agents, and checks a frozen contract of file digests, JSON values, SQL or HTTP results by a separate process rather than by model opinion.

• Agent skills
• Testing

A single MCP server that gives an AI agent eyes and hands inside a running app, driving end-to-end tests by natural language across ten platforms including Flutter, React Native, iOS, Android, Electron and the web.

• MCP servers
• Testing

A collection of installable AI-agent skills that teach coding assistants like Claude Code, Copilot, Cursor, and Gemini CLI to write and run test automation code against TestMu AI's cloud of real devices and browsers.

• Agent skills
• Testing

A pytest-native framework for writing and running safety and security tests against agentic AI applications, covering adversarial attacks, benign failures, and a range of harm categories with evaluation-driven assertions.

• Testing
• Security

A testing library that generates and runs more than 60 kinds of tests for NLP and LLM models, covering robustness, bias, fairness, toxicity and factuality, with automatic training-data augmentation.

• AI evals
• Testing

A benchmark suite comparing the runtime performance of dozens of TypeScript data-validation and parsing libraries, such as zod, valibot, ArkType, and io-ts, run in isolated Node.js processes.

• Testing
• Curated lists

A self-improving QA test harness that runs natural-language test scripts for web and mobile apps, re-observing the interface to recover from failed steps and building memory across runs to catch regressions.

• Testing

A single-package mock server for AI application testing that answers deterministically for LLM APIs, MCP, A2A, AG-UI, vector databases and search services on one local port, with record-and-replay of real API traffic.

• Testing

A benchmarking tool for vector databases and cloud vector search services, covering insertion, vector search, filtered search and full-text search under one visual interface.

• Testing
• Databases