Testing

An independent testing service, backed by Y Combinator, that runs an application and tries to break every change an AI coding agent makes, reporting what would have reached production.

• Testing

A diagnostic and audit library for Mixture-of-Experts models in HuggingFace Transformers that instruments router modules to catch expert collapse, routing entropy collapse and load imbalance during training.

• Models
• Testing

An open-source, multi-protocol mock server for HTTP, GraphQL, SOAP, and gRPC, with weighted traffic splitting, dynamic JavaScript responses, chaos-testing fault injection, and an MCP server so an AI assistant can generate mock rules directly.

• Testing
• APIs

A benchmarking tool that sweeps llama.cpp settings on your own GPU or CPU to find the fastest configuration for a given model, and compares the result against a shared database of other people's hardware and settings.

• Inference
• Testing

A CLI and GitHub Action that regression-tests RAG pipeline changes against a baseline using paired bootstrap significance tests, blocking a pull request only when a retrieval metric change is statistically real rather than noise.

• RAG
• Testing

A verification layer for AI coding agents working on Apple projects: it runs real Xcode builds and tests against the Swift an agent wrote, reconciles static analysis findings against that evidence, and returns a signed proof with the exact repairs still needed.

• Code quality
• Testing

A desktop app for manually testing MCP servers: connect, browse the tools, resources and prompts they expose, invoke them with real input, and inspect the response.

• MCP servers
• Testing

An offline, account-free desktop API client built with Kotlin and Compose Multiplatform, supporting HTTP requests, streaming, and Model Context Protocol server testing as an alternative to Postman or Insomnia.

• Testing
• APIs

A testing tool for MCP servers that connects over real stdio, SSE or HTTP transport, checks tool responses against YAML-defined assertions, and lints and fuzzes servers for schema and protocol issues.

• MCP servers
• Testing

An agent-driven framework that uses Claude Code sub-agents to iteratively optimize RTL timing, verifying every proposed transformation against the original design with sequential equivalence checking before promoting it.

• Coding agents
• Testing

ChipMATE is a multi-agent framework for generating Verilog RTL code in which a Verilog-writing agent and a Python reference-model agent cross-verify each other's outputs on random test inputs, needing no golden testbench.

• Coding agents
• Testing

A Python library for creating, simulating and formally verifying scenarios with multiple interacting, decision-making agents, such as autonomous vehicles, using hybrid reachability analysis.

• Testing
• Libraries

A distributed swarm of autonomous AI agents that turn open Lean 4 proof obligations into kernel-verified proofs, using the git repository as a work queue and continuous integration as the verification gate.

• Agent frameworks
• Testing

A Model Context Protocol server that lets an AI assistant drive browser and mobile automation through WebdriverIO, controlling Chrome, Firefox, Safari, Electron, iOS and Android through one interface.

• MCP servers
• Testing

An AI-powered auditor that checks an uploaded iOS or Android app package against Apple's and Android's app-store review guidelines before submission, streaming a live report covering safety, performance, business, design, legal and technical issues.

• Testing

A single Swift binary that gives AI agents and end-to-end tests zero-token, on-device computer vision on Apple Silicon, including OCR, pixel-exact UI targeting, and face grouping.

• Testing

A Python package that extracts the accessibility tree of macOS application windows as JSON, with an option to capture matching screenshots that highlight each UI element by type, for accessibility testing, UI automation and visual debugging.

• Testing
• Debugging

An open-source Python library that simulates quantum circuits locally, so quantum programs written for the Amazon Braket SDK can be tested on a laptop before being submitted to the Braket cloud service.

• Testing
• Libraries

An open-source framework for testing and observing multi-agent delegation, tool execution, MCP workflows and permissions, with policy checks, replayable runs and diagrams of who delegated what to whom.

• AI evals
• Testing

An MCP server that gives coding agents a browser they can drive without CSS selectors, for debugging style issues, fixing console errors, mapping a web app's pages, and writing end-to-end tests.

• Testing
• Browser automation

A command-line tool that opens a web page in a real browser, works out a test plan purely mechanically from the controls it finds, drives them, and reports exactly which control broke and how.

• Testing
• Browser automation

A framework for deploying, testing and evaluating pretrained autonomous-driving agents from the CARLA Leaderboard on a vehicle in the CARLA simulator, decoupled from the Leaderboard's own codebase.

• Testing

An open-source mock server that generates a running API from an OpenAPI specification, validating both the spec and every incoming request against it, with optional latency and error simulation.

• Testing
• APIs

A command-line tool that independently reruns a repository's own test commands after an AI coding change, then reports what actually ran and what remains unverified.

• AI evals
• Testing