Submit a resource

Navigation

Back to directory

Canary

An independent testing service, backed by Y Combinator, that runs an application and tries to break every change an AI coding agent makes, reporting what would have reached production.

Visit website (opens in a new tab)runcanary.ai
Canary

Canary is an independent tester for code written by AI coding agents such as Claude Code, Codex, Cursor, and Copilot. It installs with one line added to a coding agent's setup, then runs the application, exercises each change the agent makes, and tries to break it.

For a given change, Canary reports what it tested, what passed, and what would have reached production unnoticed, alongside the diff the agent produced. It is intended to run alongside an agent's normal workflow rather than replace a human review.

More in Testing

See all 69

  • MoEWatch

    github.com

    A diagnostic and audit library for Mixture-of-Experts models in HuggingFace Transformers that instruments router modules to catch expert collapse, routing entropy collapse and load imbalance during training.

  • Mockwave

    github.com

    An open-source, multi-protocol mock server for HTTP, GraphQL, SOAP, and gRPC, with weighted traffic splitting, dynamic JavaScript responses, chaos-testing fault injection, and an MCP server so an AI assistant can generate mock rules directly.

  • LlamaToaster

    llamatoaster.com

    A benchmarking tool that sweeps llama.cpp settings on your own GPU or CPU to find the fastest configuration for a given model, and compares the result against a shared database of other people's hardware and settings.

Cookies

We use necessary cookies to run the site. Measurement and marketing are optional; neither is used today. Privacy policy