Back to directory

EasyJailbreak

A Python framework for LLM security research that builds and runs jailbreak attacks against language models from reusable components, then scores how well each attack worked.

EasyJailbreak

EasyJailbreak is a Python framework for researchers and developers working on LLM security. It breaks the jailbreaking process into steps: initializing mutation seeds, selecting seeds, adding constraints, mutating, attacking and evaluating, and provides a component for each step.

A run loops through two processes. In mutation, a selector picks the most promising prompts, a mutator transforms them and a constraint filters them. In inference, the prompts are sent to the target model, and an evaluator scores the responses, which feeds the next round of selection.

The project ships attack recipes, reports results for 11 recipes against 10 models, and has API documentation and an accompanying paper. It installs from PyPI, needs Python 3.9 or newer, and is licensed under GPL-3.0.

More in AI evals

See all 269
  • Provenance gate

    github.com

    A deterministic authorization gateway that sits between an AI agent and its tools, tracing where each parameter of a side-effect call came from, and blocking the call or asking a human when the source does not check out.

  • JevBench

    benchmarkheaven.com

    A reproducible benchmark from Benchmark Heaven that ranks Jev-class typed decision models on intelligence, calibration, speed, and cost, with a published harness, scoring rules, and results.

  • A co-evolutionary adversarial red-teaming tool for AI agents that uses quality-diversity evolutionary search to autonomously breed edge-case scenarios, testing whether an agent with tool access can be made to hallucinate, deadlock or leak funds.