Back to directory

whatcanirun

A website and command-line tool for finding which large language models will run well on your own hardware, backed by community-submitted benchmark results.

whatcanirun

whatcanirun helps you find AI models that run locally on your own hardware and benchmark them. The whatcani.run website lets you browse models, filter by device, and view benchmark results submitted by the community, while the whatcanirun CLI, published on npm as wcir, runs standardized local LLM benchmarks on your machine and can submit the results back to the site.

The project is a monorepo built with Bun and Turborepo, split into a Next.js web app, the CLI benchmarking tool, and a shared package of types, schemas, and utilities. The CLI exposes run, show, and submit commands for running a benchmark, inspecting device or model information, and uploading a saved results bundle.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.