Back to directory

AI Hardware Fit

A free, browser-based calculator, in Korean and English, that estimates which local AI models a given GPU can run, or which GPUs a chosen model needs, along with quantization and speed estimates, with no install, sign-up or server-side processing.

AI Hardware Fit

AI Hardware Fit lets a user either pick a GPU and see which local language, vision-language, embedding or reranking models it can run along with a recommended quantization and estimated speed, or start from a model and compare candidate GPUs against a VRAM, budget or power constraint. A separate infrastructure-sizing mode turns a described service, such as an internal document RAG system or a customer chatbot with a given number of users and concurrent requests, into a suggested server configuration, a total cost of ownership estimate and a proof-of-concept checklist.

All calculations run inside the browser rather than on a server, and the project states plainly that it does not provide guaranteed automatic quotes or performance guarantees, intending it to support pre-sizing, comparison and hypothesis-building ahead of a real proof of concept. Additional calculators cover estimated API costs and the one-time cost of structuring a set of documents into an ontology or knowledge graph using an LLM.

It is written in JavaScript and released under the MIT license.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.