Back to directory

franken_ocr

A pure-Rust, CPU-only, memory-safe OCR engine running a small zoo of hand-ported vision-language models, including a DeepSeek-OCR-derived model, a chart-data extractor and a sheet-music transcriber, with no Python, GPU or general ML framework required.

franken_ocr

franken_ocr runs five models through model-specific Rust kernels: Baidu Unlimited-OCR, a DeepSeek-OCR-derived 3B mixture-of-experts vision-language model, is the fast default for document OCR, GOT-OCR2 handles specialized structured formats, SmolVLM2 handles image description and visual question answering, OneChart extracts chart data, and Polyphonic-TrOMR turns scanned sheet-music pages or staff crops into MusicXML.

All models are fetched with focr pull, which verifies each downloaded part by SHA256 before reassembly; inference itself runs offline once weights are present, needing no CUDA, FFI or GPU at inference time. The v0.8.0 release ships raw executables for macOS (Apple Silicon and Intel), Linux (x86-64 and ARM64) and Windows (x86-64 and ARM64), each with a SHA256 sidecar, and the pinned Unlimited-OCR artifact is reported to pass a 20-page corpus budget at a stated aggregate character error rate, with the project explicit that it does not yet meet its own stricter multi-signer governance bar for that claim.

More in Inference

See all 770
  • OpenDecision

    deepanwadhwa.github.io

    An open-source Python package that answers typed questions about application state or documents using a local natural-language-inference model, returning structured choice, score, yes/no or evidence-relation values instead of free text.

  • Lifeboat

    iterate.ai

    A local inference server that puts an OpenAI- and Anthropic-compatible API in front of open-weight language models running on hardware you control, from a laptop to a GPU cluster.

  • Claude S40

    github.com

    An unofficial Claude chat client for 2007-era Nokia Series 40 phones, built as a Java ME app plus a small Go relay server, with web search, reading mode and saved chats.