fastCRW
A Rust command-line tool and API that turns URLs into clean markdown or structured JSON for search, scrape, map, crawl and extract operations, runnable locally or through a managed cloud service.
fastCRW is a web crawling and extraction tool, implemented as a small Rust binary, that turns URLs into markdown, HTML, links, screenshots or schema JSON. Its five operations are scrape for a single URL, crawl for a bounded site crawl, map to discover URLs without scraping every page, search the web with optional scraping of results, and extract to pull structured fields from one or more URLs.
It installs with a single shell command and runs locally at no cost with no account required, or connects to a managed cloud service for proxying, JavaScript rendering and search when given an API key; Claude Code, Cursor, Codex, Gemini CLI, OpenCode and Windsurf are configured with its MCP server automatically when already present. It is available for macOS and Linux on Intel and ARM, with a Python SDK for the cloud service.