Scrapling
An adaptive Python web scraping framework whose parser relocates elements automatically when a site's markup changes, with fetchers built to get past common anti-bot systems.
Scrapling is a Python web scraping framework that handles everything from a single request to a full crawl. Its parser is built to adapt to website changes, automatically relocating the elements a script targets when a page's structure updates, and its fetchers are designed to get past anti-bot systems such as Cloudflare Turnstile without extra configuration.
A spider framework built into the library scales scraping up to concurrent, multi-session crawls with pause and resume support, automatic proxy rotation, and a crawl speed that adapts to how quickly a target site responds and backs off when the site starts blocking requests. The project ships a command-line interface and an MCP server alongside its Python API, and reports real-time crawl statistics while streaming results.