Scrapling

by D4Vinci · Python · ★ 66,540

View on GitHub ↗

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

#ai#ai-scraping#automation#crawler#crawling#crawling-python#data#data-extraction#mcp#mcp-server#playwright#python#scraping#selectors#stealth#web-scraper#web-scraping#web-scraping-python#webscraping#xpath

Install

pip install git+https://github.com/D4Vinci/Scrapling.git

Auto-generated from the repo's primary language — check the repo's own README for its exact install instructions.

Claude Desktop config

A starting point for your claude_desktop_config.json (auto-generated — the repo's README may specify a published package name or required env vars):

{
  "mcpServers": {
    "scrapling": {
      "command": "uvx",
      "args": [
        "git+https://github.com/D4Vinci/Scrapling.git"
      ]
    }
  }
}

From the README

Effortless Web Scraping for the Modern Web العربيه | Español | Português (Brasil) | Français | Deutsch | 简体中文 | 日本語 | Русский | 한국어 Selection methods · Fetchers · Spiders · Proxy Rotation · CLI · MCP Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl. Its parser learns from website changes and automatically relo…

Read full README on GitHub →

Related other servers

n8n

n8n-io

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

Other · TypeScript

servers

modelcontextprotocol

Official ★ 87,774

Model Context Protocol Servers

Other · TypeScript

chrome-devtools-mcp

ChromeDevTools

Chrome DevTools for coding agents

Other · TypeScript

playwright-mcp

microsoft

Playwright MCP server

Other · TypeScript

xiaozhi-esp32

78

An MCP-based chatbot | 一个基于MCP的聊天机器人

fastmcp

PrefectHQ

🚀 The fast, Pythonic way to build MCP servers and clients.

Other · Python