crawl4ai-mcp-server

by sadiuysal · Python · ★ 84

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

#ai-agents#claude-code#crawl4ai#cursor#firecrawl-alternative#mcp#model-context-protocol#openai-agents#openai-agents-sdk#web-crawling#web-scraping

Install

pip install git+https://github.com/sadiuysal/crawl4ai-mcp-server.git

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "crawl4ai-mcp-server": {
      "command": "uvx",
      "args": [
        "git+https://github.com/sadiuysal/crawl4ai-mcp-server.git"
      ]
    }
  }
}

From the README

🕷️ **A lightweight Model Context Protocol (MCP) server that exposes [Crawl4AI](https://docs.crawl4ai.com/) web scraping and crawling capabilities as tools for AI agents.** Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools. - **🔧 MCP Tools**: Exposes 4 powerful tools: , , , via stdio MCP server - **🌐 Web Scraping**: Single-page scraping with markdown extraction - **🕷️ Web Crawling**: Multi-page breadth-first crawling with depth control - **🧠 Adaptive…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related ai & ml servers

n8n

n8n-io

★ 186,228

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

AI & ML · TypeScript

ai-engineering-hub

patchy631

★ 34,421

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

AI & ML · Jupyter Notebook

openfang

RightNow-AI

★ 17,077

Open-source Agent Operating System

AI & ML · Rust

awesome-ai-apps

Arindam200

★ 10,297

A collection of projects showcasing RAG, agents, workflows, and other AI use cases

AI & ML · Python

kreuzberg

kreuzberg-dev

★ 8,159

A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.

AI & ML · Rust

yao

YaoApp

★ 7,538

✨ Build AI agents and web apps — with a single binary.

AI & ML · Go