crawlbase-mcp

by crawlbase · JavaScript · ★ 54

Crawlbase MCP Server connects AI agents and LLMs with real-time web data. It powers Claude, Cursor, and Windsurf integrations with battle-tested web scraping, JavaScript rendering, and anti-bot protection enabling structured, live data inside your AI workflows.

#ai-agents#crawlbase#crawlbase-mcp#llm-integration#mcp#mcp-server#model-context-protocol#real-time-web-data#web-scraping

Install

npx -y github:crawlbase/crawlbase-mcp

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "crawlbase-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "github:crawlbase/crawlbase-mcp"
      ]
    }
  }
}

From the README

Crawlbase MCP is a Model Context Protocol (MCP) server that bridges AI agents and the live web. Instead of relying on outdated training data, your LLMs can now fetch fresh, structured, real-time content — powered by Crawlbase’s proven crawling infrastructure trusted by 70,000+ developers worldwide. It handles the complexity of scraping for you: - JavaScript rendering for modern web apps - Proxy rotation & anti-bot evasion - Structured outputs (HTML, Markdown, screenshots) - Get Free Crawlbase Tokens → Sign up at [Crawlbase ↗️](https://crawlbase.com/signup?utm_source=github&utm_medium=readme…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related developer tools servers

everything-claude-code

affaan-m

★ 170,676

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Developer Tools · JavaScript