webclaw

by 0xMassi · Rust · ★ 1,593

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

#ai#ai-agents#ai-scraping#cli#crawler#data-extraction#firecrawl-alternative#html-to-markdown#llm#markdown#mcp#mcp-server#rag#rust#self-hosted#tls-fingerprinting#web-crawler#web-extraction#web-scraper#web-scraping

Install

cargo install --git https://github.com/0xMassi/webclaw.git

Auto-generated from the repo's primary language — check the repo's own README for its exact install instructions.

Claude Desktop config

A starting point for your claude_desktop_config.json (auto-generated — the repo's README may specify a published package name or required env vars):

{
  "mcpServers": {
    "webclaw": {
      "command": "npx",
      "args": [
        "-y",
        "github:0xMassi/webclaw"
      ]
    }
  }
}

From the README

webclaw Turn websites into clean markdown, JSON, and LLM-ready context. CLI, MCP server, REST API, and SDKs for AI agents and RAG pipelines. The fastest way to connect webclaw to Claude Code, Claude Desktop, Cursor, Windsurf, OpenCode, Codex CLI, and other MCP-compatible tools: The installer detects supported clients and configures the MCP server for you. Download macOS, Linux, and Windows binaries from [GitHub Releases](https://github.com/0xMassi/webclaw/releases). If building from source fails because native build tools are missing, install the platform…

Read full README on GitHub →

Related ai & ml servers

gemini-cli

google-gemini

★ 105,607

An open-source AI agent that brings the power of Gemini directly into your terminal.

AI & ML · TypeScript

ruflo

ruvnet

★ 61,807

🌊 The leading agent meta-harness for Claude. Deploy intelligent multi-agent swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning swarm intelligence, RAG integration, and native Claude Code / Codex Integration

AI & ML · TypeScript

context7

upstash

★ 58,210

Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors

AI & ML · TypeScript

JeecgBoot

jeecgboot

★ 46,903

AI 低代码平台「低代码 + 零代码」双驱动！低代码可一键生成前后端代码;零代码可 5 分钟搭建系统;AI Skills 一句话画流程、设计表单、生成整套系统。内置 AI聊天、知识库、流程编排、MCP插件等，兼容主流大模型。引领「AI 生成 → 在线配置 → 代码生成 → 手工合并->AI修改」开发模式，消除 Java 项目 80% 的重复工作，提效而不失灵活。

AI & ML · Java

UI-TARS-desktop

bytedance

★ 37,350

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

AI & ML · TypeScript

gpt-researcher

assafelovic

★ 27,938

An autonomous agent that conducts deep research on any data using any LLM providers

AI & ML · Python