computeruseprotocol

Computer Use Protocol is a universal schema for AI agents to perceive and interact with any desktop UI.

#accessibility#ai-agents#aria#computer-use#cross-platform#desktop-automation#gui-automation#json-schema#mcp#model-context-protocol#protocol#ui-automation

Install

git clone https://github.com/computeruseprotocol/computeruseprotocol.git

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "computeruseprotocol": {
      "command": "npx",
      "args": [
        "-y",
        "github:computeruseprotocol/computeruseprotocol"
      ]
    }
  }
}

From the README

A universal protocol for AI agents to perceive and interact with any desktop UI. -----|-----------|-------------| | | - | Click/invoke the element | | | - | Collapse an expanded element | | | - | Decrement a slider/spinbutton | | | - | Dismiss a dialog/popup | | | - | Double-click | | | - | Expand a collapsed element | | | - | Move keyboard focus to the element | | | - | Increment a slider/spinbutton | | | - | Long-press (touch/mobile interaction) | | | - | Right-click (context menu) | | | | Scroll container (up/down/left/right) | | | - | Select an item in a list/tre…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related developer tools servers

everything-claude-code

affaan-m

★ 170,676

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Developer Tools · JavaScript