tokio-prompt-orchestrator

by Mattbusel · Rust · ★ 53

Multi-core, Tokio-native orchestration for LLM pipelines.

#agent#async#backpressure#circuit-breaker#deduplication#llm#llm-inference#mcp#model-context-protocol#multi-agent#orchestration#production#rate-limiting#rust#tokio

Install

cargo install --git https://github.com/Mattbusel/tokio-prompt-orchestrator.git

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "tokio-prompt-orchestrator": {
      "command": "npx",
      "args": [
        "-y",
        "github:Mattbusel/tokio-prompt-orchestrator"
      ]
    }
  }
}

From the README

[](https://github.com/Mattbusel/tokio-prompt-orchestrator/actions/workflows/ci.yml) [](https://codecov.io/gh/Mattbusel/tokio-prompt-orchestrator) [](https://crates.io/crates/tokio-prompt-orchestrator) [](https://docs.rs/tokio-prompt-orchestrator) [](https://mattbusel.github.io/tokio-prompt-orchestrator/tokio_prompt_orchestrator/) [](https://www.rust-lang.org/) [](LICENSE) **Production-grade, multi-core Tokio orchestration for LLM inference pipelines.** Five-stage bounded-backpressure DAG with deduplication, circuit breakers, rate limiting, **prompt injection/jailbreak detection**, **provider…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related developer tools servers

everything-claude-code

affaan-m

★ 170,676

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Developer Tools · JavaScript