LocalAI

by mudler · Go · ★ 45,946

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

#agents#ai#api#audio-generation#decentralized#distributed#image-generation#libp2p#llama#llm#mamba#mcp#musicgen#object-detection#rerank#stable-diffusion#text-generation#tts

Install

go install github.com/mudler/LocalAI@latest

Claude Desktop config

Add this to your claude_desktop_config.json:

{
  "mcpServers": {
    "localai": {
      "command": "npx",
      "args": [
        "-y",
        "github:mudler/LocalAI"
      ]
    }
  }
}

From the README

**LocalAI** is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. - **Drop-in API compatibility** — OpenAI, Anthropic, ElevenLabs APIs - **36+ backends** — llama.cpp, vLLM, transformers, whisper, diffusers, MLX... - **Any hardware** — NVIDIA, AMD, Intel, Apple Silicon, Vulkan, or CPU-only - **Multi-user ready** — API key auth, user quotas, role-based access - **Built-in AI agents** — autonomous agents with tool use, RAG, MCP, and skills - **Privacy-first** — your data never leaves your infrastructure Created and maintained by [Ett…

Read full README on GitHub →

💡 Need a managed MCP host?

Try Claude Pro for the smoothest MCP experience, or browse our cloud-hosted servers.

Related developer tools servers

everything-claude-code

affaan-m

★ 170,676

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

Developer Tools · JavaScript