claude-video-vision

by jordanrendric · TypeScript · ★ 835

Give Claude the ability to watch and understand videos — Claude Code plugin with frame extraction and multimodal audio analysis

#claude-code#claude-code-plugin#ffmpeg#gemini#mcp#mcp-server#multimodal#video-analysis#whisper

Install

npx -y github:jordanrendric/claude-video-vision

Auto-generated from the repo's primary language — check the repo's own README for its exact install instructions.

Claude Desktop config

A starting point for your claude_desktop_config.json (auto-generated — the repo's README may specify a published package name or required env vars):

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "github:jordanrendric/claude-video-vision"
      ]
    }
  }
}

From the README

Give Claude the ability to **watch and understand videos**. A Claude Code plugin that extracts frames via ffmpeg and processes audio via multiple backends (Gemini API, local Whisper, or OpenAI API). Claude receives frames as images and audio transcription with timestamps — the plugin is a **perception layer**, not an interpretation layer. - **Multimodal perception** — Claude sees video frames directly and reads audio transcriptions with timestamps - **YouTube URL support** — Pass a YouTube URL directly; the MCP server downloads it with , preserving source metadata and captions for context -…

Read full README on GitHub →

Related ai & ml servers

gemini-cli

google-gemini

★ 105,607

An open-source AI agent that brings the power of Gemini directly into your terminal.

AI & ML · TypeScript

ruflo

ruvnet

★ 61,807

🌊 The leading agent meta-harness for Claude. Deploy intelligent multi-agent swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning swarm intelligence, RAG integration, and native Claude Code / Codex Integration

AI & ML · TypeScript

context7

upstash

★ 58,210

Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors

AI & ML · TypeScript

JeecgBoot

jeecgboot

★ 46,903

AI 低代码平台「低代码 + 零代码」双驱动！低代码可一键生成前后端代码;零代码可 5 分钟搭建系统;AI Skills 一句话画流程、设计表单、生成整套系统。内置 AI聊天、知识库、流程编排、MCP插件等，兼容主流大模型。引领「AI 生成 → 在线配置 → 代码生成 → 手工合并->AI修改」开发模式，消除 Java 项目 80% 的重复工作，提效而不失灵活。

AI & ML · Java

UI-TARS-desktop

bytedance

★ 37,350

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

AI & ML · TypeScript

gpt-researcher

assafelovic

★ 27,938

An autonomous agent that conducts deep research on any data using any LLM providers

AI & ML · Python