Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
Qwen-MM-Plugins is Alibaba's official QwenLM answer to a gap almost every coding agent shares: the harness itself is text-only. The repository opened on 29 July 2026 and has drawn 2,529 stars and 139 forks in roughly two weeks, with the one-line pitch printed straight in the description — "make any agent harness multimodal-native." It is Apache-2.0 and written in Python.
The architecture is deliberately not a model release. Each capability installs independently as a Skill plus an optional MCP server, under the install name qwen-mm-plugins-<capability>, so the agent's own skill layer decides which MCP tool to reach for once you reference a file. The practical effect is that you type @meeting.mp4 Transcribe this with speaker labels and timestamps inside whatever harness you already use, and the routing happens without you naming a tool.
Eight capabilities ship today. core reads images and video and visualizes documents, code, data, and 3D files, and it is the one that needs no API key at all — only ffmpeg for audio and video. api exposes Qwen VL/Omni vision, OCR, grounding, ASR, segmentation, and audio-video understanding through DashScope. search covers web search, page extraction, and reverse-image search via Serper, Exa, or Tavily. video-memory builds hierarchical memory for long-video QA, and video-edit handles image, video, and audio generation with editing workflows. The remaining three lean further out: blender for modeling, texturing, lighting, and rendering, freecad for parametric CAD with STEP/STL and FEM via CalculiX, and edu-agent for Chinese math and science explainer videos and interactive pages.
Harness coverage is the reason the project matters more than its star count suggests. The guided installer — a single curl | bash line, with an update variant — natively supports Claude Code, Codex, Qoder, OpenClaw, Qwen Code, and Gemini CLI, using each one's own install command while keeping shared configuration in ~/.qwen-mm-plugins/config. A separate manual guide documents DeepSeek Harness, Hermes Agent, opencode, pi, and QwenPaw, and the most recent merged work on 13 August was precisely that: Hermes Agent support and DeepSeek Harness support landing back to back. Released capabilities use independent, immutable tags, so a rollback targets one capability rather than the whole install. Dependencies arrive on demand through uv/uvx rather than a global Python install.
The caveats are worth stating plainly. Only core is genuinely local — everything interesting in api, video-memory, and video-edit routes through DashScope, Alibaba's cloud, so this is a Qwen-ecosystem play rather than a neutral abstraction layer. Several capabilities also need heavyweight system software installed separately (Blender, FreeCAD, Node/Chromium, ffmpeg, plus Xvfb on headless Linux). The repository carries 15 open issues, has published no tagged GitHub releases at the repo level, and at two weeks old has had no time to prove stability across the eleven harnesses it claims.
hacksider
Real-time AI face swap and one-click video deepfake with only a single image
harry0703
AI-powered short video generator that automates scripting, footage sourcing, subtitles, and composition — supporting 10+ LLM providers and batch production.