Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
**AI-Infra-Guard** (A.I.G) is an **Apache-2.0** AI red teaming platform from **Tencent's Zhuque Lab**, sitting at **5,530 stars and 521 forks** with the current release **v4.5.2** shipped on **17 August 2026**. Where most AI security tooling picks one layer — prompts, or dependencies, or the model itself — A.I.G's premise is that the attack surface of a deployed AI system now spans all of them at once, and tries to cover the whole stack from a single Docker deployment reachable at `localhost:8088`. Six scanners sit behind that interface. **AI infra vulnerability scan** fingerprints over **100 AI framework components** — Ollama, ComfyUI, vLLM, n8n, Triton Inference Server among them — against a library that v4.5.2 expanded past **2,000 CVE rules**. **MCP Server & Agent Skills scan** covers 14 categories of risk and works from either source code or a remote URL. **Agent Scan** is a separate multi-agent framework for evaluating agent workflows, with support for agents running on Dify and Coze. **ClawScan** targets OpenClaw deployments for insecure configuration, Skill risks, CVEs, and privacy leakage. **Jailbreak Evaluation** runs curated attack datasets with cross-model comparison, and v4.5.1 added four multi-turn attack methods — Many-Shot, PAIR, GOAT, and ActorAttack. A **Model and API Relay Checker** rounds it out with model fingerprinting, Claude Signature verification, and black-box relay auditing. The most substantive piece is the **Skill scanner**, which reflects how quickly agent skills became a real supply-chain surface. `aig-skill-scan` installs as a plain `pip` package and is built to drop into CI/CD, classifying findings against the **SkillTrustBench T01–T09** taxonomy across five layers: instruction and memory attacks (skill instruction hijacking, memory poisoning), code execution (remote payload download, embedded malicious code), system privilege (escalation, persistence), toolchain and dependencies (tool hijacking, insecure dependencies), and skill code quality. Because the scanner is LLM-driven, the README publishes its **SkillTrustBench** numbers per backing model rather than a single headline score — Claude Opus 4.6 leads on F1 at **0.9848** with **0.9974** recall but a **0.0663** false-positive rate, while Gemini 3.5 Flash trades recall (0.9641) for far better precision (0.9947) and a **0.0120** FPR. That FPR spread is the number to plan around: the highest-recall configuration is also the noisiest in a CI gate. The project is not new — it dates to December 2024 — but the last two releases show where the effort is going, and it is squarely toward agent-era threats rather than classic infrastructure CVEs. v4.5.2 added **.pyc bytecode bypass detection** and charset smuggling defense to Skill-Scan, plus RCE prevention through tool whitelisting in MCP-Scan's dynamic mode. v4.5.0 open-sourced the frontend, split Skill/MCP/Agent scanning into **standalone CLIs**, and launched an AI Security Skill Market. A.I.G has been presented at **Black Hat EU 2025 Arsenal**, and ships packaged skills on ClawHub so the scanners can be invoked from inside an agent workflow. Two constraints deserve emphasis before deployment. First, the maintainers state plainly that A.I.G is positioned for **internal enterprise or individual use, currently lacks an authentication mechanism, and should not be exposed on public networks** — an unauthenticated scanner reachable from the internet is itself a liability. Second, the Skill scanner requires an `LLM_API_KEY` and sends the scanned skill to a model provider, which is a meaningful consideration for proprietary code. There is also a Pro tier at aigsec.ai behind an invitation code, so the open-source build is not the full product, though the free version is genuinely comprehensive rather than a stripped demo.