Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
Helios is an open-source, real-time long video generation model from PKU-YuanGroup, the team behind Open-Sora Plan. It is a 14B diffusion transformer that achieves minute-scale, high-quality video synthesis at 19.5 FPS on a single H100 GPU (about 10 FPS on a single Ascend NPU). The headline result is notable because Helios reaches this without relying on the conventional long-video anti-drifting strategies or standard video acceleration techniques that most real-time systems depend on.
Most long-video generators fight temporal drift with mechanisms like self-forcing, error banks, keyframe sampling, or inverted sampling. Helios generates minute-scale videos with high quality and strong coherence without any of these, simplifying the pipeline while maintaining consistency over long durations. This makes it a clean baseline for studying long-horizon video generation.
Helios also forgoes the usual acceleration toolbox — no KV-cache, causal masking, sparse or linear attention, TinyVAE, progressive noise schedules, hidden-state caching, or quantization — yet still delivers 19.5 FPS end-to-end on a single H100, with some users reporting over 20 FPS on stronger hardware. Instead, the authors introduce optimizations that raise both training and inference throughput while cutting memory, enabling image-diffusion-scale batch sizes during training and fitting up to four 14B models within 80GB of GPU memory.
Despite its 14B scale, Helios is engineered for accessibility. Group Offloading brings VRAM usage down to roughly 6GB, and Context Parallelism enables multi-GPU inference with Ulysses, Ring, Unified, and Ulysses-Anything attention variants. Community tutorials demonstrate installation on consumer-grade PCs and even 4K video generation, broadening its reach beyond datacenter hardware.
Helios launched with day-0 integration across the generative video ecosystem: Diffusers, SGLang-Diffusion, vLLM-Omni, and Huawei Ascend-NPU, plus Cache-DiT acceleration support. It ships three model variants — Helios-Base (best quality with v-prediction and a custom HeliosScheduler), Helios-Mid, and Helios-Distilled — covering text-to-video, image-to-video, video-to-video, and interactive generation. A Gradio demo, technical report on arXiv, and HuggingFace/ModelScope collections round out the release.
Helios is a strong open-source contribution to real-time long video generation, pairing a genuinely fast inference path with permissive Apache-2.0 licensing and unusually broad framework support. Its willingness to drop common anti-drifting and acceleration tricks makes it both a practical tool and a useful research reference. The main caveats are hardware-dependent performance — real-world FPS varies with CPU, memory, and driver versions — and the fact that H100-class throughput remains out of reach for most consumer setups, where VRAM optimizations trade speed for accessibility.