Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
VGGT (Visual Geometry Grounded Transformer) is a feed-forward 3D reconstruction model from the University of Oxford's Visual Geometry Group and Meta AI, and it won the Best Paper Award at CVPR 2025. Now past 13,000 GitHub stars, it does something that classical 3D pipelines cannot: given one, a few, or even hundreds of images of a scene, a single forward pass of the network directly predicts the full set of 3D attributes — camera intrinsics and extrinsics, depth maps, dense point maps, and 3D point tracks — in a matter of seconds. There is no per-scene optimization loop, no bundle adjustment, and no hand-tuned matching stage. That combination of accuracy and speed is why VGGT has become one of the most talked-about open releases in 3D computer vision. ## Feed-Forward 3D From Images Traditional structure-from-motion and multi-view stereo systems such as COLMAP reconstruct geometry through slow, iterative optimization: detect features, match them across images, and then solve a large non-linear problem to recover cameras and 3D points. VGGT replaces that entire pipeline with one transformer. The model is trained to infer geometry end-to-end, so inference is a single deterministic pass rather than an optimization that can take minutes or hours. For many scenes this turns a multi-minute reconstruction into a few seconds on a single GPU. ## What The Model Predicts VGGT is unusually comprehensive for a single network. In one shot it outputs extrinsic and intrinsic camera parameters for every input view, per-view depth maps, dense point maps that place pixels in a shared 3D space, and 3D point tracks that follow the same physical point across images. Because all of these are produced jointly and consistently, downstream tasks — novel-view synthesis, camera pose estimation, dense reconstruction, and tracking — can draw from a single coherent prediction instead of stitching together separate specialized models. ## Speed, Scale, and VGGT-Omega The flagship VGGT-1B checkpoint carries roughly a billion parameters and handles anywhere from a single image to hundreds of views. In May 2026 the team released VGGT-Omega, the next step of the project, alongside an implementation fix that stopped keeping redundant intermediate tensors in memory; with the same GPU memory budget, VGGT can now process roughly 2-3x more input frames. The repository also ships training code and an example for fine-tuning on a custom dataset, so the model is a starting point for research rather than a closed demo. ## Ecosystem Fit VGGT is designed to slot into existing 3D workflows. A helper script exports predictions in COLMAP format, with optional bundle adjustment, and those files can be fed directly into gsplat and other NeRF or Gaussian splatting libraries. A Hugging Face Space provides an interactive demo, and the API is deliberately small — a few lines of PyTorch load the model and run a batch of images. This makes VGGT attractive both as a fast front-end for Gaussian splatting pipelines and as a research baseline for feed-forward geometry. ## Trade-offs and Limitations The biggest caveat is licensing. VGGT ships under a custom Meta research license rather than a permissive one. As of July 2025 the code is commercial-use-friendly (excluding military applications), but only the separately released VGGT-1B-Commercial checkpoint is licensed for commercial use — the original checkpoint remains non-commercial, and access to the commercial weights requires completing an application processed through a LLaMA-style approval workflow. Practically, the model also needs a capable NVIDIA GPU, and reconstructing very large image sets still pushes memory limits despite the recent efficiency improvements. As with any learned reconstruction system, results should be validated on your own imagery before relying on them. ## Who Should Use This VGGT is a strong fit for computer-vision researchers, 3D and graphics engineers building Gaussian splatting or NeRF pipelines, and anyone who needs fast camera-pose and depth estimation without standing up a full SfM stack. Its CVPR Best Paper pedigree, feed-forward speed, COLMAP-compatible export, and available training code make it one of the most practical open foundations for modern 3D reconstruction — as long as your use case fits within its checkpoint licensing.
graphdeco-inria
Original reference implementation of 3D Gaussian Splatting for real-time radiance field rendering
ahujasid
Connect Blender to Claude AI via MCP for natural-language-driven 3D scene creation and manipulation.
Tencent Hunyuan
Tencent's open-source diffusion system that turns a single image or text prompt into high-resolution, textured 3D assets.