Meshy AI open-sourced Overmind, an Apache-2.0 caching library that speeds up repeated from_pretrained loads of transformers and diffusers pipelines. It argues the bottleneck on a warm page cache is memory copying, not disk I/O, so it shares tensor storage by reference via memfd_create and rebuilds it zero-copy in C++.
On a Stable Diffusion pipeline with an RTX 4090, repeat loads fall from ~5.6-6.3s to ~1.1s.





