Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
TurboFieldfare runs Google's instruction-tuned Gemma 4 26B-A4B in about 2 GB of RAM on any Apple Silicon Mac, including 8 GB machines, by never loading the full model at all. The repository has collected 6,162 stars and 371 forks since its 17 July 2026 creation and was last pushed on 18 August 2026. It is an independent research project by Andrey Mikhaylov, an iOS and Metal engineer, and the README states plainly that it is not affiliated with, sponsored by, or endorsed by Google — the model is Google's, the runtime is not.
The mechanism is expert streaming rather than compression alone. The installed model occupies about 14.3 GB on disk, of which TurboFieldfare keeps only the shared 1.35 GB core plus an FP16 KV cache resident, then streams from SSD only the experts a given token actually routes to. Gemma 4 26B-A4B has 26B total parameters with roughly 3.88B active per token, which is what makes the trade viable. Weights are MLX affine 4-bit at group 64, with an 8-bit router and 4-bit shared and routed experts.
Per layer, Metal computes attention and the router from resident weights; the CPU takes the router's top-8 expert IDs and plans against that layer's 16-slot LFU cache, filling misses with bounded parallel pread calls straight into Metal-visible buffers. While those reads are in flight Metal computes the resident shared-expert branch, then combines the shared and routed outputs. Prompt prefill runs in chunks of up to 128 tokens so one fetched expert can serve multiple rows. KV storage is FP16, using bounded circular storage for 25 sliding-window layers and linear storage for 5 full-attention layers.
The published numbers are measured rather than projected, and the README frames them as reference points rather than ceilings: 5.1–6.3 tok/s decode on an 8 GB M2 MacBook Air and 31–35 tok/s on a 24 GB M5 Pro, with a community benchmark guide for contributing results from other machines. Behind that sits an unusually disciplined evidence trail — a curated experiment record of 103 measured results across kernels, caching, I/O, prefill and decode, including the plausible ideas that failed and the early results that reversed under stronger validation.
The Swift package exposes six products: the runtime library, a native SwiftUI/AppKit Mac app, a one-shot decode service, a CLI, a loopback OpenAI-compatible Chat Completions server, and a streaming installer. The installer is itself part of the memory story — it never materializes the full source checkpoint, instead streaming byte ranges from a pinned Hugging Face revision and repacking them directly into the .gturbo layout as they arrive, accepting the result only after manifest and file hashes validate.
The scope limits are strict and clearly stated. It is model-specific rather than a wrapper around MLX or llama.cpp, so it runs the pinned Gemma 4 26B-A4B checkpoint and nothing else. It requires macOS 26 with Metal 4, Swift 6.2 and Xcode 26, is arm64-only, and does not support older macOS or Metal versions. It is text-only — no images, audio or video — and the app and CLI neither expose nor execute tools, though the loopback server will return model-produced tool calls for a client to authorize. That server has no remote authentication or TLS and is meant to stay on loopback. Licensed Apache-2.0, with model weights downloaded separately and governed by their own terms.