Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
**llmfit** is a Rust terminal tool that answers a narrow but persistent question for anyone running models locally: *which of these will actually run well on this machine?* It is MIT-licensed, published by **Alex Jones**, and has reached **33,588 stars and 2,099 forks** in the six months since it went public on **15 February 2026**. The current release is **v1.1.10**, shipped on **17 August 2026**, with ten point releases since v1.1.0. The workflow is a single command. `llmfit` opens an interactive TUI that detects the host's RAM, CPU, and GPU/VRAM, then scores every model in its catalog across four dimensions: **memory fit, estimated speed, quality, and context**. A classic CLI mode covers the scripted cases — `llmfit fit` prints the ranked table, `llmfit recommend --json` emits top picks for agents and scripts to consume, `llmfit info "<model>"` breaks down a single model, and `llmfit doctor` dumps a hardware-detection report for bug filing. What distinguishes llmfit from a spec calculator is that it takes **MoE architectures** seriously. The README calls this out directly in its comparison to the alternative tool llm-checker, which treats every model as dense — meaning memory estimates for Mixtral- or DeepSeek-V3-class models reflect total parameter count rather than the much smaller active subset. For a field that has moved decisively toward sparse activation, getting that distinction right is the difference between a useful estimate and a misleading one. llmfit also handles multi-GPU setups and dynamic quantization selection, and it reads live state from local runtime providers: **Ollama, llama.cpp, MLX, Docker Model Runner, and LM Studio**. The more interesting recent direction is **measurement replacing estimation**. Speed numbers come from a memory-bandwidth model grounded in runtime sampling and community measurements, and every estimate ships its inputs — `llmfit info` shows what a number assumes and the exact commands to verify it. On top of that, `llmfit bench` measures real tok/s and TTFT against a running provider, saves the run locally, and can open a PR contributing the result back to the project **from inside the TUI**, with no `gh` CLI and no third-party account. Merged submissions ship in the next release, so anyone on identical hardware sees a measured `✓` instead of an estimate before ever running a benchmark. This is a sensible answer to the credibility problem that dogs hardware-fit tools, though it does mean coverage quality is uneven — popular hardware accumulates real numbers, unusual configurations stay on estimates. Distribution is unusually thorough for a project this young: **scoop** on Windows, **Homebrew** (both a project tap and homebrew-core) and **MacPorts** on macOS/Linux, an install script, `uv tool install` / `uvx`, a **crates.io** package, and a `ghcr.io` container that prints `recommend` JSON by default. Windows release binaries are **Authenticode-signed** through SignPath.io under a SignPath Foundation certificate, with signing restricted to artifacts built by the repository's own GitHub Actions pipeline — a supply-chain detail most tools at this scale skip. The README also states the privacy posture plainly: llmfit contacts external services only when the user invokes a feature that needs one, such as model downloads, provider queries, or the community leaderboard. The main caveat is inherent to the category. A fit score is a prediction, and predictions drift as runtimes, quantization formats, and drivers change underneath them. llmfit's response — publish the assumptions, provide the verification command, and let measured data overwrite the guess — is about as honest as the genre allows, but users chasing an exact throughput figure should still run `llmfit bench` rather than trust the table.