Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
Speech Swift packages a large catalog of speech models as native Swift libraries for Mac and iOS, running entirely on-device through MLX Swift and CoreML — no cloud, no API keys, no data leaving the machine. It is Apache-2.0, published by the soniqo organization, and has reached 1,139 stars and 151 forks since going public on 4 February 2026. Releases ship at a rapid clip, with v0.0.26 on 17 August 2026 following two more in the preceding day.
The transcription lineup is the strongest part of the catalog. It spans Qwen3-ASR (52 languages, MLX and CoreML), Whisper Large-v3 Turbo through a native CoreML runtime on the Neural Engine, Parakeet TDT (NVIDIA FastConformer with a TDT decoder, 25 languages), Cohere Transcribe 2B, Voxtral Mini 3B, and Meta's Omnilingual ASR covering 1,672 languages across 32 scripts. MOSS Transcribe Diarize does offline transcription with model-generated speaker labels and timestamps at a 128K MLX context. Two NVIDIA Nemotron streaming variants handle low-latency ASR with native punctuation and capitalization — a multilingual build at 40 language-locales and a smaller English-only one. The project publishes real-time-factor figures per model rather than a single headline number: Omnilingual ASR at 0.28 RTF on an iPhone 16 Pro, Voxtral Mini at 0.074 RTF on an M5 Pro, and streaming dictation at 0.04 RTF on an iPhone 16 Pro.
Coverage extends well past recognition. TTS includes Qwen3-TTS, CosyVoice, VoxCPM2, IndexTTS2, F5-TTS, Higgs TTS 3, Kokoro, VibeVoice, Magpie, Supertonic, Chatterbox, OmniVoice, Indic-Mio, and Sesame CSM. There are speech-to-speech and voice-agent paths (Hibiki Zero-3B streaming translation, PersonaPlex 7B full-duplex, VoiceChat 11B), on-device LLM and translation modules (Qwen3Chat, FunctionGemma for tool calls, MADLAD-400 across 400+ languages), enhancement and separation (DeepFilterNet3, LocalVQE AEC, HTDemucs and Open-Unmix source separation, FlashSR super-resolution), music generation via MAGNeT and Stable Audio 3, and a full turn-detection stack of wake word, VAD, diarization, and speaker embeddings. NVIDIA's Audio2Face-3D even drives avatar facial animation from speech.
Two structural choices make this practical rather than merely broad. Every model is its own SPM library, so importing only what you need avoids paying for the rest of the catalog in binary size — a real concern for an iOS app. And there is a genuine CLI alongside the Swift API: brew install speech gives speech transcribe, speech speak, speech translate, speech respond, speech voice-chat, and a speech-server exposing OpenAI-compatible /v1/realtime and /v1/audio/transcriptions endpoints locally. Model weights download from HuggingFace on first use and cache locally, with an offlineMode flag on every fromPretrained() entry point once cached. The README lists 16 public repositories with verifiable package references, including AnythingLLM.
The limits follow directly from the design. This is Apple Silicon only — Homebrew installation requires native ARM Homebrew, and Rosetta or x86_64 Homebrew is explicitly unsupported, so there is no Linux, Windows, or Intel Mac story. The Apache-2.0 license covers the library, not the weights: F5-TTS ships under a non-commercial license and Higgs TTS 3 under a research/non-commercial license, so anyone shipping a commercial product needs to check each model individually rather than assume the repository license carries through. Version numbers still in the 0.0.x range, with three releases inside two days, signal an API that has not settled.
ggml-org
Pure C/C++ port of OpenAI Whisper for edge deployment
CJ Pais
A free, open-source, cross-platform speech-to-text app that transcribes your voice entirely offline — press a shortcut, speak, and have the text pasted into any app.