Audiocraft is Meta's (Facebook Research) open-source library for audio processing and generation with deep learning. With 23,368 GitHub stars and 2,640 forks under the permissive MIT license, it is one of the most established and widely used foundations in the open-source audio AI ecosystem. Rather than a single application, Audiocraft is a research-grade toolkit that bundles the EnCodec neural audio codec together with controllable generative models for music and sound, giving developers a common platform for training, fine-tuning, and running state-of-the-art audio models. ## A Library, Not Just a Model Audiocraft's defining characteristic is breadth. At its center is EnCodec, a state-of-the-art neural audio compressor and tokenizer that turns raw waveforms into discrete tokens a language model can operate on — the representational substrate that makes token-based audio generation practical. On top of that foundation sit the generative models, most prominently MusicGen, a simple and controllable music generation language model that accepts both textual and melodic conditioning. By shipping the codec and the models together in one codebase, Audiocraft lets researchers and engineers move fluidly from audio tokenization to generation without stitching together incompatible components. ## MusicGen and Controllable Generation MusicGen is the project's best-known model and a reference implementation for text-conditioned music generation. It generates music from a text prompt and, distinctively, can be conditioned on a melody — letting a user hum or supply a reference tune that the model elaborates into a full arrangement in the requested style. This melodic conditioning is what separates MusicGen from purely text-driven generators: it gives musicians a way to inject their own musical intent rather than relying solely on language to describe a sound. Because MusicGen is built on the EnCodec tokenizer, the same library that defines the audio representation also defines the generation path, keeping the system coherent end to end. ## EnCodec as Shared Infrastructure EnCodec deserves attention in its own right. As a high-fidelity neural codec, it compresses audio into a compact discrete token stream and reconstructs it with strong perceptual quality, making it useful far beyond music generation — for transmission, storage, and as the tokenization layer for any token-based audio model. Many downstream projects across the audio AI landscape have adopted EnCodec or codecs inspired by it, and its presence inside Audiocraft is a large part of why the library has accumulated such a substantial star count: it is infrastructure that other systems build upon. ## Research-Grade Tooling Audiocraft is built for researchers and developers rather than end users seeking a polished app. It provides the training code, inference code, and model definitions needed to reproduce results, fine-tune on new data, and extend the architectures. This orientation makes it a natural starting point for academic work and for teams building their own audio products on a trusted foundation. The trade-off is that it expects a degree of machine-learning fluency — it is a library to be programmed against, not a one-click web interface, and getting the most from it means working in Python with PyTorch and managing models and data directly. ## Ecosystem Position Audiocraft's longevity and scale have made it a cornerstone of open-source audio AI. Newer 2026 projects emphasize speed, consumer-hardware deployment, and song-level structure, but many of them stand on conceptual ground that Audiocraft and EnCodec helped establish: discrete audio tokenization feeding a generative language model. The MIT license has been central to that influence, allowing unrestricted commercial use and free incorporation into other projects — a permissive stance that contrasts with the more restrictive terms attached to some competing releases and that has encouraged broad adoption across both research and industry. ## Pros, Cons, and Outlook The strengths are substantial: a battle-tested EnCodec codec, the well-documented MusicGen model with melodic conditioning, a permissive MIT license, and the credibility and maintenance reach of Meta's research organization. The limitations follow from its nature as a research library. It is not an end-user application, so non-developers will find the barrier to entry high; it expects a capable GPU and a working PyTorch environment; and as the field accelerates, some of its models predate the very fastest 2026 consumer-hardware-optimized systems on raw speed. Even so, as both a practical toolkit and a piece of shared infrastructure, Audiocraft remains one of the most important reference points in open-source audio AI, and its codec and conditioning ideas continue to shape the models that follow it.