Back to list
Aug 01, 2026
6
0
0
Other LLMNEW

LG's K-EXAONE 2.0: 750B Open-Weight Sovereign AI Model

LG AI Research's K-EXAONE 2.0 is a 750B MoE model released under Apache 2.0, a rare fully permissive license for a Korean sovereign AI project.

#K-EXAONE#LG AI Research#Other LLM#Open Source#MoE
LG's K-EXAONE 2.0: 750B Open-Weight Sovereign AI Model
AI Summary

LG AI Research's K-EXAONE 2.0 is a 750B MoE model released under Apache 2.0, a rare fully permissive license for a Korean sovereign AI project.

Introduction

LG AI Research published K-EXAONE 2.0 to Hugging Face on July 31, 2026, releasing it as the second-generation model in South Korea's Ministry of Science and ICT "Sovereign AI Foundation Model" project. The main repository, LGAI-EXAONE/K-EXAONE-2.0-750B-A37B, is accompanied by FP8, NVFP4, and DSpark variants. At 750 billion total parameters, Korean press has described it as the largest AI foundation model developed in South Korea to date, roughly three times the size of LG's first-generation K-EXAONE-236B-A23B, published in May 2026.

What sets this release apart is not only its scale but its license. K-EXAONE 2.0 ships under Apache 2.0, an unrestricted commercial license, at a parameter count where nearly every other government-linked "sovereign AI" project has shipped under more restrictive terms. That combination, frontier-adjacent scale plus a fully permissive license, is the core story here, more than any single benchmark number.

Feature Overview

K-EXAONE 2.0 is a Mixture-of-Experts (MoE) model with 750 billion total parameters and 37 billion active per token, an activation ratio of roughly 4.9%. The model uses a hidden dimension of 6,144 across 78 layers: two dense heading layers, 76 sparse MoE layers, and one multi-token-prediction (MTP) layer used for speculative decoding. Each sparse layer draws from a pool of 256 experts, activating 8 per token plus a single shared expert that is always active. Attention uses 64 query heads and 8 key-value heads, and the vocabulary spans 153,600 tokens.

The attention layout mixes global and local attention rather than using uniform full attention throughout. Of the layers, one block uses global attention without positional encoding (NoPE), one uses sliding-window attention with a 4,096-token window, and the remaining 19 blocks each repeat a pattern of three sliding-window layers followed by one global layer. This mix is a deliberate design choice: sliding-window layers cap the size of the key-value cache each layer needs to hold, while the periodic global layers preserve the model's ability to attend across the full context.

That full context reaches 262,144 tokens, with a training knowledge cutoff in Q2 2025. The model supports 10 languages: Korean, English, Spanish, German, Japanese, Vietnamese, French, Italian, Polish, and Portuguese.

On its model card, LG AI Research reports MMLU-Pro at 83.5, SWE-bench Verified at 68.2, OpenAI-MRCR (a long-context retrieval benchmark) at 94.4, and KGC-Safety at 99.8. Korean press coverage cites a broader figure: an average of 70.1 across 24 benchmarks, up from 63.3 for the first-generation K-EXAONE, a gain of more than 10% relative to the prior model. For inference, the model supports speculative decoding through both its built-in MTP layer and the separate DSpark variant, which LG reports delivers a 3-5x speedup.

Usability Analysis

Publishing 750 billion parameters under Apache 2.0 is a meaningful legal statement, but it does not by itself make the model practical to run. Full-precision weights at this scale require a substantial multi-GPU cluster; realistically, only organizations with serious infrastructure, cloud providers, large enterprises, research institutions, will self-host the base checkpoint. This is where the FP8 and NVFP4 quantized variants matter more than the headline release: they reduce memory footprint relative to the base weights, bringing deployment within reach of a smaller, though still substantial, hardware budget.

The sparse activation design helps on the compute side of that equation. With only 37 billion of 750 billion parameters active per token, per-token inference cost tracks closer to a mid-sized dense model than to the total parameter count, even though the full expert set still needs to be held in memory somewhere. Combined with the sliding-window-heavy attention layout, which limits KV-cache growth at the 262,144-token context ceiling, the architecture is built to keep serving cost from scaling linearly with either parameter count or context length. The DSpark speculative-decoding variant, reported at 3-5x speedup, is a further lever for teams trying to bring latency down without changing the underlying model.

In practice, this model is aimed at institutions with the infrastructure to deploy it, not individual developers on consumer hardware, even with quantization available.

Pros and Cons

Pros

  1. Apache 2.0 licensing at 750B parameters is unusual; Korean government-linked foundation models have rarely shipped under a fully permissive commercial license.
  2. Sparse 37B-active-parameter design keeps per-token inference cost well below what the 750B total parameter count would suggest.
  3. FP8, NVFP4, and DSpark variants give deployers multiple paths to trade off memory footprint against inference speed.
  4. A 262,144-token context window, paired with a sliding-window/global attention mix designed to contain KV-cache growth at that length.
  5. Reported benchmark gains over the first-generation K-EXAONE (70.1 vs. 63.3 average across 24 benchmarks, per Korean press) suggest real improvement, not just scale.

Cons

  1. All benchmark figures, both the model-card numbers and the press-reported 24-benchmark average, are vendor-reported; none have been independently replicated as of this release.
  2. 750 billion parameters remains a heavy deployment for the vast majority of self-hosters, even with FP8/NVFP4 quantization narrowing that gap somewhat.
  3. The Q2 2025 knowledge cutoff is already roughly a year old relative to the model's July 2026 release.
  4. Ten supported languages is narrower than some competing multilingual open-weight models, and language coverage outside Korean and English has not been independently benchmarked here.

Outlook

K-EXAONE 2.0 puts LG AI Research in a category of open-weight, frontier-scale MoE models that has, until now, been dominated by Chinese labs, DeepSeek, Qwen, and Kimi among them, several of which have also released permissively-licensed models above 200B parameters. Whether K-EXAONE 2.0's reported benchmark scores hold up against independent evaluation will determine how it is actually positioned against those models, rather than how Korean press has framed it at launch.

For the Sovereign AI Foundation Model project, this release matters as much for what it signals as for its raw performance: a government-linked initiative choosing full commercial permissiveness at frontier scale, rather than a research-only or non-commercial license, is a deliberate strategic choice. If adoption follows, particularly among Korean cloud providers and enterprises building domestic AI infrastructure, it would validate that bet. Independent benchmarking, and evidence of real deployment outside LG's own ecosystem, are the two things to watch next.

Conclusion

K-EXAONE 2.0 is a serious entry: a 750B-parameter, 37B-active MoE model with a long context window, quantized deployment variants, and a genuinely permissive Apache 2.0 license. Its architecture choices show real attention to serving cost, not just parameter-count bragging rights. But its benchmark claims remain vendor-reported, its weights remain heavy even quantized, and its knowledge cutoff is already dated. It is best suited to enterprises, cloud providers, and research institutions with the infrastructure to deploy a model of this scale, and to observers tracking how open-weight AI development in Korea compares with China's more established open MoE ecosystem.

Editor's Verdict

LG's K-EXAONE 2.0: 750B Open-Weight Sovereign AI Model earns a solid recommendation within the other llm space.

The strongest case for paying attention is apache 2.0 license at 750B parameters — unrestricted commercial use is rare at this scale for a sovereign AI project, which raises the bar for what readers should now expect from peers in this space. Reinforcing that, sparse 37B-active design keeps inference cost well below what the total parameter count suggests adds practical value rather than just headline appeal. The broader signal worth registering is straightforward: K-EXAONE 2.0 ships under Apache 2.0 at 750B parameters, an unusually permissive license for a government-linked sovereign AI project of this scale. On the other side of the ledger, benchmark figures are entirely vendor-reported, with no independent replication confirmed yet is a real constraint, not a marketing footnote, and it should factor into any serious decision. Layered on top of that, 750B total parameters remains a heavy deployment even with quantized variants narrows the set of teams for whom this is an obvious yes.

For multi-model deployment teams, cost-conscious operators, and developers willing to evaluate beyond the major labs, this is a serious evaluation candidate, not just a curiosity to bookmark. For everyone else, the safer posture is to monitor coverage and revisit once the use cases that matter to your team are demonstrated in the wild.

Pros

  • Apache 2.0 license at 750B parameters — unrestricted commercial use is rare at this scale for a sovereign AI project
  • Sparse 37B-active design keeps inference cost well below what the total parameter count suggests
  • FP8, NVFP4, and DSpark variants provide multiple practical deployment paths
  • 262,144-token context window backed by an attention layout designed to limit KV-cache growth
  • Reported double-digit percentage improvement over the first-generation K-EXAONE model

Cons

  • Benchmark figures are entirely vendor-reported, with no independent replication confirmed yet
  • 750B total parameters remains a heavy deployment even with quantized variants
  • Q2 2025 knowledge cutoff is already about a year old at release
  • Only 10 supported languages, narrower than some competing multilingual open-weight models

Comments0

Key Features

1. MoE architecture: 750B total / 37B active parameters (~4.9% activation), hidden dim 6,144, 78 layers (2 dense heading + 76 sparse + 1 MTP), 256 experts (8 activated + 1 shared) 2. Mixed attention layout — 1 global (NoPE) block, 1 sliding-window (4,096) block, and 19 blocks of 3 sliding-window + 1 global — supporting a 262,144-token context 3. Apache 2.0 license (unrestricted commercial use), 10 supported languages, Q2 2025 knowledge cutoff 4. FP8, NVFP4, and DSpark variants published alongside the base model for quantized/speculative-decoding deployment 5. Reported benchmarks: MMLU-Pro 83.5, SWE-bench Verified 68.2, OpenAI-MRCR 94.4, KGC-Safety 99.8 (model card); 70.1 average across 24 benchmarks vs. 63.3 for gen 1 (press-reported)

Key Insights

  • K-EXAONE 2.0 ships under Apache 2.0 at 750B parameters, an unusually permissive license for a government-linked sovereign AI project of this scale.
  • Its 37B active-parameter design, out of 750B total, keeps per-token inference cost far below what the total parameter count implies.
  • The mixed sliding-window/global attention layout — 19 blocks of 3 sliding-window + 1 global, plus 2 standalone blocks — is built to contain KV-cache growth at a 262,144-token context length.
  • FP8 and NVFP4 quantized variants, plus a DSpark speculative-decoding variant, are published alongside the base checkpoint specifically to make deployment more tractable.
  • Press-reported gains put the average score across 24 benchmarks at 70.1, up from 63.3 for the first-generation K-EXAONE, a model roughly one-third the size.
  • All benchmark figures, model-card and press-reported alike, are vendor-reported and have not been independently replicated as of this release.
  • At 750B parameters, even quantized variants remain out of reach for the large majority of individual self-hosters; this is an institutional-scale deployment.
  • The release positions LG AI Research within a category of open-weight, frontier-scale MoE models that has so far been led by Chinese labs such as DeepSeek, Qwen, and Kimi.

Was this review helpful?

Share

Twitter/X