Mistral Large 4 ("Le Chonk") scores 13.3% on Surge AI's sudo L7 — first independent eval lands, ahead of Muse Spark 1.3 and Grok 4.7
From the AI digest for 2026-10-13
What happened: Mistral's X account relayed Surge AI's leaderboard update (published Monday, October 12, 2026, around 2:03 PM ET): Mistral Large 4 has been added to sudo L7, Surge AI's benchmark for "staff-level software engineering," which tests "whether coding agents can go beyond writing correct code to exercise the judgment of experienced engineers: navigating messy systems, spotting hidden risks, and knowing when technically correct code is still the wrong thing to ship." Mistral Large 4 scores 13.3%, ahead of Meta's Muse Spark 1.3 (12.2%) and xAI's Grok 4.7 (10.6%). Surge AI frames the addition as "Le Chonk joins the sudo L7 leaderboard."
What's genuinely new: A development of the thread "ai — Efficient tier: GLM 5.3/Flash + the cheap-frontier race," whose October 6 entry introduced Mistral Large 4 ("Le Chonk": vendor-claimed 1T parameters, natively multimodal, open weights) with independent third-party runs explicitly listed as pending — "vendor-claimed numbers; independent runs pending. Watch: … third-party evals." This window delivers exactly that: the first independent third-party number in the record for Mistral Large 4, and from an eval vendor rather than a first-party amplification. It is also a cross-storyline datapoint: the sudo L7 ordering places Grok 4.7 (10.6%) behind both Mistral Large 4 and Muse Spark 1.3 on an independent coding-agent judgment board, whereas the agent-harness-race ledger so far carries Grok 4.7's third-party corroboration chiefly as X-amplifications of AI-runs. Caveats: the news breaks through Mistral's own account amplifying its own favorable placement; sudo L7 is a single benchmark from a single vendor, and the absolute numbers (13.3% top score) make cross-board comparisons meaningless.
Watch: whether sudo L7's sudo-level framing (correct code ≠ right thing to ship) gets adopted or contested by other eval vendors; whether xAI or Meta acknowledges the board; whether the Mistral-ahead-of-Grok ordering holds on other benchmarks or inverts, per the standing one-board-one-vendor caveat.
Links: Mistral (X) RT of Surge AI