Mistral Large 4's eval layer: blind human review and the 4,000-GPU line
From the AI digest for 2026-10-06
What happened: Mistral's announcement tweet + Surge AI: "For their Mistral Large 4 release, @MistralAI ran a blind Surge human eval... five frontier models on coding quality. Le Chonk ranked #1 among open-weight models and #2 overall, behind only Opus 5." — with Surge's framing: "Unit tests ask: does it work? Human code review asks: would you merge it?" Peter Gostev (RT'd by LeCun, 9:58 AM ET) supplies the disparity metric: "Mistral Large 4 was trained on 4,000 GPUs and Astra was trained on 100,000 of them. We'll see what the kitten can pull off..."
What's genuinely new: the X layer of the release covered in today's ai digest (story 6) — the eval genre here is blind human code review, not a benchmark board, and the compute-disparity frame is doing the anti-scaling-narrative work. Vendor-run and vendor-floated numbers, both disclosed as such.
Watch: independent runs once weights circulate; whether the blind-human-eval announcement move spreads.
Links: Surge/Mistral · Gostev RT via LeCun (no link captured in feed)