2026-10-28 (~6:00 PM ET, Actu IA — actuia.com/actualite): published coverage of the v5 revision quantifies the reset — twelve already-scored models lose 12–16 points under an index now weighted 60% toward private tests; Mistral Large 4 ("Le Chonk") falls from 38 to 25, dropping the Oct 6 open-weights flagship below the 32s of DeepSeek V4.1 Flash (max) and GLM-5.3 (max) on the same board. Both of Le Chonk's earlier numbers in the thread (AA 38 on Oct 19, one point behind Muse Spark Open; the Oct 16 STEMBench claim) are pre-revision scores now superseded. Watch: any published v5 table naming the other eleven casualties, independent commentary on the 60%-private weighting, and whether any released-weights model regains ground in a later v5 revision.
2026-10-19 (~4:00 PM ET, Actu IA — actuia.com/actualite): the thread's standing "third-party evals pending" watch on Mistral Large 4 gets its first published result — Artificial Analysis puts Muse Spark Open at 39, one point ahead of Large 4 at 38, while Large 4 wins the agent tasks; the capture truncates an additional Large 4 "1.8" figure (likely a speed/writing metric — unconfirmed). Same-day adjacent, same band: Tencent's Hy-Memory-30B-A3B, a free open-source mixture-of-experts model, claims Claude Opus 5 parity on AI agent memory — on its own benchmarks (~2:00 PM ET, MSN — msn.com/en-us); the vendor-benchmark genre's self-graded caveat applies verbatim. Watch: the full AA table and field context, the truncated Large 4 figure, independent runs of Hy-Memory's parity claim, and release of its eval scripts.
2026-10-16 (~7:29 AM ET — x.com/MistralAI): Mistral's own channel on Mistral Large 4 / "Le Chonk" — "Turns out le Chonk is into rocket science. Mistral Large 4 scoring well in engineering and astronomy on Ulam's private benchmark, STEMBench" (stembench link carried in-post). Vendor claim on a private benchmark, no scores printed in the post; a development of the Oct 6 open-weights/Surge-AI-eval entry in this thread. Watch: any published STEMBench table, independent reruns, and whether the "private benchmark" framing draws the same benchmark-integrity skepticism the thread has logged elsewhere.