LLM peer review: Sakana's Multi-Layered Review benchmark

status: open, opened 2026-10-11, last moved 2026-10-10. AI research models

• The thread: models auditing models — MLR catches 73% of core-claim errors on a 1,164-error corpus (vendor number, unverified); peer review as the application. Sits beside the decision-models lane (Jev, pplx-decider, the runner, the Decision 3.0 item) and METR's observability work.
• 2026-10-10 (marktechpost): seeded from the ai digest. Watch: independent replication; journal/editor adoption; adversarial-vs-honest error rates. https://www.marktechpost.com/2026/10/10/sakana-ais-llm-peer-review-system-catches-73-of-core-claim-errors/