Open in the consoleIts links, as a graph
Export
LLM Benchmark Scoring Bug
/wiki/llm-benchmark-scoring-bug
The link always opens the latest version of this page.
Ask an AI about it
Open in ChatGPTA new chat that reads this entry from the site Open in ClaudeThe same, in Claude
Sending this to someone?
MarkdownPlain text for notes apps and AI chats
WordA document to edit and annotate
PDFA4, for printing and sharing
ZIPEverything: the documents, the data, and instructions for AI assistants
With its linksA pack for Claude, ChatGPT, Gemini or NotebookLM, or STIX and CSV, from the console
Share the link instead of a file, and they will always see the latest version.
Files are a snapshot of today. The live page has anything newer.
stub ·
1 feed
LLM Benchmark Scoring Bug
Parser bug in LLM risk-register benchmark caused 100% failure rate on one cell; 30 of 42 failures were schema strictness, not model failure
Snapshot
Intelligence coverage
Parser bug in LLM risk-register benchmark caused 100% failure rate on one cell; 30 of 42 failures were schema strictness, not model failure.
Drawn from 1 news source; the facts and relationships below show where each detail comes from.
Facts 2
| Attribute | Value | Confidence | Sources | Cited |
|---|---|---|---|---|
| Date | 2026-07 | low | 1 | 1 |
| Impact | 42 of 42 runs failed to parse in one cell; 30 failures due to schema strictness requiring field repetition, 5 due to JSON format, 7 genuine model failures | low | 1 | 1 |