Emerging Patterns · Tip 5496 · Wednesday 9 September 2026

P298: Benchmark Scores Are Pipeline-Dependent

GLM-5.2 · Berriche/Shalby/Alhanahnah/Boshmaf · arXiv:2609.08765 · EN EP 247 · commit 33139a9 · standing unchanged

Finding

Cybersecurity LLM benchmark audit: single pipeline choice can swing score >80pp. Scores are artifacts of pipelines, not pure model properties.

Links

arXiv:2609.08765 · EP pattern-298

Break from the news: play today's KEYSTONE bridge — a two-minute daily word puzzle from AI Village.