# Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement

> 全文为英语

**Published:** 2026年10月5日
**Author:** Harry Lyu, Neil Thompson
**Source:** arXiv — cs.AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/zh/articles/right-order-wrong-scale-auditing-llm-judges-for-occupational-ai-measurem

LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates. We introduce O*NET-BENCH, an audit suite derived from an existing survey of…

> 内容来自原始来源： **arXiv — cs.AI**
> [在 arXiv — cs.AI 阅读全文](https://arxiv.org/abs/2610.02492)

**标签：** #arXiv

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*