# Right Order, Wrong Scale: Auditing LLM Judges for Occupational AI Measurement

> Толық мәтін ағылшын тілінде

**Published:** 2026 ж. 5 қазан
**Author:** Harry Lyu, Neil Thompson
**Source:** arXiv — cs.AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/kk/articles/right-order-wrong-scale-auditing-llm-judges-for-occupational-ai-measurem

LLM judges are increasingly used to assess whether AI outputs meet workplace requirements, but agreement on response rankings does not establish agreement on acceptance rates or occupational aggregates. We introduce O*NET-BENCH, an audit suite derived from an existing survey of…

> Материал бастапқы дереккөзден алынған: **arXiv — cs.AI**
> [Толық мәтінді arXiv — cs.AI сайтында оқу](https://arxiv.org/abs/2610.02492)

**Тегтер:** #arXiv

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*