# AGORA: Reliability-Aware Aggregation of LLM Judges via Item-Response Theory

> Толық мәтін ағылшын тілінде

**Published:** 2026 ж. 5 қараша
**Author:** Junhyung Ahn
**Source:** arXiv — cs.AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/kk/articles/agora-reliability-aware-aggregation-of-llm-judges-via-item-response-theo

arXiv:2611.05556v1 Announce Type: new Abstract: LLM-as-a-judge is a common substitute for costly human evaluation, and aggregating several judges is the standard remedy for any single judge's bias. Judge pools mix judges of very different reliability, while the human-labeled…

> Материал бастапқы дереккөзден алынған: **arXiv — cs.AI**
> [Толық мәтінді arXiv — cs.AI сайтында оқу](https://arxiv.org/abs/2611.05556)

**Тегтер:** #arXiv

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*