arXiv:2611.08613v1 Announce Type: new Abstract: Normative competence, the ability to infer socially enforced expectations from interaction and adjust behavior accordingly, is essential for agents operating in unfamiliar human communities. Yet existing evaluations largely test whether agents can recognize or apply norms they may already know, rather than whether they can acquire previously unknown norms from social interaction. We introduce NormGym, an interactive benchmark for normative competence in which a newcomer must infer a hidden, arbitrary norm while pursuing its own task in a multi-agent community. Success requires distinguishing what is possible from what is permitted, inferring the norm from observed behavior and sanctions, and applying it in new situations. NormGym contains diverse norms and distinct environments, allowing systematic evaluation of current agents, including large language model (LLM) agents. We find that normative competence remains challenging: the strongest evaluated LLM achieves a joint task-and-compliance success rate of 55.3%. Our analysis reveals that models can sometimes revise their behavior following sanctions for their own actions, but struggle to use other agents' behavior and the sanctions they receive to infer the underlying norm. We further find that fine-tuning models may be insufficient to improve normative competence. These results suggest that current models lack a robust, transferable capability for acquiring normative knowledge through social interaction.
Research2 分钟阅读
NormGym:通过社会互动评估规范能力
arXiv:2611.08613v1 Announce Type: new Abstract:规范能力是指从互动中推断社会强制期望并相应调整行为的能力,这对于在陌生人类社区中运作的智能体至关重要。然而,现有的评估主要测试……
arXiv — cs.AI作者: Binze Li, Zihuan Zhang, Seokhyun Baek, Gillian K. Hadfield, Tianmin Shu2026年11月9日 (2小时前)
提供 4 种语言版本AI 摘要:要点
- arXiv:2611.08613v1 Announce Type: new Abstract:规范能力是指从互动中推断社会强制期望并相应调整行为的能力,这对于在陌生人类社区中运作的智能体至关重要。然而,现有的评估主要测试……
Research
KZ·AI 52AAИнсайт дня
NormGym:通过社会互动评估规范能力
全文为英语
内容来自原始来源: arXiv — cs.AI
查看原文查看原文
标签:#arXiv
相关文章
Ripple-65B Preview:面向智能体编程的模型
🌟 Ripple-65B Preview:面向智能体编程的模型。Recursive Intelligence 发布了一个拥有 650 亿参数的智能体编程模型的开放预览版,专注于响应速度。该公司由前 Google 研究员 Anna Goldie 和 Azalia Mirhoseini 创立……
Telegram — AI Machine Learning Big Data
SMNTCN (Semanticon) — глобальные новости ИИ
本周AI热门新闻榜
📌 本周AI热门新闻榜 🔊 ElevenLabs Sound Effects v3 — 根据描述生成声音:从脚步声、爆炸声到环境背景音。 🎨 OpenAI Images 2.6 — 创建GIF动画,图像生成更快,编辑现有图像更精准。 🎬 Gemini Omni 1.2 Flash —…
Telegram — GPT Time | Нейросети | ИИ
面向数据稀缺条件下的LLM自我博弈:有效性、泛化能力与可信度
arXiv:2611.08908v1 公告类型:新 摘要:大语言模型(LLM)的快速发展主要得益于模型规模扩大和人工策划的训练数据,但这一范式正日益受到数据稀缺和人工收益递减的制约…
arXiv — cs.AI