arXiv:2611.08860v1 Announce Type: new Abstract: Multimodal emotion recognition in conversations (MERC) integrates textual, acoustic, and visual cues to identify utterance-level emotions. However, existing approaches generally do not explicitly adapt multimodal processing to the degree of inter-modal predictive disagreement. In real conversations, semantic incongruity, concealed emotion, noisy observations, and ambiguity can affect modality-specific emotional evidence differently, while the reliability of individual modalities varies across samples. Rather than identifying each source of inconsistency separately, we model their common consequence for emotion recognition as predictive disagreement among unimodal emotion distributions over the same emotion-label set. Such disagreement makes indiscriminate fusion prone to propagating unreliable or competing evidence. Inspired by the Brunswik Lens Model, we propose MiD-ERC, a divergence-centric framework that quantifies inter-modal predictive disagreement using a normalized divergence score and estimates sample-specific modality reliability. MiD-ERC uses these signals to coordinate divergence-guided cross-modal gating, divergence-modulated reliability weighting, and divergence-conditioned adaptive LLM prompting. The framework is trained end-to-end using only standard emotion annotations, without requiring additional conflict labels, auxiliary data construction, or external retrieval modules. Experiments on IEMOCAP and MELD demonstrate that MiD-ERC achieves state-of-the-art performance, with particularly pronounced improvements on high-divergence samples.
Research2 分钟阅读
关注差异:差异引导的可靠性感知融合与自适应LLM提示用于对话情绪识别
arXiv:2611.08860v1 发布类型:新 摘要:对话中的多模态情绪识别(MERC)整合文本、声学和视觉线索以识别话语级别的情绪。然而,现有方法通常不明确地将多模态处理适应到具体场景中。
arXiv — cs.AI作者: Jingwen Wang, Jiao Li, Yuhang Qian, Yuyin Wang, Min Zhang2026年11月9日 (2小时前)
提供 4 种语言版本AI 摘要:要点
- arXiv:2611.08860v1 发布类型:新 摘要:对话中的多模态情绪识别(MERC)整合文本、声学和视觉线索以识别话语级别的情绪。然而,现有方法通常不明确地将多模态处理适应到具体场景中。
Research
KZ·AI 5CAAИнсайт дня
关注差异:差异引导的可靠性感知融合与自适应LLM提示用于对话情绪识别
全文为英语
内容来自原始来源: arXiv — cs.AI
查看原文查看原文
相关文章
Ripple-65B Preview:面向智能体编程的模型
🌟 Ripple-65B Preview:面向智能体编程的模型。Recursive Intelligence 发布了一个拥有 650 亿参数的智能体编程模型的开放预览版,专注于响应速度。该公司由前 Google 研究员 Anna Goldie 和 Azalia Mirhoseini 创立……
Telegram — AI Machine Learning Big Data
SMNTCN (Semanticon) — глобальные новости ИИ
本周AI热门新闻榜
📌 本周AI热门新闻榜 🔊 ElevenLabs Sound Effects v3 — 根据描述生成声音:从脚步声、爆炸声到环境背景音。 🎨 OpenAI Images 2.6 — 创建GIF动画,图像生成更快,编辑现有图像更精准。 🎬 Gemini Omni 1.2 Flash —…
Telegram — GPT Time | Нейросети | ИИ
面向数据稀缺条件下的LLM自我博弈:有效性、泛化能力与可信度
arXiv:2611.08908v1 公告类型:新 摘要:大语言模型(LLM)的快速发展主要得益于模型规模扩大和人工策划的训练数据,但这一范式正日益受到数据稀缺和人工收益递减的制约…
arXiv — cs.AI