arXiv:2611.08860v1 Announce Type: new Abstract: Multimodal emotion recognition in conversations (MERC) integrates textual, acoustic, and visual cues to identify utterance-level emotions. However, existing approaches generally do not explicitly adapt multimodal processing to the degree of inter-modal predictive disagreement. In real conversations, semantic incongruity, concealed emotion, noisy observations, and ambiguity can affect modality-specific emotional evidence differently, while the reliability of individual modalities varies across samples. Rather than identifying each source of inconsistency separately, we model their common consequence for emotion recognition as predictive disagreement among unimodal emotion distributions over the same emotion-label set. Such disagreement makes indiscriminate fusion prone to propagating unreliable or competing evidence. Inspired by the Brunswik Lens Model, we propose MiD-ERC, a divergence-centric framework that quantifies inter-modal predictive disagreement using a normalized divergence score and estimates sample-specific modality reliability. MiD-ERC uses these signals to coordinate divergence-guided cross-modal gating, divergence-modulated reliability weighting, and divergence-conditioned adaptive LLM prompting. The framework is trained end-to-end using only standard emotion annotations, without requiring additional conflict labels, auxiliary data construction, or external retrieval modules. Experiments on IEMOCAP and MELD demonstrate that MiD-ERC achieves state-of-the-art performance, with particularly pronounced improvements on high-divergence samples.
Mind the Divergence: Divergence-Guided Reliability-Aware Fusion and Adaptive LLM Prompting for Conversational Emotion Recognition
arXiv:2611.08860v1 Announce Type: new Abstract: Multimodal emotion recognition in conversations (MERC) integrates textual, acoustic, and visual cues to identify utterance-level emotions. However, existing approaches generally do not explicitly adapt multimodal processing to the…
AI Summary & Key Takeaways
- arXiv:2611.08860v1 Announce Type: new Abstract: Multimodal emotion recognition in conversations (MERC) integrates textual, acoustic, and visual cues to identify utterance-level emotions
- However, existing approaches generally do not explicitly adapt multimodal processing to the…
Mind the Divergence: Divergence-Guided Reliability-Aware Fusion and Adaptive LLM Prompting for Conversational Emotion Recognition
Related stories
Ripple-65B Preview: Model for Agentic Coding
🌟 Ripple-65B Preview: Model for Agentic Coding. Recursive Intelligence has released an open preview of a 65‑billion‑parameter agentic programming model focused on response speed. The company was founded by Anna Goldie and Azalia Mirhoseini, former Google researchers…
FLEX Platform Teaches Robots to Understand Hidden Human Intentions
MIT Unveils FLEX Platform: Robots Learn to Understand Hidden Human Intentions and Generalize Commands Based on Language Model.
Top AI News of the Week
📌 Top AI News of the Week 🔊 ElevenLabs Sound Effects v3 — generates sounds from descriptions: from footsteps and explosions to ambient backgrounds. 🎨 OpenAI Images 2.6 — creates GIF animations, generates images faster, and edits existing images more precisely. 🎬 Gemini Omni 1.2 Flash —…
Toward LLM Self-Play Under Data Scarcity: Effectiveness, Generalizability, and Trustworthiness
arXiv:2611.08908v1 Announce Type: new Abstract: The rapid development of large language models (LLMs) has been driven largely by scaling model size and human-curated training data, yet this paradigm is increasingly constrained by data scarcity and diminishing returns from human…