Context-Aware Dynamic Graph Learning for Multimodal Emotion Recognition with Missing Modalities
Miree Kim, Sunyoung Cho
Sookmyung Women's University
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
The missing modality problem in multimodal emotion recognition in conversations (MERC) remains a key challenge in real-world applications, as existing methods often fail to preserve semantic coherence or achieve robust cross-modal reconstruction. To address this issue, we propose a unified framework that combines adaptive dialogue graphs, Large Language Models (LLMs)-guided emotional context extraction, and cross-modal semantic alignment. Our approach leverages dynamic graph ordinary differential equations to model temporal and speaker-specific dynamics, while LLMs refine textual representations by extracting emotion-relevant keywords conditioned on conversational context. An additional alignment loss enforces semantic consistency between reconstructed and observed modalities. Experiments on IEMOCAP and MELD demonstrate that our method achieves state-of-the-art performance under both complete- and missing-modality conditions, outperforming prior approaches and showing strong robustness to incomplete inputs. Code is available at https://github.com/premiree/CDAGL.git.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
社会科学Emotion and Mood Recognition
Multimodal Machine Learning Applications · Face and Expression Recognition
参考文献 28
此处列出前 3 条