CADET: Cycle-Consistent Adversarial Disentanglement With Text-Guided Enhancement for Multimodal Sentiment Analysis
Xiangrui Dan, Bin Gao, Yanping Chen, Qian Fu, Yutong Li, Shutian Liu, Zhengjun Liu, Zhengjun Liu
Heilongjiang University Guizhou University Harbin Institute of Technology
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Multimodal sentiment analysis (MSA) integrates language, vision, and audio for robust emotion recognition. A core challenge lies in balancing cross-modal consistency and modality-specific private information: While consistency ensures stable semantic alignment, it often suppresses fine-grained modality cues. Conversely, excessive emphasis on private information enriches detailed representations, but may introduce noise, particularly in the audio and visual domains. To address this, we propose Cycle-Consistent Adversarial Disentanglement with Text-Guided Enhancement (CADET), a unified framework for disentangled multimodal representation learning. CADET incorporates three complementary modules.First, an adversarial autoencoder with cross-modal contrastive learning separates shared and private representations and enforces instance-level semantic compactness to improve representation discriminability. Second, a cycle-consistent generative adversarial module introduces bidirectional reconstruction to preserve modality fidelity and guarantee semantic reversibility.Third, a two-stream text-guided enhancement mechanism leverages the dominant role of language to refine audiovisual features through cross-modal attention, thereby strengthening finegrained semantic representation within the private subspace.Experiments on CMU-MOSI and CMUMOSEI demonstrate that CADET consistently outperforms state-of-the-art baselines, validating the effectiveness of disentanglement, cycle consistency, and text-guided enhancement in advancing multimodal sentiment analysis.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AISentiment Analysis and Opinion Mining
Emotion and Mood Recognition · Multimodal Machine Learning Applications
参考文献 49
此处列出前 3 条