DeepDefense: Robust Learning via Layer-Wise Gradient-Feature Alignment
Ci Lin, Tet Yeap, Iluju Kiringa, Biwei Zhang
University of Ottawa
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Deep neural networks are known to be vulnerable to adversarial perturbations, which are small, carefully crafted inputs that lead to incorrect predictions. In this paper, we propose DeepDefense, a novel defense framework that applies Gradient-Feature Alignment (GFA) regularization across multiple layers to suppress adversarial vulnerability. By aligning input gradients with internal feature representations, DeepDefense promotes a smoother loss landscape in tangential space, also known as feature space, thereby reducing the model's sensitivity to adversarial noise. We provide insights into how adversarial perturbations can be decomposed into radial and tangential components and demonstrate that alignment suppresses loss variation in tangential space, where most attacks are effective. Empirically, our method achieves significant improvements in robustness against both gradient-based and optimization-based attacks. For example, on CIFAR-10, CNN models trained with DeepDefense outperform standard adversarial training by up to 15.2 percent under APGD attacks and 24.7 percent under FGSM attacks. Against optimization-based attacks such as DeepFool and EADEN, DeepDefense requires perturbation magnitudes that are 20 to 30 times larger to cause misclassification, indicating stronger decision boundaries and a flatter loss landscape. Our approach is architecture-agnostic, simple to implement, and highly effective, offering a promising direction for improving the adversarial robustness of deep learning models.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIAdversarial Robustness in Machine Learning
Security and Verification in Computing · Digital Media Forensic Detection