UAMFDet: Acoustic‐Optical Fusion for Underwater Multi‐Modal Object Detection
Haojie Chen, Zhuo Wang, Hongde Qin, Xiaokai Mu
Harbin Engineering University
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Underwater object detection serves as a crucial means for autonomous underwater vehicles (AUVs) to gain awareness of their surroundings. Currently, AUVs predominantly depend on underwater optical cameras or sonar sensing techniques to furnish vital information sources for subsequent tasks such as underwater rescue and mining exploration. However, the influence of underwater light attenuation or significant background noise often leads to the failure of either the acoustic or optical sensor. Consequently, the traditional single‐modal object detection network, which relies exclusively on either the optical or acoustic modality, struggles to adapt to the varying complexities of underwater environments. To address this challenge, this paper proposes a novel underwater acoustic‐optical fusion‐based underwater multi‐modal object detection paradigm termed UAMFDet, which fuses highly misaligned acoustic‐optical features in the spatial dimension at both the fine‐grained level and the instance level. First, we propose a multi‐modal deformable self‐aligned feature fusion module to adaptively capture feature dependencies between multi‐modal targets, and perform self‐aligned multi‐modal fine‐grained feature fusion by differential fusion. Then a multi‐modal instance‐level feature matching network is designed. It matches multi‐modal instance features by a lightweight cross‐attention mechanism and performs differential fusion to achieve instance‐level feature fusion. In addition, we establish a data set dedicated to underwater acoustic‐optical fusion object detection tasks called UAOF, and conduct a large number of experiments on the UAOF data set to verify the effectiveness of UAMFDet.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
工程Underwater Vehicles and Communication Systems
Advanced Neural Network Applications · Underwater Acoustics Research
参考文献 38
此处列出前 3 条
引用本文 33
按被引量排序,此处列出前 3 条