A spatiotemporal bidirectional mamba network with global–local skeletal enhancement for 3D human pose estimation
Chuhan Wu, Zan Wang, Guixian Zhou, Jiahao Hua, Lianke Shi
Henan University
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
3D human pose estimation (HPE) is a cornerstone task in computer vision with diverse applications, where lifting 2D pose sequences to 3D representations has attracted significant interest. Transformer-based approaches have demonstrated robust performance but are hampered by quadratic computational complexity and insufficient bidirectional modeling capabilities. The recently introduced Mamba model mitigates these limitations through state-space models (SSMs) offering linear complexity and effective long-range dependencies; however, it falls short in modeling local skeletal interactions essential for human motion.To address this, we present BSTMamba, a bidirectional spatiotemporal SSM architecture designed specifically for monocular 3D HPE. BSTMamba integrates efficient global sequence modeling with localized convolutions and dynamic gating mechanisms to capture intricate spatiotemporal dependencies. For enhanced robustness and generalization, we introduce DisruptEnhance, a residual-compensated joint-order perturbation module that randomly disrupts joint orders at both global (full-skeleton) and local (body-part) scales, followed by feature compensation via a lightweight residual subnet. Comprehensive evaluations on the Human3.6M and MPI-INF-3DHP datasets reveal that BSTMamba attains state-of-the-art accuracy while requiring fewer parameters and lower multiply-accumulate operations (MACs) compared to prior methods.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIHuman Pose and Action Recognition
Face recognition and analysis · 3D Shape Modeling and Analysis