Efficient Mixture-of-Experts for Video-Based Driver State and Physiological Multi-Task Estimation in Conditional Autonomous Driving
Jiyao Wang, Xiao Yang, Zhenyu Wang, Ximeng Wei, Ange Wang, Dengbo He, Kaishun Wu
The Hong Kong University of Science and Technology (Guangzhou) University of Hong Kong
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Road safety remains a critical challenge worldwide, with approximately 1.19 million fatalities annually attributed to traffic accidents, often due to human error. As we advance towards higher levels of vehicle automation, challenges still exist, as driving with automation can cognitively over-demand drivers if engaging in non-driving-related tasks (NDRTs), or lead to drowsiness if driving is the sole task. This calls for the urgent need for an effective Driver Monitoring System (DMS) that can evaluate cognitive load and drowsiness in SAE Level-2/3 autonomous driving contexts. In this study, we propose a novel multi-task DMS, termed VDMoE, which leverages RGB video input to monitor driver states non-invasively. By utilizing key facial features to minimize computational load and integrating remote Photoplethysmography (rPPG) for physiological insights, our approach enhances detection accuracy while maintaining efficiency. Additionally, we optimize the Mixture-of-Experts (MoE) framework to accommodate multi-modal inputs and improve performance across different tasks. A novel prior-driven regularization method is introduced to align model outputs with human-factors priors, thus mitigating overfitting risks. We validated our method by creating a new dataset (MCDD), which comprises RGB video and physiological indicators from 42 participants, as well as two public datasets. Our findings demonstrate the effectiveness of VDMoE in monitoring driver states, contributing to safer autonomous driving systems. Code is inhttps://github.com/WJULYW/VDMoE
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
社会科学Human-Automation Interaction and Safety
Sleep and Work-Related Fatigue · Non-Invasive Vital Sign Monitoring