Reles-OTA: A Reinforcement-Learning Enhanced Scalable Over-the-Air Update Approach for CAVs
Arpan Bhattacharjee, Zheng Xu, Vikas Vyas, Weisong Shi
University of Delaware
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Scalable over-the-air (OTA) updates for connected and autonomous vehicles (CAVs) present a significant challenge for many original vehicle equipment manufacturers (OEMs) due to the lack of scalability in their current software update solutions. We have proposed a novel reinforcement learning (RL) approach to tackle this issue. The problem-solving capability of deep reinforcement learning (RL) has been advanced in many fields, yet its potential for tackling over-the-air (OTA) update problems remains under-explored. As one of the backbones for enabling fast software iterations in various autonomous systems and robotic platforms, the OTA update problem remains challenging. This work primarily focuses on two key aspects of the OTA challenge: data payload size and memory overhead. By formulating the OTA problem and reducing it to a sequential codec construction problem and a Markov-Decision Process environment, we can apply deep reinforcement learning algorithms and generate approximately optimal OTA payload with small payload size and memory usage. Running experiments on real-world datasets, our proposed method performs better than open-source methods, effectively showcasing the potential of RL-augmented OTA update algorithms to reduce payload size and minimize runtime memory overhead. Finally, this work lays a robust foundation for applying deep RL in automotive OTA update systems, with potential implications for broader autonomous systems and robotic platforms.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
工程Autonomous Vehicle Technology and Safety
Vehicular Ad Hoc Networks (VANETs) · Reinforcement Learning in Robotics