A Charging Strategy with Battery Swapping Station in Car-Sharing System Using Deep Q-network

The development of car-sharing system using electric vehicles (EVs) is a promising solution to mitigate traffic pressure and reduce carbon emissions. As the market scale of car-sharing expands gradually, the electricity refueling of EVs in car-sharing system becomes quite vital. We propose the concept of car-sharing battery swapping station (CSBSS), which has both the functions of a car-sharing station and a battery swapping station. An individual CSBSS is modeled as a coupled queuing network. Deep Q-Network (DQN) is implemented in this paper to control the charging operation of replaced batteries (RBs). The proposed charging control strategy can fetch more profit than the baseline scheme. Moreover, the simulation results show that more profits can be obtained by adjusting the state of charge (SOC) threshold or the total number of batteries. Our work provides a practical perspective and guidance for the problem of refueling car-sharing EVs.