A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles

Pu Zhao, Yanzhi Wang, Naehyuck Chang, Qi Zhu, Xue Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Hybrid electric vehicles employ a hybrid propulsion system to combine the energy efficiency of electric motor and a long driving range of internal combustion engine, thereby achieving a higher fuel economy as well as convenience compared with conventional ICE vehicles. However, the relatively complicated powertrain structures of HEVs necessitate an effective power management policy to determine the power split between ICE and EM. In this work, we propose a deep reinforcement learning framework of the HEV power management with the aim of improving fuel economy. The DRL technique is comprised of an offline deep neural network construction phase and an online deep Q-learning phase. Unlike traditional reinforcement learning, DRL presents the capability of handling the high dimensional state and action space in the actual decision-making process, making it suitable for the HEV power management problem. Enabled by the DRL technique, the derived HEV power management policy is close to optimal, fully model-free, and independent of a prior knowledge of driving cycles. Simulation results based on actual vehicle setup over real-world and testing driving cycles demonstrate the effectiveness of the proposed framework on optimizing HEV fuel economy.
Original languageEnglish (US)
Title of host publicationProceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18)
Pages196-202
Number of pages7
StatePublished - 2018

Fingerprint

Reinforcement learning
Hybrid vehicles
Fuel economy
Powertrains
Electric motors
Internal combustion engines
Propulsion
Energy efficiency
Decision making
Power management
Testing

Cite this

Zhao, P., Wang, Y., Chang, N., Zhu, Q., & Lin, X. (2018). A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles. In Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18) (pp. 196-202)
Zhao, Pu ; Wang, Yanzhi ; Chang, Naehyuck ; Zhu, Qi ; Lin, Xue. / A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles. Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18). 2018. pp. 196-202
@inproceedings{52ca97d15b5348bf991379623581e15d,
title = "A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles",
abstract = "Hybrid electric vehicles employ a hybrid propulsion system to combine the energy efficiency of electric motor and a long driving range of internal combustion engine, thereby achieving a higher fuel economy as well as convenience compared with conventional ICE vehicles. However, the relatively complicated powertrain structures of HEVs necessitate an effective power management policy to determine the power split between ICE and EM. In this work, we propose a deep reinforcement learning framework of the HEV power management with the aim of improving fuel economy. The DRL technique is comprised of an offline deep neural network construction phase and an online deep Q-learning phase. Unlike traditional reinforcement learning, DRL presents the capability of handling the high dimensional state and action space in the actual decision-making process, making it suitable for the HEV power management problem. Enabled by the DRL technique, the derived HEV power management policy is close to optimal, fully model-free, and independent of a prior knowledge of driving cycles. Simulation results based on actual vehicle setup over real-world and testing driving cycles demonstrate the effectiveness of the proposed framework on optimizing HEV fuel economy.",
author = "Pu Zhao and Yanzhi Wang and Naehyuck Chang and Qi Zhu and Xue Lin",
year = "2018",
language = "English (US)",
pages = "196--202",
booktitle = "Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18)",

}

Zhao, P, Wang, Y, Chang, N, Zhu, Q & Lin, X 2018, A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles. in Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18). pp. 196-202.

A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles. / Zhao, Pu; Wang, Yanzhi; Chang, Naehyuck; Zhu, Qi; Lin, Xue.

Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18). 2018. p. 196-202.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles

AU - Zhao, Pu

AU - Wang, Yanzhi

AU - Chang, Naehyuck

AU - Zhu, Qi

AU - Lin, Xue

PY - 2018

Y1 - 2018

N2 - Hybrid electric vehicles employ a hybrid propulsion system to combine the energy efficiency of electric motor and a long driving range of internal combustion engine, thereby achieving a higher fuel economy as well as convenience compared with conventional ICE vehicles. However, the relatively complicated powertrain structures of HEVs necessitate an effective power management policy to determine the power split between ICE and EM. In this work, we propose a deep reinforcement learning framework of the HEV power management with the aim of improving fuel economy. The DRL technique is comprised of an offline deep neural network construction phase and an online deep Q-learning phase. Unlike traditional reinforcement learning, DRL presents the capability of handling the high dimensional state and action space in the actual decision-making process, making it suitable for the HEV power management problem. Enabled by the DRL technique, the derived HEV power management policy is close to optimal, fully model-free, and independent of a prior knowledge of driving cycles. Simulation results based on actual vehicle setup over real-world and testing driving cycles demonstrate the effectiveness of the proposed framework on optimizing HEV fuel economy.

AB - Hybrid electric vehicles employ a hybrid propulsion system to combine the energy efficiency of electric motor and a long driving range of internal combustion engine, thereby achieving a higher fuel economy as well as convenience compared with conventional ICE vehicles. However, the relatively complicated powertrain structures of HEVs necessitate an effective power management policy to determine the power split between ICE and EM. In this work, we propose a deep reinforcement learning framework of the HEV power management with the aim of improving fuel economy. The DRL technique is comprised of an offline deep neural network construction phase and an online deep Q-learning phase. Unlike traditional reinforcement learning, DRL presents the capability of handling the high dimensional state and action space in the actual decision-making process, making it suitable for the HEV power management problem. Enabled by the DRL technique, the derived HEV power management policy is close to optimal, fully model-free, and independent of a prior knowledge of driving cycles. Simulation results based on actual vehicle setup over real-world and testing driving cycles demonstrate the effectiveness of the proposed framework on optimizing HEV fuel economy.

M3 - Conference contribution

SP - 196

EP - 202

BT - Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18)

ER -

Zhao P, Wang Y, Chang N, Zhu Q, Lin X. A Deep Reinforcement Learning Framework for Optimizing Fuel Economy of Hybrid Electric Vehicles. In Proceedings of the 23rd Asia and South Pacific Design Automation Conference (ASP-DAC’18). 2018. p. 196-202