HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces
Joint Authors
Huang, Zetian
Chen, Jianping
Fu, Qiming
Wu, Hongjie
Lu, You
Gao, Zhen
Source
Mathematical Problems in Engineering
Issue
Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-12, 12 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2020-10-27
Country of Publication
Egypt
No. of Pages
12
Main Subjects
Abstract EN
We propose an optimization method, named as the Multistep-Actor Critic (MAC) algorithm, which uses the value-network and the action-network, where the action-network is based on the deep Q-network (DQN).
The proposed method is intended to solve the problem of energy conservation optimization of heating, ventilating, and air-conditioning (HVAC) system in a large action space, principally for the cases with high computation and convergence time.
The method employs the multistep action-network and search tree to generate the original state and then selects the optimal state based on the value-network for the original and the adjacent states.
The results from the application of the MAC algorithm to a simulation problem on the TRNSYS system, where the simulation problem is referring to a real supertall building in Hong Kong, have shown that the proposed MAC algorithm balances control actions between different HVAC subsystems.
Further, it substantially saves the computational time while maintaining a good energy conservation performance.
American Psychological Association (APA)
Huang, Zetian& Chen, Jianping& Fu, Qiming& Wu, Hongjie& Lu, You& Gao, Zhen. 2020. HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces. Mathematical Problems in Engineering،Vol. 2020, no. 2020, pp.1-12.
https://search.emarefa.net/detail/BIM-1193181
Modern Language Association (MLA)
Huang, Zetian…[et al.]. HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces. Mathematical Problems in Engineering No. 2020 (2020), pp.1-12.
https://search.emarefa.net/detail/BIM-1193181
American Medical Association (AMA)
Huang, Zetian& Chen, Jianping& Fu, Qiming& Wu, Hongjie& Lu, You& Gao, Zhen. HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces. Mathematical Problems in Engineering. 2020. Vol. 2020, no. 2020, pp.1-12.
https://search.emarefa.net/detail/BIM-1193181
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1193181