Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning
Joint Authors
Li, Wenkai
Wang, Chenyang
Li, Ding
Hu, Bin
Wang, Xiaofei
Ren, Jianji
Source
Wireless Communications and Mobile Computing
Issue
Vol. 2019, Issue 2019 (31 Dec. 2019), pp.1-12, 12 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2019-02-27
Country of Publication
Egypt
No. of Pages
12
Main Subjects
Information Technology and Computer Science
Abstract EN
Edge caching is a promising method to deal with the traffic explosion problem towards future network.
In order to satisfy the demands of user requests, the contents can be proactively cached locally at the proximity to users (e.g., base stations or user device).
Recently, some learning-based edge caching optimizations are discussed.
However, most of the previous studies explore the influence of dynamic and constant expanding action and caching space, leading to unpracticality and low efficiency.
In this paper, we study the edge caching optimization problem by utilizing the Double Deep Q-network (Double DQN) learning framework to maximize the hit rate of user requests.
Firstly, we obtain the Device-to-Device (D2D) sharing model by considering both online and offline factors and then we formulate the optimization problem, which is proved as NP-hard.
Then the edge caching replacement problem is derived by Markov decision process (MDP).
Finally, an edge caching strategy based on Double DQN is proposed.
The experimental results based on large-scale actual traces show the effectiveness of the proposed framework.
American Psychological Association (APA)
Li, Wenkai& Wang, Chenyang& Li, Ding& Hu, Bin& Wang, Xiaofei& Ren, Jianji. 2019. Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning. Wireless Communications and Mobile Computing،Vol. 2019, no. 2019, pp.1-12.
https://search.emarefa.net/detail/BIM-1212044
Modern Language Association (MLA)
Li, Wenkai…[et al.]. Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning. Wireless Communications and Mobile Computing No. 2019 (2019), pp.1-12.
https://search.emarefa.net/detail/BIM-1212044
American Medical Association (AMA)
Li, Wenkai& Wang, Chenyang& Li, Ding& Hu, Bin& Wang, Xiaofei& Ren, Jianji. Edge Caching for D2D Enabled Hierarchical Wireless Networks with Deep Reinforcement Learning. Wireless Communications and Mobile Computing. 2019. Vol. 2019, no. 2019, pp.1-12.
https://search.emarefa.net/detail/BIM-1212044
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1212044