Intelligent Resource Allocation Algorithm for 6G Multi-Tenant Network Slicing Based on Deep Reinforcement Learning

doi:10.13190/j.jbupt.2020-211

Journal of Beijing University of Posts and Telecommunications ›› 2020, Vol. 43 ›› Issue (6): 132-139.doi: 10.13190/j.jbupt.2020-211

Previous Articles Next Articles

Intelligent Resource Allocation Algorithm for 6G Multi-Tenant Network Slicing Based on Deep Reinforcement Learning

GUAN Wan-qing¹, ZHANG Hai-jun^1,2, LU Zhao-ming^3,4

1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China;
2. Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China;
3. Beijing Key Laboratory of Network System Architecture and Convergence, Beijing University of Posts and Telecommunications, Beijing 100876, China;
4. Beijing Laboratory of Advanced Information Networks, Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2020-10-14 Online:2020-12-28 Published:2020-11-30

Abstract

Abstract: In the future, the sixth generation of mobile communications system (6G) network services merge reality and virtual reality, and support real-time interaction. It is urgent to quickly match the personalized service requirements of multiple tenants, therefore a two-layer hierarchical intelligent management scheme for network slicing is proposed, including the global resource manager at the upper level and the local resource managers for different tenants at the lower level. Firstly, based on the real-time status description of end-to-end slice, a service quality evaluation model is established considering the difference of multi-type slice requests from different tenants. With the service quality feedback, deep reinforcement learning (DRL) algorithm is adopted to optimize the global resource allocation and local resource adjustment. Hence, utilization efficiency of multi-dimensional resources in different domains are improved and tenants are able to customize resource usage. The simulation results show that the proposed scheme can optimize the long-term revenue of resource providers while guaranteeing the service quality.

Key words: the sixth generation of mobile communications system, multi-tenant network slicing, intelligent management, deep reinforcement learning

CLC Number:

TN929.53

GUAN Wan-qing, ZHANG Hai-jun, LU Zhao-ming. Intelligent Resource Allocation Algorithm for 6G Multi-Tenant Network Slicing Based on Deep Reinforcement Learning[J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 132-139.

References

[1] David K, Berndt H. 6G Vision and requirements:is there any need for beyond 5G?[J]. IEEE Vehicular Technology Magazine, 2018, 13(3):72-80.
[2] Samdanis K, Costa-Perez X, Sciancalepore V. From network sharing to multi-tenancy:the 5G network slice broker[J]. IEEE Communications Magazine, 2016, 54(7):32-39.
[3] Zhang Haijun, Liu Na, Chu Xiaoli, et al. Network slicing based 5G and future mobile networks:mobility, resource management, and challenges[J]. IEEE Communications Magazine, 2017, 55(8):138-145.
[4] Foukas X, Patounas G, Elmokashfi A, et al. Network slicing in 5G:survey and challenges[J]. IEEE Communications Magazine, 2017, 55(5):94-100.
[5] Zhang Zhengquan, Xiao Yue, Ma Zheng, et al. 6G wireless networks:vision, requirements, architecture, and key technologies[J]. IEEE Vehicular Technology Magazine, 2019, 14(3):28-41.
[6] 张平, 牛凯, 田辉, 等. 6G移动通信技术展望[J]. 通信学报, 2019, 40(1):141-148. Zhang Ping, Niu Kai, Tian Hui, et al. Technology prospect of 6G mobile communications[J]. Journal on Communications, 2019, 40(1):141-148.
[7] Zhang Haijun, Yang Ning, Huangfu Wei, et al. Power control based on deep reinforcement learning for spectrum sharing[J]. IEEE Transactions on Wireless Communications, 2020, 19(6):4209-4219.
[8] Raza M R, Natalino C, Öhlen P, et al. Reinforcement learning for slicing in a 5G flexible ran[J]. Journal of Lightwave Technology, 2019, 37(20):5161-5169.
[9] Huynh N V, Hoang D T, Nguyen D N, et al. Optimal and fast real-time resource slicing with deep dueling neural networks[J]. IEEE Journal on Selected Areas in Communications, 2019, 37(6):1455-1470.
[10] Sciancalepore V, Costa-Perez X, Banchs A. RL-NSB:reinforcement learning-based 5G network slice broker[J]. IEEE/ACM Transactions on Networking, 2019, 27(4):1543-1557.
[11] Taleb T, Afolabi I, Samdanis K, et al. On multi-domain network slicing orchestration architecture and federated resource control[J]. IEEE Network, 2019, 33(5):242-252.
[12] Shen Xueming, Gao Jie, Wu Wen, et al. AI-assisted network-slicing based next-generation wireless networks[J]. IEEE Open Journal of Vehicular Technology, 2020, 1:45-66.

[1]	LIU Yang, TENG Yinglei, NIU Tao, ZHI Jialin. Filter Pruning Algorithm Based on Deep Reinforcement Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 31-36.
[2]	TAN Weiqian, WU Binwei, WANG Shuo. Cross-Domain Deterministic Networking Architecture and DRL Flow Scheduling [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 37-42.
[3]	YANG Hua, GENG Xuan, KONG Ning. A MAC Protocol for Wireless Networks Using Dueling-DDQN Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 25-30.
[4]	. An Ensemble Learning-Aided DDPG Resource Optimization Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 29-36.
[5]	. Deterministic Scheduling and Routing Joint Intelligent Optimization Scheme in Computing First Network [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 9-14.
[6]	. Resource Allocation Based on Alternating Direction Multiplier Method and Deep Reinforcement Learning Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 126-130.
[7]	. Intent-driven Demand-aware Resource Service in Autonomous Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 85-91.
[8]	. Polar Coded Modulation for 6G System [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 1-11.
[9]	ZHI Jialin, WANG Nan, MAN Yi, TENG Yinglei. Hardware Model-Aware Joint Offloading and Resources Allocation Optimization [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 22-28.
[10]	YAN Shi, PENG Mu-gen, WANG Wen-bo. Integration of Communication, Sensing and Computing: the Vision and Key Technologies of 6G [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(4): 1-11.
[11]	KANG Wei-min, YANG Hong-wen. Application of Constellation Shaping in Faster than Nyquist Transmission [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 32-37.
[12]	HUANG Hao, HU Zhi-qun, WANG Lu-han, LU Zhao-ming, WEN Xiang-ming. Intelligent Traffic Signal Control Algorithm Based on Sumtree DDPG [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 97-103.
[13]	WANG Xiao-xiao, DAN Zhen-lei, GU Chen-wei, ZHU Wei-ping, LIN Min. Secure Beamforming Scheme for Multi-Antenna UAV Communication Systems [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 103-109.
[14]	HE Jian-hua, ZHAO Hui, XU Xiao-bin, YAN Lei, WANG Shang-guang. Data Collection Method of Space-Based Internet of Things Based on Improved Double Level Distributed LT Code [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 118-125.
[15]	CUI Chun-feng, WANG Sen, LI Ke, DONG Jing, ZHENG Zhi-min. 6G Vision, Scenarios and Network Requirements [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 10-17.

Intelligent Resource Allocation Algorithm for 6G Multi-Tenant Network Slicing Based on Deep Reinforcement Learning

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments