A Joint Intelligent Optimization Scheme of Computation Offloading and Resource Allocation for MEC

doi:10.13190/j.jbupt.2021-145

Journal of Beijing University of Posts and Telecommunications ›› 2022, Vol. 45 ›› Issue (2): 65-71.doi: 10.13190/j.jbupt.2021-145

• PAPERS • Previous Articles Next Articles

A Joint Intelligent Optimization Scheme of Computation Offloading and Resource Allocation for MEC

DU Mei¹, ZHOU Junhua², LI Dunqiao³, CHEN Shizhao⁴, WEI Yifei¹

1. School of Electronic Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China;
2. Beijing Simulation Center, Beijing Advanced Manufacturing Engineering Research Center for Complex Products, Beijing 100854, China;
3. Guizhou Aerospace Control Technology Limited Company, Guiyang 550009, China;
4. Ningbo Zhongwan Technology Limited Company, Ningbo 315400, China

Received:2021-07-21 Published:2021-12-16

Abstract

Abstract: Due to the distributed base station deployment, limited server resources and dynamic end-users in mobile edge computing (MEC), the design of computation offloading scheme is extremely challenging. Since the deep reinforcement learning has advantages in terms of dealing with dynamic complex problems, we design the optimal computation offloading and resource allocation strategies based on deep reinforcement learning to minimize the system energy consumption. First, the network framework of cloud edge-end collaboration is considered. Then, the joint computation offloading and resource allocation problem is defined as a Markov decision process.Next, a multi-agent deep deterministic policy gradient-based learning algorithm is proposed to minimize the system energy consumption. The experimental results show that our proposed scheme significantly reduces the energy consumption compared to the deep deterministic policy gradient-based algorithm and the full offloading policy.

Key words: mobile edge computing, computation offloading, resource allocation, multi-agent reinforcement learning

CLC Number:

TP391.4

DU Mei, ZHOU Junhua, LI Dunqiao, CHEN Shizhao, WEI Yifei. A Joint Intelligent Optimization Scheme of Computation Offloading and Resource Allocation for MEC[J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 65-71.

References

[1] ABBAS N, ZHANG Y, TAHERKORDI A, et al. Mobile edge computing:a survey[J]. IEEE Internet of Things Journal, 2018, 5(1):450-465.
[2] MACH P, BECVAR Z. Mobile edge computing:a survey on architecture and computation offloading[J]. IEEE Communications Surveys and Tutorials, 2017, 19(3):1628-1656.
[3] WANG Y, GE H, FENG A, et al. Computation offloading strategy based on deep reinforcement learning in cloud-assisted mobile edge computing[C]//2020 IEEE 5th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA). Piscataway, NJ:IEEE Press, 2020:108-113.
[4] DAI Y, ZHANG K, MAHARJAN S, et al. Edge intelligence for energy-efficient computation offloading and resource allocation in 5G Beyond[J]. IEEE Transactions on Vehicular Technology, 2020, 69(10):12175-12186.
[5] LIANG H, XU F, CHENG Z, et al. Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing[J]. Digital Communications and Networks, 2019, 5(1):10-17.
[6] LV J F, XIONG J Y, GUO H Z, et al. Joint computation offloading and resource configuration in ultra-dense edge computing networks:a deep reinforcement learning solution[C]//VTC2019-Fall. Piscataway, NJ:IEEE Press, 2019:1-5.
[7] LOWER R, WU Y, TAMAR A, et al. Multiagent actor-critic for mixed cooperative-competitive environments[C]//International Conference on Neural Information Processing Systems.Piscataway, NJ:IEEE Press, 2017:6382-6393.
[8] ZHAO J H, LI Q P, GONG Y, et al. Computation offloading and resource allocation for cloud assisted mobile edge computing in vehicular networks[J]. IEEE Transactions on Vehicular Technology, 2019, 68(8):7944-7956.
[9] NGUYEN T T, LE L B. Computation offloading in MIMO based mobile edge computing systems under perfect and imperfect CSI estimation[C]//2018 IEEE International Conference on Communications (ICC).Piscataway, NJ:IEEE Press, 2018:1-6.
[10] DAI Y Y, XU D, MAHARJAN S, et al. Joint computation offloading and user association in multi-task mobile edge computing[J]. IEEE Transactions on Vehicular Technology, 2018, 67(12):12313-12325.
[11] XIAO J, YANG C G, ANPALAGAN A, et al. Joint interference management in ultra-dense small-cell networks:a multi-domain coordination perspective[J]. IEEE Transactions on Communications, 2018, 66(11):5470-5481.
[12] YU Y H, ZHANG J, LETAIEF K B. Joint subcarrier and CPU time allocation for mobile edge computing[C]//2016 IEEE Global Communications Conference. Piscataway, NJ:IEEE Press, 2016:1-6.
[13] BLUM L, SHUB M, SMALE S. On a theory of computation over the real numbers; NP completeness, recursive functions and universal machines[C]//29th Annual Symposium on Foundations of Computer Science. Piscataway, NJ:IEEE Press, 1988:387-397.

[1]	. Fog Node Contribution Degree Based Task Offloading Algorithm for Heterogeneous Cellular Network [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 37-42.
[2]	. Research on Resource Allocation and Task Offloading Joint Optimization for Mobile Edge Computing in Ultra-Dense Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 50-56.
[3]	. An Ensemble Learning-Aided DDPG Resource Optimization Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 29-36.
[4]	. Cooperative Offloading and Resource Allocation Algorithm of Multi-edge Nodes in VEC [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 78-83.
[5]	. Resource Allocation Based on Alternating Direction Multiplier Method and Deep Reinforcement Learning Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 126-130.
[6]	YU Xiaosong, ZHU Qingcheng, GU Jiaming, ZHAO Yongli, ZHANG Jie. Architecture and Resource Allocation of Cloud-Edge Collaboration Based Optical-Quantum Internet of Things [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(3): 50-56.
[7]	ZHI Jialin, WANG Nan, MAN Yi, TENG Yinglei. Hardware Model-Aware Joint Offloading and Resources Allocation Optimization [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 22-28.
[8]	ZHANG Yuqing, LI Yun, HUANG Hongrui, ZHUANG Hongcheng. Joint Optimization Algorithm for Task Offloading and Resource Allocation in Heterogeneous Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 91-97.
[9]	JIA Yuning, WEI Yifei, ZHOU Junhua. Service Function Chain Orchestrating Algorithm Based on SDN and NFV [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 85-90.
[10]	GAO Xiao-na, LU Guang-yue, YE Ying-hui, ZAN Jin-mei. Throughput Fairness Guarantee in Cognitive Backscattering Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(6): 26-32.
[11]	ZHENG Yuan-peng, ZHANG Tian-kui, ZHU Guang-yu, SHEN Hong. Network Slicing-Oriented Joint Allocation Algorithm of 3C Resources in MEC Systems [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(5): 41-47.
[12]	HUANG Xiao-ge, WANG Yong-sheng, LAI Chen-bin, CHEN Qian-bin. Trust Degree Based RSU Recognition and Resource Allocation in Vehicular Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(2): 109-115.
[13]	KANG Man-cong, LI Xi, JI Hong, ZHANG He-li. Collaborative Computation Offloading Exploring Task Dependencies in Small Cell Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 72-78.
[14]	XUE Jian-bin, BAI Zi-mei. Security and Efficient Authentication Scheme for Mobile Edge Computing [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 110-116.
[15]	ZHAO Wei, WANG Bin, BAO Hui, ZHAO Pin-fang, LI Bao-gang. Energy Efficient Resource Allocation for Secure MEC System Based on mMIMO [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(6): 126-131.

A Joint Intelligent Optimization Scheme of Computation Offloading and Resource Allocation for MEC

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments