基于DRL的MEC任务卸载与资源调度算法

doi:10.13190/j.jbupt.2019-155

北京邮电大学学报 ›› 2019, Vol. 42 ›› Issue (6): 64-69,104.doi: 10.13190/j.jbupt.2019-155

基于DRL的MEC任务卸载与资源调度算法

薛宁¹, 霍如^1,2, 曾诗钦³, 汪硕^2,3, 黄韬^2,3

1. 北京工业大学北京未来网络科技高精尖创新中心, 北京 100124;
2. 网络通信与安全紫金山实验室, 南京 211111;
3. 北京邮电大学网络与交换技术国家重点实验室, 北京 100876

收稿日期:2019-07-11 出版日期:2019-12-28 发布日期:2019-11-15
通讯作者: 霍如(1988-),女,讲师,E-mail:huoru@bjut.edu.cn. E-mail:huoru@bjut.edu.cn
作者简介:薛宁(1994-),男,硕士生.
基金资助:
国家自然科学基金项目（61902033）；未来网络操作系统发展战略研究（2019-XY-5）

Tasks Offloading and Resource Scheduling Algorithm Based on Deep Reinforcement Learning in MEC

XUE Ning¹, HUO Ru^1,2, ZENG Shi-qing³, WANG Shuo^2,3, HUANG Tao^2,3

1. Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of Technology, Beijing 100124, China;
2. Purple Mountain Laboratories, Nanjing 211111, China;
3. State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2019-07-11 Online:2019-12-28 Published:2019-11-15

摘要/Abstract

摘要： 为提高多接入边缘计算（MEC）任务卸载效率，提出了一个任务卸载和异构资源调度的联合优化模型.考虑异构的通信资源和计算资源，联合最小化用户的设备能耗、任务执行时延和付费，并利用深度强化学习（DRL）算法对该模型求最优的任务卸载算法.仿真结果表明，该优化算法比银行家算法的设备能耗、时延和付费的综合指标提升了27.6%.

关键词: 多接入边缘计算, 任务卸载, 异构资源调度, 深度强化学习

Abstract: In order to improve the task offloading efficiency in multi-access edge computing (MEC), a joint optimization model for task offloading and heterogeneous resource scheduling was proposed, considering the heterogeneous communication resources and computing resources, jointly minimizing the energy consumption of user equipment, task execution delay, and the payment. A deep reinforcement learning method is adopted in the model to obtain the optimal offloading algorithm. Simulations show that the proposed algorithm improves the comprehensive indexes of equipment energy consumption, delay, and payment by 27.6%, compared to the Banker's algorithm.

Key words: multi-access edge computing, task offloading, heterogeneous resource scheduling, deep reinforcement learning

中图分类号:

TP393

薛宁, 霍如, 曾诗钦, 汪硕, 黄韬. 基于DRL的MEC任务卸载与资源调度算法[J]. 北京邮电大学学报, 2019, 42(6): 64-69,104.

XUE Ning, HUO Ru, ZENG Shi-qing, WANG Shuo, HUANG Tao. Tasks Offloading and Resource Scheduling Algorithm Based on Deep Reinforcement Learning in MEC[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 64-69,104.

参考文献

[1] Mao Yuyi, You Changsheng, Zhang Jun, et al. A survey on mobile edge computing:the communication perspective[J]. IEEE Communications Surveys & Tutorials, 2017, 19(4):2322-2358.
[2] Huang D, Wang P, Niyato D. A dynamic offloading algorithm for mobile computing[J]. IEEE Transactions on Wireless Communications, 2012, 11(6):1991-1995.
[3] Chen Xu, Jiao Lei, Li Wenzhong, et al. Efficient multi-user computation offloading for mobile-edge cloud computing[J]. ACM Transactions on Networking, 2016, 24(5):2795-2808.
[4] Ebrahimzadeh A, Maier M. Distributed cooperative computation offloading in multi-access edge computing fiber-wireless networks[J]. Optics Communications, 2019, 452:130-139.
[5] Wang Feng, Xu Jie, Wang Xin, et al. Joint offloading and computing optimization in wireless powered mobile-edge computing systems[J]. IEEE Transactions on Wireless Communications, 2017, 17(3):1784-1797.
[6] Chen Min, Hao Yixue. Task offloading for mobile edge computing in software defined ultra-dense network[J]. IEEE Journal on Selected Areas in Communications, 2018, 36(3):587-597.
[7] Chen M H, Liang Ben, Dong Min. Joint offloading and resource allocation for computation and communication in mobile cloud with computing access point[C]//IEEE INFOCOM 2017 IEEE Conference on Computer Communications. Atlanta, GA:IEEE Press, 2017:1-9.
[8] 孟浩, 霍如, 郭倩影, 等. 基于机器学习的MEC随机任务迁移算法[J]. 北京邮电大学学报, 2019, 42(2):25-30. Meng Hao, Huo Ru, Guo Qianying, et al. Machine learning-based stochastic task offloading algorithm in mobile-edge computing[J]. Journal of Beijing University of Posts and Telecommunications, 2019, 42(2):25-30.
[9] Guo Songtao, Xiao Bin, Yang Yuanyuan, et al. Energy-efficient dynamic offloading and resource scheduling in mobile cloud computing[C]//IEEE INFOCOM 2016 The 35^th Annual IEEE International Conference on Computer Communications. San Francisco, CA:IEEE Press, 2016:1-9.
[10] Yang L, Cao J, Cheng H, et al. Multi-user computation partitioning for latency sensitive mobile cloud applications[J]. IEEE Transactions on Computers, 2014, 64(8):2253-2266.
[11] Yu Yingha, Zhang Jun, Letaief K B. Joint subcarrier and CPU time allocation for mobile edge computing[C]//2016 IEEE Global Communications Conference (GLOBECOM). Washington DC:IEEE Press, 2016:1-6.

[1]	刘阳, 滕颖蕾, 牛涛, 郅佳琳. 基于深度强化学习的滤波器剪枝方案[J]. 北京邮电大学学报, 2023, 46(3): 31-36.
[2]	谭炜骞, 吴斌伟, 汪硕. 确定性网络跨域传输架构与DRL流量调度算法[J]. 北京邮电大学学报, 2023, 46(3): 37-42.
[3]	杨华, 耿烜, 孔宁. 一种采用dueling-DDQN算法的无线网络MAC协议[J]. 北京邮电大学学报, 2023, 46(3): 25-30.
[4]	魏明亮耿绥燕赵雄文胡玮范静怡. 超密集网络中移动边缘计算的资源分配和任务卸载联合优化研究[J]. 北京邮电大学学报, 2023, 46(2): 50-56.
[5]	李晓辉苏家楠吕思婷张鹏. 基于SMDP模型的车路协同任务智能卸载算法研究[J]. 北京邮电大学学报, 2023, 46(2): 15-21.
[6]	公雨魏翼飞. 一种集成学习辅助DDPG的资源优化算法[J]. 北京邮电大学学报, 2023, 46(2): 29-36.
[7]	孙国玮许方敏朱瑾瑜张恒升赵成林. 算力网络中的确定性调度与路由联合智能优化方案[J]. 北京邮电大学学报, 2023, 46(2): 9-14.
[8]	谢人超杨煜天唐琴琴陈清霞向雪霜. 低轨卫星网络星载边缘DNN推理策略研究[J]. 北京邮电大学学报, 2023, 46(2): 57-63.
[9]	郭兴康孙君. 基于交替方向乘子法与深度强化学习算法的资源分配[J]. 北京邮电大学学报, 2022, 45(6): 126-130.
[10]	郭令奇褚智贤廖建新王敬宇陆璐. 意图驱动的自智网络资源按需服务[J]. 北京邮电大学学报, 2022, 45(6): 85-91.
[11]	蒋丽缪家辉郑镐谢正昊赖健鑫. 虚实映射误差条件下数字孪生辅助的无人机网络计算任务卸载及资源自适应优化机制[J]. 北京邮电大学学报, 2022, 45(6): 138-144.
[12]	鲁蔚锋, 李学晴, 徐佳, 陈思光. 边缘计算架构中P2P的组合多资源任务卸载算法[J]. 北京邮电大学学报, 2022, 45(4): 98-103.
[13]	郅佳琳, 王楠, 满毅, 滕颖蕾. 面向硬件感知的边缘计算卸载和资源分配[J]. 北京邮电大学学报, 2022, 45(2): 22-28.
[14]	张雨晴, 李云, 黄鸿锐, 庄宏成. 异构网络中任务卸载与资源分配联合优化算法[J]. 北京邮电大学学报, 2022, 45(2): 91-97.
[15]	陈伟, 霍如, 汪硕, 黄韬, 刘韵洁. 基于区块链的D2D辅助的MEC资源共享架构[J]. 北京邮电大学学报, 2021, 44(5): 1-9.

基于DRL的MEC任务卸载与资源调度算法

Tasks Offloading and Resource Scheduling Algorithm Based on Deep Reinforcement Learning in MEC

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价