关键词: 车载边缘计算, 计算卸载, 功率分配, 服务缓存, 深度确定性策略梯度

Abstract: A deep reinforcement learning-based computation offloading and power allocation algorithm is proposed to address the time-varying channel and stochastic task arrival problems caused by the mobility of vehicle in the vehicular edge computing environment. In this paper, we first build a three-layer system model for end-edge-cloud orchestrated computing based on non-orthogonal multiple access in a two-way lane scenario. By combining the communication, computing, cache resources and the mobility of vehicle, a joint optimization problem is designed to minimize the long-term cumulative total system cost consisting of power consumption and cache latency. Furthermore, in view of the dynamics, time-varying and stochastic characteristics in vehicular edge computing networks, a decentralized intelligent algorithm based on deep deterministic policy gradient (DDPG) is proposed for obtaining the power allocation optimization. Compared with conventional baseline algorithms, the simulation results illustrate that the proposed algorithm can achieve a superior performance in reducing the system total cost.

Key words: vehicular edge computing, computation offloading, power allocation, service caching, DDPG