Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

Journal of Beijing University of Posts and Telecommunications ›› 2023, Vol. 46 ›› Issue (3): 37-42.

Previous Articles     Next Articles

Cross-Domain Deterministic Networking Architecture and DRL Flow Scheduling

TAN Weiqian1,2, WU Binwei2, WANG Shuo2,3   


  • Received:2022-07-28 Revised:2022-11-28 Online:2023-06-28 Published:2023-06-05

Abstract:

A deterministic cross-domain transmission architecture and a deep reinforcement learning(DRL)-based scheduling algorithm are proposed to address the cross-domain transmission problem in time-sensitive networks. The deterministic cross-domain transmission architecture is a wide-area deterministic networking architecture that integrates cyclic queuing forwarding with deterministic Internet Protocol. By defining a cross-domain cycle mapping function, a time-slot-based deterministic transmission channel is established to ensure bounded transmission delay. DRL states, actions, and rewards are detined in the DRL-based time-slot path joint online scheduling algorithm, and the scheduling target is to maximize the total earning value of all scheduled flows with different earning values. Experimental results demonstrate that the proposed cross-domain transmission architecture and scheduling algorithm can ensure end-to-end deterministic transmission, significantly improve the earning value of traffic scheduling, and guarantee the transmission of important traffic.

Key words: deterministic networking, large-scale cross-domain communication, flow scheduling, deep reinforcement learning

CLC Number: