Two-Stage Resource Scheduling for Deterministic Communication and Computation Integration

In this paper, we investigate a resource orchestration and transmission scheduling problem for data-intensive services with diversified service requirements. A three-layer collaborative architecture is presented to support dynamic networking and computing resource allocation. To obtain optimal orchestration and scheduling policies, we formulate a constrained resource scheduling problem with the objective to maximizing resource utilization and scheduling success ratio. Since the complicated coupled constraints among decisions, we decouple the problem into a two-stage sub-problems of resource orchestration and transmission scheduling. To realize cross-domain resource orchestration and deterministic transmission of large-scale computing tasks, a two-stage resource scheduling scheme is proposed. Specifically, the first stage makes the resource orchestration decision by a greedy algorithm, and the second stage makes the transmission scheduling decision based on a deep reinforcement learning algorithm. Simulation results show that the proposed solution can effectively improve resource utilization and scheduling success ratio while satisfying diversified service requirements, as compared with benchmarks.