Work

AuTO: scaling deep reinforcement learning for datacenter-scale automatic traffic optimization

Year: 2018
Type: conference-paper
Abstract: Traffic optimizations (TO, e.g. flow scheduling, load balancing) in datacenters are difficult online decision-making problems. Previously, they are done with heuristics relying on operators' understanding of the workload and environment. Designing and implementing proper TO algorithms thus take at least weeks. Encouraged by recent successes in applying deep reinforcement learning (DRL) techniques to solve complex online control problems, we study if DRL can be used for automatic TO without human-intervention. However, our experiments show that the latency of current DRL systems cannot handle flow-level TO at the scale of current datacenters, because short flows (which constitute the majority of traffic) are usually gone before decisions can be made.
Language: English
Open Access status: bronze
OpenAlex ID: W2824027552
FWCI: 23.83
Cites: 47
Cited by: 289
Related to: 10