QFlow: A Reinforcement Learning Approach to High QoE Video Streaming over Wireless Networks
Year: 2019
Type: conference-paper
Abstract: Wireless Internet access has brought legions of heterogeneous applications all sharing the same resources. However, current wireless edge networks that cater to worst or average case performance lack the agility to best serve these diverse sessions. Simultaneously, software reconfigurable infrastructure has become increasingly mainstream to the point that dynamic per packet and per flow decisions are possible at multiple layers of the communications stack. Exploiting such reconfigurability requires the design of a system that can enable a configuration, measure the impact on the application performance (Quality of Experience), and adaptively select a new configuration. Effectively, this feedback loop is a Markov Decision Process whose parameters are unknown. The goal of this work is to design, develop and demonstrate QFlow that instantiates this feedback loop as an application of reinforcement learning (RL). Our context is that of reconfigurable (priority) queueing, and we use the popular application of video streaming as our use case. We develop both model-free and model-based RL approaches that are tailored to the problem of determining which clients should be assigned to which queue at each decision period. Through experimental validation, we show how the RL-based control policies on QFlow are able to schedule the right clients for prioritization in a high-load scenario to outperform the status quo, as well as the best known solutions with over 25% improvement in QoE, and a perfect QoE score of 5 over 85% of the time.
Institution: Texas A&M University
Language: English
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
Funder: National Science Foundation
Awards: CAREER: Beyond Akamai and BitTorrent: Information and Decision Dynamics in Content Distribution Networks, Collaborative Research: EARS: Creating an Ecosystem for Enhanced Spectrum Utilization Through Dynamic Market Mechanisms, NeTS: Medium: Collaborative Research: Economics of Contractual Arrangements for Internet Interconnections, ICN-WEN: Collaborative Research: SPLICE: Secure Predictive Low-Latency Information Centric Edge for Next Generation Wireless Networks
OpenAlex ID: W2963556501
