Neural-Enhanced Rate Adaptation and Computation Distribution for Emerging mmWave Multi-User 3D Video Streaming Systems
Year: 2025
Type: article
Abstract: We investigate multitask edge-user communication-computation resource allocation for$360^\circ$video streaming in an edge-computing enabled millimeter wave (mmWave) multi-user virtual reality system. To balance the communication-computation trade-offs that arise herein, we formulate a video quality maximization problem that integrates interdependent multitask/multi-user action spaces and rebuffering time/quality variation constraints. We formulate a deep reinforcement learning framework formulti-taskrate adaptation andcomputation distribution (MTRC) to solve the problem of interest. Our solution does not rely on a priori knowledge about the environment and uses only prior video streaming statistics (e.g., throughput, decoding time, and transmission delay), and content information, to adjust the assigned video bitrates and computation distribution, as it observes the induced streaming performance online. Moreover, to capture the task interdependence in the environment, we leverage neural network cascades to extend our MTRC method to two novel variants denoted as R1C2 and C1R2. We train all three methods with real-world mmWave network traces and$360^\circ$video datasets to evaluate their performance in terms of expected quality of experience (QoE), viewport peak signal-to-noise ratio (PSNR), rebuffering time, and quality variation. We outperform state-of-the-art rate adaptation algorithms, with C1R2 showing best results and achieving$5.21-6.06$dB PSNR gains,$2.18-2.70$x rebuffering time reduction, and$4.14-4.50$dB quality variation reduction.
Source: IEEE Transactions on Multimedia
Institutions: University of Kansas, New Jersey Institute of Technology
Language: English
Topic: IoT and Edge/Fog Computing
Subfield: Computer Networks and Communications
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Awards: Collaborative Research: CNS Core: Medium: miVirtualSeat: Semantics-aware Content Distribution for Immersive Meeting Environments, Collaborative Research: CNS Core: Medium: Combating Latency and Disconnectivity in mmWave Networks: From Theory to Implementation, ICE-T: RC: Millimeter Wave Communications and Edge Computing for Next Generation Tetherless Mobile Virtual Reality, GOALI: CNS: Medium: Communication-Computation Co-Design for Rural Connectivtiy and Intelligence under Nonuniformity: Modeling, Analysis, and Implementation, IMR: MT: AirScope: A Versatile and Programmable UAV Platform for End-to-End Cellular Network Measurements in Rural Environments, Automated Orientation & Mobility Training in Virtual Reality for Low Vision Rehabilitation, CIRC: Dev: SMILE:Scan to Multi-sensorial Interactive Learning Environment
OpenAlex ID: W4412605415
