Year: 2018
Type: preprint
Abstract: We study the problem of serving randomly arriving and delay-sensitive traffic over a multi-channel communication system with time-varying channel states and unknown statistics. This problem deviates from the classical exploration-exploitation setting in that the design and analysis must accommodate the dynamics of packet availability and urgency as well as the cost of each channel use at the time of decision. To that end, we have developed and investigated an index-based policy UCB-Deadline, which performs dynamic channel allocation decisions that incorporate these traffic requirements and costs. Under symmetric channel conditions, we have proved that the UCB-Deadline policy can achieve bounded regret in the likely case where the cost of using a channel is not too high to prevent all transmissions, and logarithmic regret otherwise. In this case, we show that UCB-Deadline is order-optimal. We also perform numerical investigations to validate the theoretical findings, and also compare the performance of the UCB-Deadline to another learning algorithm that we propose based on Thompson Sampling.
Source: arXiv (Cornell University)
Authors: Cayci, Semih, Eryilmaz, Atilla
Institution: The Ohio State University
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
Awards: G2379327423, WiFiUS: Collaborative Research: Joint Network and Market Design for Content and Spectrum Sharing in Future 5G Networks (JoiNtMaCS), G4199344768, G5455151330, Collaborative Research: Performance Analysis and Design of Systems with Interconnected Resources, EARS: Collaborative Research: Mobile Millimeter-Wave Networking: Distributed Cognition and Coordination Algorithms using Novel On-Chip Phased-Arrays, G6541015203, G6990742964, ICN-WEN: Collaborative Research: SPLICE: Secure Predictive Low-Latency Information Centric Edge for Next Generation Wireless Networks
OpenAlex ID: W2949944368