Work

Multiagent -Learning for Aloha-Like Spectrum Access in Cognitive Radio Systems

Year: 2010
Type: article
Abstract: An Aloha-like spectrum access scheme without negotiation is considered for multiuser and multichannel cognitive radio systems. To avoid collisions incurred by the lack of coordination, each secondary user learns how to select channels according to its experience. Multiagent reinforcement leaning (MARL) is applied for the secondary users to learn good strategies of channel selection. Specifically, the framework of -learning is extended from single user case to multiagent case by considering other secondary users as a part of the environment. The dynamics of the -learning are illustrated using a Metrick-Polak plot, which shows the traces of -values in the two-user case. For both complete and partial observation cases, rigorous proofs of the convergence of multiagent -learning without communications, under certain conditions, are provided using the Robins-Monro algorithm and contraction mapping, respectively. The learning performance (speed and gain in utility) is evaluated by numerical simulations.
Author: Husheng Li
Language: English
Open Access status: gold
Estimated APC paid: $1,790
OpenAlex ID: W1976294375
FWCI: 8.846
Cites: 30
Cited by: 79
Related to: 10