Work

Market-based Architectures in RL and Beyond

Year: 2025
Type: preprint
Abstract: Market-based agents refer to reinforcement learning agents which determine their actions based on an internal market of sub-agents. We introduce a new type of market-based algorithm where the state itself is factored into several axes called ``goods'', which allows for greater specialization and parallelism than existing market-based RL algorithms. Furthermore, we argue that market-based algorithms have the potential to address many current challenges in AI, such as search, dynamic scaling and complete feedback, and demonstrate that they may be seen to generalize neural networks; finally, we list some novel ways that market algorithms may be applied in conjunction with Large Language Models for immediate practical applicability.
Authors: Sudhir, Abhimanyu Pallavi, Tran-Thanh, Long
Language: English
Open Access status: green
OpenAlex ID: W6966513992
Cites:
Cited by:
Related to: