Keyword

value iteration

Description: Value iteration is a dynamic programming algorithm that repeatedly updates estimates of state values to find optimal policies in Markov decision processes.

Primary topic: Adaptive Dynamic Programming Control (25%)

OpenAlex ID: keywords/value-iteration

Introduction to Reinforcement Learning

1998 · Richard S. Sutton, Andrew G. Barto · 6,672

Approximate Dynamic Programming

2011 · Warren B. Powell · Wiley series in probability and statistics · 2,301

Residual Algorithms: Reinforcement Learning with Function Approximation

1995 · Leemon Baird · Elsevier eBooks · 936

Reinforcement Learning and Dynamic Programming Using Function Approximators

2010 · Lucian Busoniu, Robert Babuska, et al. · CRC Press eBooks · 920

PDF

Combined Pricing and Inventory Control Under Uncertainty

1999 · Awi Federgruen, Aliza Heching · Operations Research · 650

Regression methods for pricing complex American-style options

2001 · J.N. Tsitsiklis, B. Van Roy · IEEE Transactions on Neural Networks · 612

Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data

2010 · F L Lewis, K G Vamvoudakis · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · 544

Risk-Sensitive Markov Decision Processes

1972 · Ronald A. Howard, James E. Matheson · Management Science · 503

Two formal analyses of attack graphs

2003 · S. Jha, O. Sheyner, et al. · 502

A Sparse Sampling Algorithm for Near-Optimal Planning in Large Markov Decision Processes

2002 · Michael Kearns, Yishay Mansour, et al. · Machine Learning · 489

PDF

Value Iteration Networks

2017 · Aviv Tamar, Yi Wu, et al. · International Joint Conference on Artificial Intelligence · 483

PDF

Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems

2015 · Qinglai Wei, Derong Liu, et al. · IEEE Transactions on Cybernetics · 465

Stable Function Approximation in Dynamic Programming

1995 · Geoffrey J. Gordon · Elsevier eBooks · 449

Risk-averse dynamic programming for Markov decision processes

2010 · Andrzej Ruszczyński · Mathematical Programming · 417

Heuristic search value iteration for POMDPs

2004 · Trey Smith, Reid Simmons · 417

Comparing solution methods for dynamic equilibrium economies

2005 · S. Borağan Aruoba, Jesús Fernández-Villaverde, et al. · Journal of Economic Dynamics and Control · 400

An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks

2008 · E. Stevens-Navarro, Yuxia Lin, et al. · IEEE Transactions on Vehicular Technology · 395

Cost-Based Scheduling of Scientific Workflow Application on Utility Grids

2006 · Jia Yu, R. Buyya, et al. · 395

SPUDD: Stochastic Planning using Decision Diagrams

2013 · Hoey, Jesse, St-Aubin, Robert, et al. · arXiv (Cornell University) · 380

PDF

Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing

2021 · Huan Zhou, Kai Jiang, et al. · IEEE Internet of Things Journal · 352

Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design

2016 · Tao Bian, Zhong-Ping Jiang · Automatica · 339

Bounded-parameter Markov decision processes

2000 · Robert Givan, Sonia Leach, et al. · Artificial Intelligence · 310

PDF

PAC Bounds for Multi-armed Bandit and Markov Decision Processes

2002 · Eyal Even-Dar, Shie Mannor, et al. · Lecture notes in computer science · 300

Sequential Optimality and Coordination in Multiagent Systems

1999 · Craig Boutilier · 294

Multi-agent discrete-time graphical games and reinforcement learning solutions

2014 · Mohammed I. Abouheaf, Frank L. Lewis, et al. · Automatica · 284

Works count: 2,988

Citation count: 52,440