Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
controlled Markov processes
Description:
Stochastic processes whose transition dynamics are influenced by control decisions, analyzed in stochastic control and decision theory.
Related topics:
Adaptive Dynamic Programming Control (18%),
Stochastic processes and financial applications (14%)
OpenAlex ID:
keywords/controlled-markov-processes
Controlled Markov Processes and Viscosity Solutions
2006
·
Fleming, Wendell Helms 1928-2023
, Soner, H. Mete
·
Springer eBooks
·
4,460
Controlled markov processes and viscosity solutions
1994
·
M. R. James
·
Stochastics and stochastics reports
·
1,057
Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise
2008
·
S. Kar
, J.M.F. Moura
·
IEEE Transactions on Signal Processing
·
778
PDF
Controlled Markov Processes
1979
·
E. B. Dynkin
, A. A. Yushkevich
·
Grundlehren der mathematischen Wissenschaften
·
519
Controlled Markov processes
1983
·
Gian-Carlo Rota
·
Advances in Mathematics
·
284
PDF
A theory of Markovian time-inconsistent stochastic control in discrete time
2014
·
Tomas Björk
, Agatha Murgoci
·
Finance and Stochastics
·
265
Occupation measures for controlled Markov processes: characterization and optimality
1996
·
Abhay G. Bhatt
, Vivek S. Borkar
·
The Annals of Probability
·
147
PDF
Optimal Control of Jump Processes
1977
·
R. Boel
, P. Varaiya
·
SIAM Journal on Control and Optimization
·
138
Viscosity Solutions and Applications
1997
·
Martino Bardi
, Michael G. Crandall
, et al.
·
Lecture notes in mathematics
·
135
Controlled markov processes, viscosity solutions and applications to mathematical finance: Cime lectures
1997
·
Halil Mete Soner
·
Lecture notes in mathematics
·
78
Two Time-Scale Stochastic Approximation with Controlled Markov Noise and Off-Policy Temporal-Difference Learning
2017
·
Prasenjit Karmakar
, Shalabh Bhatnagar
·
Mathematics of Operations Research
·
70
PDF
Controlled Markov Processes with Arbitrary Numerical Criteria
1983
·
E. A. Fainberg
·
Theory of Probability and Its Applications
·
64
Time-Average Control of Martingale Problems: A Linear Programming Formulation
1990
·
Richard H. Stockbridge
·
The Annals of Probability
·
63
PDF
Time-Average Control of Martingale Problems: Existence of a Stationary Solution
1990
·
Richard H. Stockbridge
·
The Annals of Probability
·
62
PDF
Analysis of an identification algorithm arising in the adaptive estimation of Markov chains
1990
·
Aristotle Arapostathis
, Steven I. Marcus
·
Mathematics of Control Signals and Systems
·
55
Universally Measurable Policies in Dynamic Programming
1979
·
Steven E. Shreve
, Dimitri P. Bertsekas
·
Mathematics of Operations Research
·
54
Strategies and trajectories of coral reef fish larvae optimizing self-recruitment
2004
·
Jean-Olivier Irisson
, Anselme LeVan
, et al.
·
Journal of Theoretical Biology
·
53
Time-discretization for controlled Markov processes. I. General approximation results
1996
·
N.M. van Dijk
, Arie Hordijk
·
Kybernetika
·
52
PDF
Reachability Analysis for Controlled Discrete Time Stochastic Hybrid Systems
2006
·
Saurabh Amin
, Alessandro Abate
, et al.
·
Lecture notes in computer science
·
50
On Reducing a Jump Controllable Markov Model to a Model with Discrete Time
1980
·
A. A. Yushkevich
·
Theory of Probability and Its Applications
·
50
Exponential filter stability via Dobrushin’s coefficient
2020
·
Curtis McDonald
, Serdar Yüksel
·
Electronic Communications in Probability
·
46
PDF
Stochastic approximation with ‘controlled Markov’ noise
2005
·
Vivek S. Borkar
·
Systems & Control Letters
·
45
Machine learning and nonparametric bandit theory
1995
·
Tze-Leung Lai
, S. Yakowitz
·
IEEE Transactions on Automatic Control
·
43
Sequential decomposition of sequential dynamic teams: applications to real-time communication and networked control systems
2008
·
Demosthenis Teneketzis
, Aditya Mahajan
·
Deep Blue (University of Michigan)
·
40
PDF
Optimization of queuing system via stochastic control
2009
·
Boris M. Miller
·
Automatica
·
36
Show more works
View as search
Works count:
182
Citation count:
9,523
Year
Topic
Type