Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
recurrent classes
Description:
Sets of mutually accessible recurrent states in a Markov chain, from which the process cannot leave once entered.
Primary topic:
Probability and Statistical Research (33%)
Related topics:
Probability and Statistical Research (33%),
Adaptive Dynamic Programming Control (9%),
Stochastic processes and statistical mechanics (8%),
Game Theory and Applications (7%)
OpenAlex ID:
keywords/recurrent-classes
Mesure invariante sur les classes récurrentes des processus de Markov
1967
·
J. Azema
, M. Kaplan-Duflo
, et al.
·
Probability Theory and Related Fields
·
107
PDF
A Reduction Process for Perturbed Markov Chains
1983
·
F. Delebecque
·
SIAM Journal on Applied Mathematics
·
99
Multichain Markov Decision Processes with a Sample Path Constraint: A Decomposition Approach
1991
·
Keith W. Ross
, Ravi Varadarajan
·
Mathematics of Operations Research
·
96
Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states
2000
·
G. Badowski
, G. Yin
, et al.
·
The Annals of Applied Probability
·
77
PDF
Discrete-time singularly perturbed Markov chains: aggregation, occupation measures, and switching diffusion limit
2003
·
G. Yin
, Q. Zhang
, et al.
·
Advances in Applied Probability
·
59
Optimal threshold probability in undiscounted Markov decision processes with a target set
2003
·
Yoshio Ohtsubo
·
Applied Mathematics and Computation
·
43
Contributions to the Theory of Markov Chains. II
1954
·
K. L. Chung
·
Transactions of the American Mathematical Society
·
41
PDF
Weak Convergence of Hybrid Filtering Problems Involving Nearly Completely Decomposable Hidden Markov Chains
2003
·
G. Yin
, S. Dey
·
SIAM Journal on Control and Optimization
·
25
PDF
Exploration-Exploitation Trade-off in Reinforcement Learning on Online Markov Decision Processes with Global Concave Rewards
2019
·
Cheung, Wang Chi
·
arXiv (Cornell University)
·
24
PDF
Singularly Perturbed Markov Chains: Convergence and Aggregation
2000
·
G Yin
, Q Zhang
, et al.
·
Journal of Multivariate Analysis
·
22
Classification Problems in MDPs
2002
·
L. C. M. Kallenberg
·
Springer eBooks
·
19
Necessary and sufficient conditions for a solution to the risk-sensitive Poisson equation on a finite state space
2008
·
Rolando Cavazos-Cadena
, Daniel Hernández-Hernández
·
Systems & Control Letters
·
18
document
2001
·
R. H. Liu
, Q. Zhang
, et al.
·
Applied Mathematics & Optimization
·
16
A classification of a random walk defined on a finite Markov chain
1973
·
M. Newbould
·
Probability Theory and Related Fields
·
15
PDF
On asymptotic behaviour of probabilities in groups of states of homogeneous Markov chain
1959
·
Petr Mandl
·
Časopis pro pěstování matematiky
·
15
Optimal threshold probability and expectation in semi-Markov decision processes
2010
·
Masahiko Sakaguchi
, Yoshio Ohtsubo
·
Applied Mathematics and Computation
·
13
Classification of Markov chains with a general state space
1966
·
Zbynĕk Šidák
·
Bulletin of the American Mathematical Society
·
13
PDF
Das 0-1-Gesetz der terminalen ?-Algebra bei Harrisirrfahrten
1977
·
Uwe R�sler
·
Probability Theory and Related Fields
·
12
Network Formation Under Heterogeneous Costs: the Multiple Group Model
2007
·
JURJEN KAMPHORST
, GERARD VAN DER LAAN
·
International Game Theory Review
·
11
PDF
A characterization of exponential functionals in finite Markov chains
2004
·
Rolando Cavazos–Cadena
, Daniel Hernández–Hernández
·
Mathematical Methods of Operations Research
·
11
The stochastic stability of decentralized matching on a graph
2017
·
Leonardo Boncinelli
, Paolo Pin
·
Games and Economic Behavior
·
10
Logarithmic regret in communicating MDPs: Leveraging known dynamics with bandits
2023
·
Saber, Hassan
, Pesquerel, Fabien
, et al.
·
HAL
·
9
PDF
Optimistic Policy Iteration for MDPs with Acyclic Transient State Structure
2021
·
Lubars, Joseph
, Winnicki, Anna
, et al.
·
arXiv (Cornell University)
·
9
PDF
Abelian sandpile model and Biggs–Merino polynomial for directed graphs
2017
·
Swee Hong Chan
·
Journal of Combinatorial Theory Series A
·
9
A sufficient condition for a unique invariant distribution of a higher-order Markov chain
2017
·
Bernhard C. Geiger
·
Statistics & Probability Letters
·
9
PDF
Show more works
View as search
Works count:
111
Citation count:
911
Year
Topic
Type