Estimation of An Infinite Dimensional Transition Probability Matrix Using a Generalized Hierarchical Stick-Breaking Process
Year: 2025
Type: preprint
Abstract: Markov chains provide a foundational framework for modeling sequential stochastic processes, with the transition probability matrix characterizing the dynamics of state evolution. While classical estimation methods such as maximum likelihood and empirical Bayes approaches are effective in finite-state settings, they become inadequate in applications involving countably infinite or dynamically expanding state spaces, which frequently arise in domains such as natural language processing, population dynamics, and behavioral modeling. In this work, we introduce a novel Bayesian nonparametric framework for estimating infinite-dimensional transition probability matrices by employing a new class of priors, termed the Generalized Hierarchical Stick-Breaking prior. This prior extends traditional Dirichlet process and stick-breaking constructions, enabling highly flexible modelling of transition probability matrices. The proposed approach offers a principled methodology for inferring transition probabilities in settings characterized by sparsity, high dimensionality, and unobserved state spaces, thereby contributing to the advancement of statistical inference for infinite-dimensional transition probability matrices.
Source: arXiv (Cornell University)
Authors: Saha, Agamani, Roy, Souvik
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4416284654
Cites:
Cited by:
Related to: