Work

Control of Finite-State, Finite Memory Stochastic Systems

Year: 1974
Type: article
Abstract: A generalized problem of stochastic control is discussed in which multiple controllers with different data bases are present. The vehicle for the investigation is the finite state, finite memory (FSFM) stochastic control problem. Optimality conditions are obtained by deriving an equivalent deterministic optimal control problem. A FSFM minimum principle is obtained via the equivalent deterministic problem. The minimum principle suggests the development of a numerical optimization algorithm, the min-H algorithm. The relationship between the sufficiency of the minimum principle and the informational properties of the problem are investigated. A problem of hypothesis testing with 1-bit memory is investigated to illustrate the application of control theoretic techniques to information processing problems.
Author: N. Sandell
Language: English
Open Access status: green
OpenAlex ID: W326019863
FWCI: 5.201
Cites: 66
Cited by: 28
Related to: 10