Characteristic of exit moments and models of enlargement of states for finite Markov chains in terms of global memory functionals

Citation
Vv. Anisimov et Yy. Klygunova, Characteristic of exit moments and models of enlargement of states for finite Markov chains in terms of global memory functionals, CYB SYS AN, 36(3), 2000, pp. 405-414
Citations number
7
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
CYBERNETICS AND SYSTEMS ANALYSIS
ISSN journal
10600396 → ACNP
Volume
36
Issue
3
Year of publication
2000
Pages
405 - 414
Database
ISI
SICI code
1060-0396(200005/06)36:3<405:COEMAM>2.0.ZU;2-B
Abstract
A notion of local- and global-memory functionals for discrete-type distribu tions is introduced by analogy with the notion of the memory for continuous -type distributions introduced in Muth's papers. In the class of PH-distrib utions (i.e., of distributions of the time of Markov chain exit from? a sub set of states) the necessary and sufficient conditions nle obtained for the case where the exit time has an exponential (continous-time) or a geometri c (discrete time) distribution. A new notion of a global memory functional for decomposition of the state space of a finite Markov chain is int Its pr operties as a measure of quality of decomposition and enlargement of a stat e space are studied. The asymptotic optimality is proved.