Aggregated Markov processes incorporating time interval omission

Citation
Ball, Frank et Sansom, Mark, Aggregated Markov processes incorporating time interval omission, Advances in applied probability , 20(3), 1988, pp. 546-572
ISSN journal
00018678
Volume
20
Issue
3
Year of publication
1988
Pages
546 - 572
Database
ACNP
SICI code
Abstract
We consider a finite-state-space, continuous-time Markov chain which is time reversible. The state space is partitioned into two sets, termed .open' and .closed', and it is only possible to observe which set the process is in. Further, short sojourns in either the open or closed sets of states will fail to be detected. We show that the dynamic stochastic properties of the observed process are completely described by an embedded Markov renewal process. The parameters of this Markov renewal process are obtained, allowing us to derive expressions for the moments and autocorrelation functions of successive sojourns in both the open and closed states. We illustrate the theory with a numerical study.