K. Satia, J. et E. Lave, R., Markovian decision processes with probabilistic observation of states, Management science , 20(1, Theory ), 1973, pp. 1-13
This is a study of finite state discrete time discounted Markovian decision process when the states are probabilistically observed. A model of this process is formulated, and an implicit enumeration algorithm is presented which optimizes the total expected discounted reward given the initial state. Several numerical examples are presented.