This could have gone in the Programmer's Symposium as well, but I'll ask here since it is really about the underlying math. For some background, a Markov chain is a sequence of things where the ...

This is a preview. Log in through your library . Abstract If a finite Markov chain (discrete time, discrete states) has a number of absorbing states, one of these will eventually be reached. In this ...

Journal of Applied Probability, Vol. 51A, CELEBRATING 50 YEARS OF THE APPLIED PROBABILITY TRUST (2014), pp. 377-389 (13 pages) We introduce a new class of Monte Carlo methods, which we call exact ...

Brief review of conditional probability and expectation followed by a study of Markov chains, both discrete and continuous time. Queuing theory, terminology, and single queue systems are studied with ...