This book discusses both the theory and applications of Markov chains.
The text is firstly an introduction to the theory of stochastic processes at the undergraduate or beginning grad.
The author studies both discrete-time and continuous-time chains and connected topics such as finite Gibbs fields, non-homogeneous Markov chains, discrete time regenerative processes, Monte Carlo simulation, simulated annealing, and queueing networks are also developed in this accessible and self-contained text.
This book discusses both the theory and applications of Markov chains