Ebook: An introduction to Markov processes

"Provides a more accessible introduction than other books on Markov processes by emphasizing the structure of the subject and avoiding sophisticated measure theory. Leads the reader to a rigorous understanding of basic theory."--Publisher's website.;Random Walks, a Good Place to Begin -- Doeblin's Theory for Markov Chains -- Stationary Probabilities -- More about the Ergodic Theory of Markov Chains -- Markov Processes in Continuous Time -- Reversible Markov Processes -- A minimal Introduction to Measure Theory -- Notation.