Introduction to Stochastic Processes
by Gordan Žitković
Publisher: The University of Texas at Austin 2010
Number of pages: 107
Contents: Probability review; Mathematica in 15 minutes; Stochastic Processes; The simple random walk; Generating functions; Random walks - advanced methods; Branching processes; Markov Chains; The 'Stochastics' package; Classification of States; More on Transience and recurrence; Absorption and reward; Stationary and Limiting Distribution; Solved Problems.
Download or read it online for free here:
by S.P. Meyn, R.L. Tweedie - Springer
The book on the theory of general state space Markov chains, and its application to time series analysis, operations research and systems and control theory. An advanced graduate text and a monograph treating the stability of Markov chains.
by Alan Bain
An informal introduction to Stochastic Calculus, and especially to the Ito integral and some of its applications. The text concentrates on the parts of the course which the author found hard, there is little or no comment on more standard matters.
by I. F. Wilde
A gentle introduction to the mathematics of Stochastic Analysis. From the table of contents: Introduction; Conditional expectation; Martingales; Stochastic integration - informally; Wiener process; Ito's formula; Bibliography.
by Jan A. Van Casteren - Bookboon
In this book, which is basically self-contained, the following topics are treated thoroughly: Brownian motion as a Gaussian process, Brownian motion as a Markov process, Brownian motion as a martingale, Markov chains, renewal theory, etc.