Examples using Matlab (Page numbers correspond to course notes.)

• Chapter 3, Page 3. n-stage transition probability matrices for 2x2 matrix (a=.9 b=.6).

• Chapter 3, Page 3. n-stage transition probability matrices for 2x2 matrix (a=.75 b=.5).

• Chapter 3, Page 4. n-stage transition probability matrices for Snakes and Ladders example.

• Chapter 3, Page 16. Finding P(absorption into state k|Xo=i) for the rat in maze example (page 122 of text).

• Chapter 3, Pages 17-18. Finding E(T|Xo=i) for the rat in maze example (page 122 of text).

• Chapter 3, Pages 17-18. Finding the E(number of visits to transient state k prior to absorption|Xo=i) for the rat in maze example (page 122 of text).

• Chapter 3, Page 19. Approximating the E(T|Xo=0) and Var(T|Xo=0) using the first 300 n-stage transition probabilities for Chutes and Ladders game (1 player).

• Chapter 3, Page 20. Using matrix equations to find the exact E(T|Xo=0) and Var(T|Xo=0) for Chutes and Ladders game (1 player).

• Chapter 3 (no handout). Approximating the E(T|Xo=0) and Var(T|Xo=0) using the first 300 n-stage transition probabilities for Chutes and Ladders game for k=1,2,3,4 players.

Data sets.