Due in recitation Wednesday Dec. 6 or Friday Dec. 8.

BE CAREFUL ON PROBLEMS FROM [P] ON MARKOV PROCESSES SINCE THE TRANSITION MATRICES IN THE TEXT ARE FLIPPED VERSIONS OF WHAT WE USED IN CLASS.

Reading: Sections 7.1-7.6 of [P].

Maple :

Core Problems : Sections 7.1-7.6 of [P]. (Note that all matrices from 7.29 on should be flipped to agree with our notation of Stochastic matrices.)

Other problems :

• None

Sample Exam Questions:

• Exam 1: 18 (don't try 16, 17)
• Exam 2: 16 (don't try 20)
• Exam 3: 16 (don't try 17, 18)
• Exam 4: 16 (don't try 17)
• Fall 2010 Final Exam: 18,19
• Spring 2011 Final Exam: 18,19
• Fall 2002 Final Exam: All except don't try 18 (some have already been assigned)