Teacher: Adam Shwartz
Class Hours: Monday 14:30-16:30, room 353 (Electrical Engineering)
Office Hours: by appointment, Room 669.
For those who would like to review material on Markov Chains you can download the lecture notes of the course “Stochastic Signals” 044202.
The Linear Quadratic finite-time problem (with noise)
Properties of contraction operators
About the interchange argument for finding an optimal policy.
A corrected version of the lecture notes was uploaded 5.12.06.
In the sub-directory Lectures you will find an older version of the introduction, and the following lectures. The lectures as given in previous years are available as a PostScript file. As I prepare my lectures, I correct and amend them, so you can find the latest file with my 2003 lectures here . Note that while this is the last version, it only includes the material up to, and possibly including, the next lecture. For later material, refer to the older lecture notes. To make life a little easier, here is the material up to and including lecture 3, 2003, the material for lecture 4, 2003, the material up to and including lecture 4, 2003, additional material for lecture 5, 2003, additional material for lecture 6, 2003, corrected version of chapters 7,8 ,
You can also find LaTeX files of my lecture notes (to be on the safe side, take all files with the .tex suffix, and then run LaTeX (you need the 2-epsilon version) on the file lectures.tex). These files keep changing as I update them.
Note: some material which I distribute in class is not included. This includes copies I made for the class from various texts.