EECI09: Jump linear Markov processes
Prev: Information systems  Course home  Next: Packet loss 
In this lecture, we give a brief overview of Markovian jump linear systems. Such systems display multiple linear modes for the evolution of the state, and the modes are chosen stochastically. Such systems were important in the early development of networked control systems, where the communication channels were modeled as a Markov chain for effects such as delay and packet loss. As we will see in the next chapter, the oneblock design problem for such systems can be studied in the framework of Markovian jump linear systems.
Lecture Materials
 Lecture slides: Summary
Further Reading

DiscreteTime Markov Jump Linear Systems (Probability and its Applications), O.L.V. Costa, M.D. Fragoso, and R.P. Marques. Springer, 2004. This book is a good introduction to Markov jump linear systems.

On a Stochastic Sensor Selection Algorithm with Applications in Sensor Scheduling and Sensor Coverage, V. Gupta, T. Chung, B. Hassibi and R. M. Murray, Automatica, 42(2):251260, February 2006. This paper presents the necessary and sufficient stability conditions for the estimation problem. The results for the LQR problem are dual to the results obtained here.
RealTime Control Systems with Delays, J. Nilsson, Ph.D. Thesis, Department of Automatic Control, Lund University, 1998. This thesis extends the Markovian jump linear system framework to the case when the system mode defines a probability density function for the system matrices.
Additional Information
 Networked Control Systems Repository (M. Branicky and S. Phillipps)
 2008 lecture page
 Additional links to external information