Browse wiki

From MurrayWiki
Jump to: navigation, search
Robust Control of Uncertain Markov Decision Processes with Temporal Logic Specifications
Abstract We present a method for designing robust c …
We present a method for designing robust con- trollers for dynamical systems with linear temporal logic specifications. We abstract the original system by a finite Markov Decision Process (MDP) that has transition probabilities in a specified uncertainty set. A robust control policy for the MDP is generated that maximizes the worst-case probability of satisfying the specification over all transition probabilities in the uncertainty set. To do this, we use a procedure from probabilistic model checking to combine the system model with an automaton representing the specification. This new MDP is then transformed into an equivalent form that satisfies assumptions for stochastic shortest path dynamic programming. A robust version of dynamic programming allows us to solve for a eps-suboptimal robust control policy with time complexity O(log1/eps) times that for the non-robust case. We then implement this control policy on the original dynamical system.
l policy on the original dynamical system.  +
Authors Eric M. Wolff, Ufuk Topcu and Richard M. Murray  +
Funding Correct-by-Construction Synthesis of Control Protocols for Aerospace Systems +
ID 2011m  +
Source Submitted, 2012 American Control Conference (ACC)  +
Tag wtm12-acc  +
Title Robust Control of Uncertain Markov Decision Processes with Temporal Logic Specifications +
Type Conference Paper  +
Categories Papers
Modification date
This property is a special property in this wiki.
15 May 2016 06:15:59  +
URL
This property is a special property in this wiki.
http://www.cds.caltech.edu/~murray/preprints/wtm12-acc_s.pdf  +
hide properties that link here 
Robust Control of Uncertain Markov Decision Processes with Temporal Logic Specifications + Title
 

 

Enter the name of the page to start browsing from.