"We study the problem of effective controller synthesis for finite-state Markov decision processes (MDPs) and the class of properties definable in the logic PCTL extended with long-run average propositions. We show that the existence of such a controller is decidable, and we give an algorithm which computes the controller if it exists. We also address the issue of ``controller robustness'', i.e., the problem whether there is a controller which still guarantees the satisfaction of a given property when the probabilities in the considered MDP slightly deviate from their original values. From a practical point of view, this is an important aspect since the probabilities are often determined empirically and hence they are inherently imprecise. We show that the existence of robust controllers is also decidable, and that such controllers are effectively computable if they exist. ."@en . . . "2005" . "On the Controller Synthesis for Finite-State Markov Decision Processes"@en . "On the Controller Synthesis for Finite-State Markov Decision Processes" . "O synt\u00E9ze \u0159\u00EDd\u00EDc\u00EDch jednotek pro Markovovy rozhodovac\u00ED procesy s kone\u010Dn\u011B mnoha stavy"@cs . "RIV/00216224:14330/05:00012780" . . . "12"^^ . "On the Controller Synthesis for Finite-State Markov Decision Processes" . . . . . "On the Controller Synthesis for Finite-State Markov Decision Processes"@en . "Ku\u010Dera, Anton\u00EDn" . "P(1M0545), P(GA201/03/1161), Z(MSM0021622419)" . . . "V \u010Dl\u00E1nku je studov\u00E1na problematika efektivn\u00ED synt\u00E9zy \u0159\u00EDd\u00EDc\u00EDch jednotek pro Markovovy rozhodovac\u00ED procesy s kone\u010Dn\u011B mnoha stavy a t\u0159\u00EDdu vlastnost\u00ED definovateln\u00FDch v logice PCTL roz\u0161\u00ED\u0159en\u00E9 o limitn\u00ED vlastnosti b\u011Bh\u016F. Je dok\u00E1z\u00E1no, \u017Ee probl\u00E9m existence takov\u00FDch \u0159\u00EDd\u00EDc\u00EDch jednotek je rozhodnuteln\u00FD a je pod\u00E1n algoritmus pro jejich konstrukci. Je tak\u00E9 podrobn\u011Bji rozebr\u00E1na ot\u00E1zka stability \u0159\u00EDd\u00EDc\u00EDch jednotek."@cs . "541-552" . "[C3606E5FF3AB]" . "We study the problem of effective controller synthesis for finite-state Markov decision processes (MDPs) and the class of properties definable in the logic PCTL extended with long-run average propositions. We show that the existence of such a controller is decidable, and we give an algorithm which computes the controller if it exists. We also address the issue of ``controller robustness'', i.e., the problem whether there is a controller which still guarantees the satisfaction of a given property when the probabilities in the considered MDP slightly deviate from their original values. From a practical point of view, this is an important aspect since the probabilities are often determined empirically and hence they are inherently imprecise. We show that the existence of robust controllers is also decidable, and that such controllers are effectively computable if they exist. ." . . . "0302-9743" . . "2"^^ . "Stra\u017Eovsk\u00FD, Old\u0159ich" . . "2"^^ . "534449" . . "14330" . "O synt\u00E9ze \u0159\u00EDd\u00EDc\u00EDch jednotek pro Markovovy rozhodovac\u00ED procesy s kone\u010Dn\u011B mnoha stavy"@cs . . . "Controller Synthesis; Markov Decision Processes"@en . "3821" . "RIV/00216224:14330/05:00012780!RIV08-MSM-14330___" . "US - Spojen\u00E9 st\u00E1ty americk\u00E9" . . "Lecture Notes in Computer Science" .