Ebook: Stochastic Reachability Analysis of Hybrid Systems

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems. Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA: • stochastic reachability based on Markov process theory; • martingale methods; • stochastic reachability as an optimal stopping problem; and • dynamic programming. The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text. Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science. The Communications and Control Engineering series reports major technological advances which have potential for great impact in the fields of communication and control. It reflects research in industrial and academic institutions around the world so that the readership can exploit new possibilities as they become available.

---

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems.

Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA:

· stochastic reachability based on Markov process theory;

· martingale methods;

· stochastic reachability as an optimal stopping problem; and

· dynamic programming.

The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text.

Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science.

---

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems.

Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA:

· stochastic reachability based on Markov process theory;

· martingale methods;

· stochastic reachability as an optimal stopping problem; and

· dynamic programming.

The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text.

Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science.

Content:
Front Matter....Pages I-XVII
Introduction....Pages 1-4
Markov Models....Pages 5-29
Hybrid Systems: Deterministic to Stochastic Perspectives....Pages 31-53
Stochastic Hybrid Systems....Pages 55-85
Stochastic Reachability Concepts....Pages 87-103
Probabilistic Methods for Stochastic Reachability....Pages 105-134
Analytic Methods for Stochastic Reachability....Pages 135-162
Statistical Methods to Stochastic Reachability....Pages 163-172
Stochastic Reachability Based on Probabilistic Bisimulation....Pages 173-185
Stochastic Reachability with Constraints....Pages 187-202
Applications of Stochastic Reachability....Pages 203-207
Back Matter....Pages 209-244

---

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems.

Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA:

· stochastic reachability based on Markov process theory;

· martingale methods;

· stochastic reachability as an optimal stopping problem; and

· dynamic programming.

The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text.

Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science.

Content:
Front Matter....Pages I-XVII
Introduction....Pages 1-4
Markov Models....Pages 5-29
Hybrid Systems: Deterministic to Stochastic Perspectives....Pages 31-53
Stochastic Hybrid Systems....Pages 55-85
Stochastic Reachability Concepts....Pages 87-103
Probabilistic Methods for Stochastic Reachability....Pages 105-134
Analytic Methods for Stochastic Reachability....Pages 135-162
Statistical Methods to Stochastic Reachability....Pages 163-172
Stochastic Reachability Based on Probabilistic Bisimulation....Pages 173-185
Stochastic Reachability with Constraints....Pages 187-202
Applications of Stochastic Reachability....Pages 203-207
Back Matter....Pages 209-244
....