Ebook: Adaptive Learning of Polynomial Networks: Genetic Programming, Backpropagation and Bayesian Methods

This book provides theoretical and practical knowledge for develop­ ment of algorithms that infer linear and nonlinear models. It offers a methodology for inductive learning of polynomial neural network mod­ els from data. The design of such tools contributes to better statistical data modelling when addressing tasks from various areas like system identification, chaotic time-series prediction, financial forecasting and data mining. The main claim is that the model identification process involves several equally important steps: finding the model structure, estimating the model weight parameters, and tuning these weights with respect to the adopted assumptions about the underlying data distrib­ ution. When the learning process is organized according to these steps, performed together one after the other or separately, one may expect to discover models that generalize well (that is, predict well). The book off'ers statisticians a shift in focus from the standard f- ear models toward highly nonlinear models that can be found by con­ temporary learning approaches. Speciafists in statistical learning will read about alternative probabilistic search algorithms that discover the model architecture, and neural network training techniques that identify accurate polynomial weights. They wfil be pleased to find out that the discovered models can be easily interpreted, and these models assume statistical diagnosis by standard statistical means. Covering the three fields of: evolutionary computation, neural net­ works and Bayesian inference, orients the book to a large audience of researchers and practitioners.

---

This book delivers theoretical and practical knowledge for developing algorithms that infer linear and non-linear multivariate models, providing a methodology for inductive learning of polynomial neural network models (PNN) from data.

The text emphasizes an organized model identification process by which to discover models that generalize and predict well. The empirical investigations detailed here demonstrate that PNN models evolved by genetic programming and improved by backpropagation are successful when solving real-world tasks.

The book is an essential reference for researchers and practitioners in the fields of evolutionary computation, artificial neural networks and Bayesian inference, as well for advanced-level students of genetic programming.

Readers will strengthen their skills in creating efficient model representations and learning operators that efficiently sample the search space, and in navigating the search process through the design of objective fitness functions.

---

This book delivers theoretical and practical knowledge for developing algorithms that infer linear and non-linear multivariate models, providing a methodology for inductive learning of polynomial neural network models (PNN) from data.

The text emphasizes an organized model identification process by which to discover models that generalize and predict well. The empirical investigations detailed here demonstrate that PNN models evolved by genetic programming and improved by backpropagation are successful when solving real-world tasks.

The book is an essential reference for researchers and practitioners in the fields of evolutionary computation, artificial neural networks and Bayesian inference, as well for advanced-level students of genetic programming.

Readers will strengthen their skills in creating efficient model representations and learning operators that efficiently sample the search space, and in navigating the search process through the design of objective fitness functions.

Content:
Front Matter....Pages i-xiv
Introduction....Pages 1-24
Inductive Genetic Programming....Pages 25-54
Tree-Like PNN Representations....Pages 55-80
Fitness Functions and Landscapes....Pages 81-110
Search Navigation....Pages 111-146
Backpropagation Techniques....Pages 147-180
Temporal Backpropagation....Pages 181-208
Bayesian Inference Techniques....Pages 209-240
Statistical Model Diagnostics....Pages 241-272
Time Series Modelling....Pages 273-290
Conclusions....Pages 291-294
Back Matter....Pages 295-316

---

This book delivers theoretical and practical knowledge for developing algorithms that infer linear and non-linear multivariate models, providing a methodology for inductive learning of polynomial neural network models (PNN) from data.

The text emphasizes an organized model identification process by which to discover models that generalize and predict well. The empirical investigations detailed here demonstrate that PNN models evolved by genetic programming and improved by backpropagation are successful when solving real-world tasks.

The book is an essential reference for researchers and practitioners in the fields of evolutionary computation, artificial neural networks and Bayesian inference, as well for advanced-level students of genetic programming.

Readers will strengthen their skills in creating efficient model representations and learning operators that efficiently sample the search space, and in navigating the search process through the design of objective fitness functions.

Content:
Front Matter....Pages i-xiv
Introduction....Pages 1-24
Inductive Genetic Programming....Pages 25-54
Tree-Like PNN Representations....Pages 55-80
Fitness Functions and Landscapes....Pages 81-110
Search Navigation....Pages 111-146
Backpropagation Techniques....Pages 147-180
Temporal Backpropagation....Pages 181-208
Bayesian Inference Techniques....Pages 209-240
Statistical Model Diagnostics....Pages 241-272
Time Series Modelling....Pages 273-290
Conclusions....Pages 291-294
Back Matter....Pages 295-316
....