Ebook: Nonlinear Least Squares for Inverse Problems: Theoretical Foundations and Step-by-Step Guide for Applications

This book provides an introduction into the least squares resolution of nonlinear inverse problems. The first goal is to develop a geometrical theory to analyze nonlinear least square (NLS) problems with respect to their quadratic wellposedness, i.e. both wellposedness and optimizability. Using the results, the applicability of various regularization techniques can be checked. The second objective of the book is to present frequent practical issues when solving NLS problems. Application oriented readers will find a detailed analysis of problems on the reduction to finite dimensions, the algebraic determination of derivatives (sensitivity functions versus adjoint method), the determination of the number of retrievable parameters, the choice of parametrization (multiscale, adaptive) and the optimization step, and the general organization of the inversion code. Special attention is paid to parasitic local minima, which can stop the optimizer far from the global minimum: multiscale parametrization is shown to be an efficient remedy in many cases, and a new condition is given to check both wellposedness and the absence of parasitic local minima.

For readers that are interested in projection on non-convex sets, Part II of this book presents the geometric theory of quasi-convex and strictly quasi-convex (s.q.c.) sets. S.q.c. sets can be recognized by their finite curvature and limited deflection and possess a neighborhood where the projection is well-behaved.

Throughout the book, each chapter starts with an overview of the presented concepts and results.

---

This book provides an introduction into the least squares resolution of nonlinear inverse problems. The first goal is to develop a geometrical theory to analyze nonlinear least square (NLS) problems with respect to their quadratic wellposedness, i.e. both wellposedness and optimizability. Using the results, the applicability of various regularization techniques can be checked. The second objective of the book is to present frequent practical issues when solving NLS problems. Application oriented readers will find a detailed analysis of problems on the reduction to finite dimensions, the algebraic determination of derivatives (sensitivity functions versus adjoint method), the determination of the number of retrievable parameters, the choice of parametrization (multiscale, adaptive) and the optimization step, and the general organization of the inversion code. Special attention is paid to parasitic local minima, which can stop the optimizer far from the global minimum: multiscale parametrization is shown to be an efficient remedy in many cases, and a new condition is given to check both wellposedness and the absence of parasitic local minima.

For readers that are interested in projection on non-convex sets, Part II of this book presents the geometric theory of quasi-convex and strictly quasi-convex (s.q.c.) sets. S.q.c. sets can be recognized by their finite curvature and limited deflection and possess a neighborhood where the projection is well-behaved.

Throughout the book, each chapter starts with an overview of the presented concepts and results.

---

This book provides an introduction into the least squares resolution of nonlinear inverse problems. The first goal is to develop a geometrical theory to analyze nonlinear least square (NLS) problems with respect to their quadratic wellposedness, i.e. both wellposedness and optimizability. Using the results, the applicability of various regularization techniques can be checked. The second objective of the book is to present frequent practical issues when solving NLS problems. Application oriented readers will find a detailed analysis of problems on the reduction to finite dimensions, the algebraic determination of derivatives (sensitivity functions versus adjoint method), the determination of the number of retrievable parameters, the choice of parametrization (multiscale, adaptive) and the optimization step, and the general organization of the inversion code. Special attention is paid to parasitic local minima, which can stop the optimizer far from the global minimum: multiscale parametrization is shown to be an efficient remedy in many cases, and a new condition is given to check both wellposedness and the absence of parasitic local minima.

For readers that are interested in projection on non-convex sets, Part II of this book presents the geometric theory of quasi-convex and strictly quasi-convex (s.q.c.) sets. S.q.c. sets can be recognized by their finite curvature and limited deflection and possess a neighborhood where the projection is well-behaved.

Throughout the book, each chapter starts with an overview of the presented concepts and results.

Content:
Front Matter....Pages i-xiv
Front Matter....Pages 1-3
Nonlinear Inverse Problems: Examples and Difficulties....Pages 5-28
Computing Derivatives....Pages 29-78
Choosing a Parameterization....Pages 79-159
Output Least Squares Identifiability and Quadratically Wellposed NLS Problems....Pages 161-207
Regularization of Nonlinear Least Squares Problems....Pages 209-270
Front Matter....Pages 272-273
Quasi-Convex Sets....Pages 275-297
Strictly Quasi-Convex Sets....Pages 299-320
Deflection Conditions for the Strict Quasi-convexity of Sets....Pages 321-343
Back Matter....Pages 345-360

---

This book provides an introduction into the least squares resolution of nonlinear inverse problems. The first goal is to develop a geometrical theory to analyze nonlinear least square (NLS) problems with respect to their quadratic wellposedness, i.e. both wellposedness and optimizability. Using the results, the applicability of various regularization techniques can be checked. The second objective of the book is to present frequent practical issues when solving NLS problems. Application oriented readers will find a detailed analysis of problems on the reduction to finite dimensions, the algebraic determination of derivatives (sensitivity functions versus adjoint method), the determination of the number of retrievable parameters, the choice of parametrization (multiscale, adaptive) and the optimization step, and the general organization of the inversion code. Special attention is paid to parasitic local minima, which can stop the optimizer far from the global minimum: multiscale parametrization is shown to be an efficient remedy in many cases, and a new condition is given to check both wellposedness and the absence of parasitic local minima.

For readers that are interested in projection on non-convex sets, Part II of this book presents the geometric theory of quasi-convex and strictly quasi-convex (s.q.c.) sets. S.q.c. sets can be recognized by their finite curvature and limited deflection and possess a neighborhood where the projection is well-behaved.

Throughout the book, each chapter starts with an overview of the presented concepts and results.

Content:
Front Matter....Pages i-xiv
Front Matter....Pages 1-3
Nonlinear Inverse Problems: Examples and Difficulties....Pages 5-28
Computing Derivatives....Pages 29-78
Choosing a Parameterization....Pages 79-159
Output Least Squares Identifiability and Quadratically Wellposed NLS Problems....Pages 161-207
Regularization of Nonlinear Least Squares Problems....Pages 209-270
Front Matter....Pages 272-273
Quasi-Convex Sets....Pages 275-297
Strictly Quasi-Convex Sets....Pages 299-320
Deflection Conditions for the Strict Quasi-convexity of Sets....Pages 321-343
Back Matter....Pages 345-360
....