227-0424-00L Model- and Learning-Based Inverse Problems in Imaging
|Semester||Spring Semester 2021|
|Periodicity||yearly recurring course|
|Language of instruction||English|
|227-0424-00 V||Model- and Learning-Based Inverse Problems in Imaging||2 hrs|
|227-0424-00 P||Model- and Learning-Based Inverse Problems in Imaging||1 hrs|
|Abstract||Reconstruction is an inverse problem which estimates images from noisy measurements. Model-based reconstructions use analytical models of the imaging process and priors. Data-based methods directly approximate inversion using training data. Combining these two approaches yields physics-aware neural nets and state-of-the-art imaging accuracy (MRI, US, CT, microscopy, non-destructive imaging).|
|Objective||The goal of this course is to introduce the mathematical models of imaging experiments and practice implementation of numerical methods to solve the corresponding inverse problem. Students will learn how to improve reconstruction accuracy by introducing prior knowledge in the form of regularization models and training data. Furthermore, students will practice incorporating imaging model knowledge into deep neural networks.|
|Content||The course is based on following fundamental fields: (i) numerical linear algebra, (ii) mathematical statistics and learning theory, (iii) convex optimization and (iv) signal processing. The first part of the course introduces classical linear and nonlinear methods for image reconstruction. The second part considers data-based regularization and covers modern deep learning approaches to inverse problems in imaging. Finally, we introduce advances in the actively developing field of experimental design in biomedical imaging (i.e. how to conduct an experiment in a way to enable the most accurate reconstruction).|
1. Introduction: Examples of inverse problems, general introduction. Refresh prerequisites.
2. Linear algebra in imaging: Refresh prerequisites. Demonstrate properties of operators employed in imaging.
3. Linear inverse problems and regularization: Classical theory of inverse problems. Introduce notion of ill-posedness and regularization.
3. Compressed sensing: Sparsity, basis-CS, TV-CS. Notion of analysis and synthesis forms of reconstruction problems. Application of PGD and ADMM to reconstruction.
4. Advanced priors and model selection: Total generalized variation, GMM priors, vectorial TV, low-rank, and tensor models. Stein's unbiased risk estimator.
5. Dictionary and prior learning: Classical dictionary learning. Gentle intro to machine learning. A lot of technical details about patch-models.
6. Deep learning in image reconstruction: Generic convolutional-NN models (automap, residual filtering, u-nets). Talk about the data generation process. Characterized difference between model- and data-based reconstruction methods. Mode averaging.
7. Loop unrolling and physics-aware networks for reconstruction: Autograd, Variational Networks, a lot of examples and intuition. Show how to use them efficiently, e.g. adding preconditioners, attention, etc.
8. Generative models and uncertainty quantification: Amortized posterior, variational autoencoders, adversarial learning. Estimation uncertainty quantification.
9. Inversible networks for estimation: Gradient flows in networks, inversible neural networks for estimation problems.
10. Experimental design in imaging: Acquisition optimization for continuous models. How far can we exploit autograd?
11. Signal sampling optimization in MRI. Reinforcement learning: Acquisition optimization for discrete models. Reinforce and policy gradients, variance minimization for discrete variables (RELAX, REBAR). Cartesian under-sampling pattern design
12. Summary and exam preparation.
|Lecture notes||Lecture slides with references will be provided during the course.|
|Prerequisites / Notice||Students are expected to know the basics of (i) numerical linear algebra, (ii) applied methods of convex optimization, (iii) computational statistics, (iv) Matlab and Python.|
|Performance assessment information (valid until the course unit is held again)|
|Performance assessment as a semester course|
|ECTS credits||4 credits|
|Language of examination||English|
|Repetition||The performance assessment is offered every session. Repetition possible without re-enrolling for the course unit.|
|Mode of examination||oral 30 minutes|
|Additional information on mode of examination||There is a grade bonus of 0.25 awarded if a 2-week hands-on project is successfully accomplished.|
|This information can be updated until the beginning of the semester; information on the examination timetable is binding.|
|No public learning materials available.|
|Only public learning materials are listed.|
|No information on groups available.|
|There are no additional restrictions for the registration.|