227-0427-00L  Signal and Information Processing: Modeling, Filtering, Learning

SemesterAutumn Semester 2017
LecturersH.‑A. Loeliger
Periodicityyearly recurring course
Language of instructionEnglish


227-0427-00 GSignal and Information Processing: Modeling, Filtering, Learning4 hrs
Fri08:15-12:00CHN C 14 »
H.‑A. Loeliger

Catalogue data

AbstractFundamentals in signal processing, detection/estimation, and machine learning.
I. Linear signal representation and approximation: Hilbert spaces, LMMSE estimation, regularization and sparsity.
II. Learning linear and nonlinear functions and filters: kernel methods, neural networks.
III. Structured statistical models: hidden Markov models, factor graphs, Kalman filter, parameter estimation.
ObjectiveThe course is an introduction to some basic topics in signal processing, detection/estimation theory, and machine learning.
ContentPart I - Linear Signal Representation and Approximation: Hilbert spaces, least squares and LMMSE estimation, projection and estimation by linear filtering, learning linear functions and filters, L2 regularization, L1 regularization and sparsity, singular-value decomposition and pseudo-inverse, principal-components analysis.
Part II - Learning Nonlinear Functions: fundamentals of learning, neural networks, kernel methods.
Part III - Structured Statistical Models and Message Passing Algorithms: hidden Markov models, factor graphs, Gaussian message passing, Kalman filter and recursive least squares, Monte Carlo methods, parameter estimation, expectation maximization, sparse Bayesian learning.
Lecture notesLecture notes.
Prerequisites / NoticePrerequisites:
- local bachelors: course "Discrete-Time and Statistical Signal Processing" (5. Sem.)
- others: solid basics in linear algebra and probability theory

Performance assessment

Performance assessment information (valid until the course unit is held again)
Performance assessment as a semester course
ECTS credits6 credits
ExaminersH.-A. Loeliger
Typesession examination
Language of examinationEnglish
RepetitionThe performance assessment is offered every session. Repetition possible without re-enrolling for the course unit.
Mode of examinationoral 30 minutes
This information can be updated until the beginning of the semester; information on the examination timetable is binding.

Learning materials

No public learning materials available.
Only public learning materials are listed.


No information on groups available.


There are no additional restrictions for the registration.

Offered in

Biomedical Engineering MasterTrack Core CoursesWInformation
Data Science MasterCore ElectivesWInformation
Doctoral Dep. of Information Technology and Electrical EngineeringDoctoral and Post-Doctoral CoursesWInformation
Electrical Engineering and Information Technology MasterCore SubjectsWInformation
Electrical Engineering and Information Technology MasterCore SubjectsWInformation
Mathematics MasterInformation and Communication TechnologyWInformation
Neural Systems and Computation MasterElectivesWInformation
Computational Science and Engineering BachelorElectivesWInformation
Computational Science and Engineering MasterElectivesWInformation