401-3650-22L  Numerical Analysis Seminar: Deep Neural Network Methods for PDEs

SemesterSpring Semester 2022
LecturersC. Schwab
Periodicityyearly recurring course
Language of instructionEnglish
CommentNumber of Participants: limited to seven.
Participation by consent of instructor.
Closed for further registrations.



Courses

NumberTitleHoursLecturers
401-3650-00 SNumerical Analysis Seminar: Deep Neural Network Methods for PDEs
Permission from lecturers required for all students.
2 hrs
21.02.11:15-13:00HG F 26.5 »
11.04.11:15-13:00HG F 26.1 »
26.04.14:15-17:00HG F 26.3 »
28.04.14:15-17:00HG F 26.1 »
24.05.14:15-18:00HG F 26.3 »
25.05.14:15-16:00HG F 26.3 »
C. Schwab

Catalogue data

AbstractThe seminar will review recent _mathematical results_
on approximation power of deep neural networks (DNNs).
The focus will be on mathematical proof techniques to
obtain approximation rate estimates (in terms of neural network
size and connectivity) on various classes of input data
including, in particular, selected types of PDE solutions.
Learning objective
ContentDeep Neural Networks (DNNs) have recently attracted substantial
interest and attention due to outperforming the best established
techniques in a number of tasks (Chess, Go, Shogi,
autonomous driving, language translation, image classification, etc.).
In big data analysis, DNNs achieved remarkable performance
in computer vision, speech recognition and natural language processing.
In many cases, these successes have been achieved by
heuristic implementations combined
with massive compute power and training data.

For a (bird's eye) view, see
https://doi.org/10.1017/9781108860604
and, more mathematical and closer to the seminar theme,
https://doi.org/10.1109/TIT.2021.3062161

The seminar will review recent _mathematical results_
on approximation power of deep neural networks (DNNs).
The focus will be on mathematical proof techniques to
obtain approximation rate estimates (in terms of neural network
size and connectivity) on various classes of input data
including, in particular, selected types of PDE solutions.
Mathematical results support that DNNs can
equalize or outperform the best mathematical results
known to date.

Particular cases comprise:
high-dimensional parametric maps,
analytic and holomorphic maps,
maps containing multi-scale features which arise as solution classes from PDEs,
classes of maps which are invariant under group actions.

Format of the Seminar:
The seminar format will be oral student presentations, combined with written report.
Student presentations will be based on a recent research paper
selected in two meetings at the start of the semester.

Grading of the Seminar:
Passing grade will require
a) 1hr oral presentation _via Zoom_ with Q/A from the seminar group, in early May 2022
and
b) typed seminar report (``Ausarbeitung'') of several key aspects
of the paper under review.

Each seminar topic will allow expansion to a semester or a
master thesis in the MSc MATH or MSc Applied MATH.

Disclaimer:
The seminar will _not_ address recent developments in DNN software,
eg. TENSORFLOW, and algorithmic training heuristics, or
programming techniques for DNN training in various specific applications.
CompetenciesCompetencies
Subject-specific CompetenciesConcepts and Theoriesassessed
Techniques and Technologiesassessed
Method-specific CompetenciesAnalytical Competenciesassessed
Decision-makingfostered
Media and Digital Technologiesfostered
Problem-solvingassessed
Project Managementfostered
Social CompetenciesCommunicationassessed
Cooperation and Teamworkassessed
Customer Orientationfostered
Leadership and Responsibilityfostered
Self-presentation and Social Influence assessed
Sensitivity to Diversityassessed
Negotiationfostered
Personal CompetenciesAdaptability and Flexibilityfostered
Creative Thinkingassessed
Critical Thinkingassessed
Integrity and Work Ethicsassessed
Self-awareness and Self-reflection fostered
Self-direction and Self-management assessed

Performance assessment

Performance assessment information (valid until the course unit is held again)
Performance assessment as a semester course
ECTS credits4 credits
ExaminersC. Schwab
Typeungraded semester performance
Language of examinationEnglish
RepetitionRepetition only possible after re-enrolling for the course unit.
Additional information on mode of examinationPassing grade will require
a) 1hr oral presentation with Q/A from the seminar group and
b) typed seminar report (``Ausarbeitung'') of several key aspects of the paper under review.

Learning materials

No public learning materials available.
Only public learning materials are listed.

Groups

No information on groups available.

Restrictions

GeneralPermission from lecturers required for all students
PlacesLimited number of places. Special selection procedure.
Beginning of registration periodRegistration possible from 03.01.2022
PriorityRegistration for the course unit is only possible for the primary target group
Primary target groupMathematics MSc (437000)
Applied Mathematics MSc (437100)
Computational Science and Engineering MSc (438000)
Waiting listuntil 28.02.2022
End of registration periodRegistration only possible until 18.02.2022

Offered in

ProgrammeSectionType
Mathematics MasterSeminarsWInformation