Florian Tramèr: Katalogdaten im Frühjahrssemester 2023

NameHerr Prof. Dr. Florian Tramèr
NamensvariantenFlorian Tramèr
Florian Tramer
LehrgebietInformatik
Adresse
Professur für Informatik
ETH Zürich, CAB F 72
Universitätstrasse 6
8092 Zürich
SWITZERLAND
E-Mailflorian.tramer@inf.ethz.ch
DepartementInformatik
BeziehungAssistenzprofessor (Tenure Track)

NummerTitelECTSUmfangDozierende
263-5354-00LLarge Language Models Information 8 KP3V + 2U + 2AR. Cotterell, M. Sachan, F. Tramèr, C. Zhang
KurzbeschreibungLarge language models have become one of the most commonly deployed NLP inventions. In the past half-decade, their integration into core natural language processing tools has dramatically increased the performance of such tools, and they have entered the public discourse surrounding artificial intelligence.
LernzielTo understand the mathematical foundations of large language models as well as how to implement them.
InhaltWe start with the probabilistic foundations of language models, i.e., covering what constitutes a language model from a formal, theoretical perspective. We then discuss how to construct and curate training corpora, and introduce many of the neural-network architectures often used to instantiate language models at scale. The course covers aspects of systems programming, discussion of privacy and harms, as well as applications of language models in NLP and beyond.
LiteraturThe lecture notes will be supplemented with various readings from the literature.