252-0055-00L  Information Theory

SemesterSpring Semester 2020
LecturersL. Haug, J. M. Buhmann
Periodicityyearly recurring course
Language of instructionGerman



Courses

NumberTitleHoursLecturers
252-0055-00 VInformationstheorie2 hrs
Thu13:15-15:00ML F 36 »
20.02.13:15-15:00CAB G 52 »
27.02.13:15-15:00CAB G 52 »
L. Haug, J. M. Buhmann
252-0055-00 UInformationstheorie1 hrs
Wed/2w15:15-17:00HG D 7.1 »
19.02.15:15-17:00HG D 3.3 »
L. Haug, J. M. Buhmann

Catalogue data

AbstractThe course covers the fundamental concepts of Shannon's information theory.
The most important topics are: Entropy, information, data compression, channel coding, codes.
Learning objectiveThe goal of the course is to familiarize with the theoretical fundamentals of information theory and to illustrate the practical use of the theory with the help of selected examples of data compression and coding.
ContentIntroduction and motivation, basics of probability theory, entropy and information, Kraft inequality, bounds on expected length of source codes, Huffman coding, asymptotic equipartition property and typical sequences, Shannon's source coding theorem, channel capacity and channel coding, Shannon's noisy channel coding theorem, examples
LiteratureT. Cover, J. Thomas: Elements of Information Theory, John Wiley, 1991.

D. MacKay, Information Theory, Inference and Learning Algorithms, Cambridge University Press, 2003.

C. Shannon, The Mathematical Theory of Communication, 1948.

Performance assessment

Performance assessment information (valid until the course unit is held again)
Performance assessment as a semester course
ECTS credits4 credits
ExaminersL. Haug, J. M. Buhmann
Typesession examination
Language of examinationGerman
RepetitionThe performance assessment is only offered in the session after the course unit. Repetition only possible after re-enrolling.
Mode of examinationwritten 120 minutes
Written aidsKeine!
This information can be updated until the beginning of the semester; information on the examination timetable is binding.

Learning materials

 
Main linkInformation
Only public learning materials are listed.

Groups

No information on groups available.

Restrictions

There are no additional restrictions for the registration.

Offered in

ProgrammeSectionType
Computer Science BachelorElectivesWInformation