Information Theory [IT-EN]


Lecturer:
Prof. Dr.-Ing. Ralf Müller

Lectures:
Time: Tuesday 14:15-15:45, Friday 16:15-17:45
Place: Caurstrasse 7, 0.151-115

ECTS-Credits:

5 credits

Fields of study:
WF EEI-BA 5-6
PF EEI-MA-INT 1-4
PF CE-BA-TA-IT 5
WF CE-MA-TA-IT 1
PF EEI-BA-INT 5-6
WPF IuK-BA 5-6
PF IuK-MA-ÜTMK-EEI 1-4
WPF IuK-MA-ES-EEI 1-4
WPF IuK-MA-KN-EEI 1-4
WPF IuK-MA-MMS-EEI 1-4
WPF IuK-MA-REA-EEI 1-4
WPF IuK-MA-ES 1-4
PF IuK-MA-KOMÜ 1-4
WPF IuK-MA-MMS 1-4
WF WING-BA-IKS-ING-MG1 5-6
PF CME-MA 1
PF ASC-MA 1

Language:
English

Tutorial:
Christoph Rachinger, M.Sc.
Time and place: will be announced.

Contents:

Basic definitions: Information, Entropy, Mutual Information.
Coding for data compression: Source Coding Theorem, Lossless Compressing Codes: Huffman, Tunstall, Lempel-Ziv-codes.
Entropy and coding for sources with memory.
Markovian sources.
Channel coding for reliable communications over noisy channels: Channel Models, Capacity, Channel Coding Theorem.
Bounding techniques for decoding, Error probability, Cut-Off-Rate, Random Coding Error Exponent.

Literature:

Huber, J. "Lecture manuscript".
Gallager, R. G. "Information Theory and Reliable Communication," John Wiley & Sons 1968.
MacKay, D. J. C. "Information Theory, Inference and Learning Algorithms," Cambridge University Press, 2003.
Cover, T. and Thomas J. "Elements of Information Theory," John Wiley and Sons, New York, 1991.


StudOn Link:

TBD.