Information Theory [IT-EN]


Lecturer:
Prof. Dr.-Ing. Ralf Müller

Lectures:
Time: Tuesday 12:15-13:45, Wednesday 14:15-15:45
Place: Caurstrasse 7, H 15

ECTS-Credits:

5 credits

Fields of study:
PF CE-BA-TA-IT 5
WF CE-MA-TA-IT 1
WF EEI-BA 5-6
PF EEI-MA-INT 1-4
PF EEI-BA-INT 5-6
WF IuK-BA 5
WF WING-BA-IKS-ING-MG1 5-6
PF CME-MA 1

Language:
English

Tutorial:

Time and place: will be announced.
Attendant: Christoph Rachinger, M.Sc.

Contents:

Basic definitions: Information, Entropy, Mutual Information.
Coding for data compression: Source Coding Theorem, Lossless Compressing Codes: Huffman, Tunstall, Lempel-Ziv-codes.
Entropy and coding for sources with memory.
Markovian sources.
Channel coding for reliable communications over noisy channels: Channel Models, Capacity, Channel Coding Theorem.
Bounding techniques for decoding, Error probability, Cut-Off-Rate, Random Coding Error Exponent.

Literature:

Huber, J. "Lecture manuscript".
Gallager, R. G. "Information Theory and Reliable Communication," John Wiley & Sons 1968.
MacKay, D. J. C. "Information Theory, Inference and Learning Algorithms," Cambridge University Press, 2003.
Cover, T. and Thomas J. "Elements of Information Theory," John Wiley and Sons, New York, 1991.


StudOn Link:

TBD.