Information Theory and Coding [ITC]


Lecturer:
Prof. Dr.-Ing. Ralf Müller

Lectures:
Time: Tuesday 14:15-15:45, Friday 08:15-09:45
Place: Caurstrasse 7, H6

ECTS-Credits:

5 credits

Fields of study:
PF CE-BA-TA-IT 5
WF CE-MA-TA-IT 1
WF EEI-BA 5-6
PF EEI-MA-INT 1-4
PF EEI-BA-INT 5-6
WF IuK-BA 5
WF WING-BA-IKS-ING-MG1 5-6
PF CME-MA 1

Language:
English

Tutorial:

Time and place: will be announced.
Attendant: Ali Bereyhi, M.Sc.

Contents:

Basic definitions: Information, Entropy, Mutual Information.
Coding for data compression: Source Coding Theorem, Lossless Compressing Codes: Huffman, Tunstall, Lempel-Ziv-codes.
Entropy and coding for sources with memory.
Markovian sources.
Channel coding for reliable communications over noisy channels: Channel Models, Capacity, Channel Coding Theorem.
Bounding techniques for decoding, Error probability, Cut-Off-Rate, Random Coding, Error Exponent.

Literature:

Huber, J. "Lecture manuscript".
Gallager, R. G. "Information Theory and Reliable Communication," John Wiley & Sons 1968.
MacKay, D. J. C. "Information Theory, Inference and Learning Algorithms," Cambridge University Press, 2003.
Cover, T. and Thomas J. "Elements of Information Theory," John Wiley and Sons, New York, 1991.

Registration via StudOn