Information Theory and Coding
| Code | Completion | Credits | Range | Language |
|---|---|---|---|---|
| A0B01TIK | Z,ZK | 8 | 4+2s | Czech |
- Lecturer:
- Tomáš Kroupa (gar.), Alena Gollová
- Tutor:
- Tomáš Kroupa (gar.), Alena Gollová
- Supervisor:
- Department of Mathematics
- Synopsis:
-
Fundamentals of information theory with a view towards efficient data compression and reliable transmission of information.
- Requirements:
-
Probability, statistics, and information theory (A0B01PSI)
Discrete mathematics (A4B01DMA)
- Syllabus of lectures:
-
1) Entropy, divergence, mutual information. Conditional entropy and conditional information.
2) Entropy rate of stationary and ergodic sources.
3) Universal source coding. Lempel-Ziv coding.
4) Information channel. Basic types.
5) Channel capacity. Blahut-Arimoto algorithm.
6) Shannon theorem.
7) Introduction to secret sharing schemes.
8) Algebraic structures in error detection and correction. Groups and finite fields.
9) Linear codes. Hamming codes.
10) Polynomials over Z_p and quotient rings.
11) Cyclic codes.
12) Galois fields, primitive elements and field characteristics.
13) BCH codes.
14) Reserve.
- Syllabus of tutorials:
-
1) Entropy, divergence, mutual information. Conditional entropy and conditional information.
2) Entropy rate of stationary and ergodic sources.
3) Universal source coding. Lempel-Ziv coding.
4) Information channel. Basic types.
5) Channel capacity. Blahut-Arimoto algorithm.
6) Shannon theorem.
7) Introduction to secret sharing schemes.
8) Algebraic structures in error detection and correction. Groups and finite fields.
9) Linear codes. Hamming codes.
10) Polynomials over Z_p and quotient rings.
11) Cyclic codes.
12) Galois fields, primitive elements and field characteristics.
13) BCH codes.
14) Reserve.
- Study Objective:
-
Understanding of mathematical models used in coding and transmission of digital information.
- Study materials:
-
[1] Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley, 2006.
[2] Yeung, R.W.: Information Theory and Network Coding. Springer, 2008.
[3] Adámek, J.: Kódování. SNTL, Praha, 1989.
[4] Vajda, I.: Teorie informace. Vydavatelství ČVUT, 2004.
- Note:
- Further information:
- http://staff.utia.cas.cz/kroupa/?id=3#TIK
- Time-table for winter semester 2011/2012:
- Time-table is not available yet
- Time-table for summer semester 2011/2012:
-
06:00–08:0008:00–10:0010:00–12:0012:00–14:0014:00–16:0016:00–18:0018:00–20:0020:00–22:0022:00–24:00
Mon Tue Fri Thu Fri - The course is a part of the following study plans: