Course: Theory of Signals and Information 2

« Back
Course title Theory of Signals and Information 2
Course code KEF/TSI2
Organizational form of instruction Lecture + Exercise
Level of course Master
Year of study not specified
Semester Summer
Number of ECTS credits 6
Language of instruction Czech
Status of course Compulsory
Form of instruction Face-to-face
Work placements This is not an internship
Recommended optional programme components None
  • Machala Libor, doc. RNDr. Ph.D.
Course content
1. Basic properties and types of analog modulations of signals 2. Amplitude modulation and effect of noise on amplitude-modulated signals 3. Phase modulation and effect of noise on phase-modulated signals 4. Sampling and impulse modulations of signals 5. Quantization and digital modulations of signals 6. Multi-channel signals 7. Application of software Matlab for modelling of signal modulations 8. Definition and basic terms of information theory, information and its quantitative measures, mathematical inequalities in theory of information 9. Basic types and properties of information entropy 10. Mean mutual information and its properties 11. Coding and redundancy of information 12. Transfer of information via discrete channel 13. Transfer of information via continuous channel 14. Relationship between information and thermodynamical entropy

Learning activities and teaching methods
  • Homework for Teaching - 30 hours per semester
  • Preparation for the Exam - 40 hours per semester
  • Attendace - 50 hours per semester
Learning outcomes
The main aim is to learn students the main methods of signal modulations and further basic terms and quantities of information theory.
Knowledge To define the main ideas and conceptions of the subject, describe the main approaches of the studied topics, recall the theoretical knowledge for solution of model problems in the field of signal modulation and theory of information.
Knowledge of signal processing (Fourier transform, signal sampling, signal quantization) Basic knowledge of mathematical analysis (derivations, integrations, functions of complex variable)

Assessment methods and criteria
Mark, Oral exam

Knowledge in the range of lecture content. Attantion is paid to understand signal modulations and principles of information theory. Regular coming to the lectures is strongly recommended. Home preparation for seminars is required.
Recommended literature
  • Bajcsy, J.; Vítovec, J. (1988). Telemetria a prenos údajov. Alfa Bratislava a SNTL Praha.
  • Černý, J. (1981). Entropia a informácia v kybernetike. Alfa Bratislava.
  • Ertinger, Z.; Sklenář, J. (1980). Signály a soustavy. VUT Brno.
  • Goldman, S. (1953). Information theory. Prentice - Hall Inc.
  • Havrda, J. (1982). Stochastické procesy a teorie informace. ČVUT Praha (skriptum).
  • Hoffner, V. (1987). Úvod do teorie signálů. SNTL Praha.
  • MacKay, D. J. C. (2003). Information Theory, Inference, and Learning Algorithms. Cambridge.
  • Pospíšil, J. (1993). Teorie informace. UP Olomouc (skriptum).
  • Pospíšil, J. (1994). Teorie zpracování signálů. UP Olomouc.
  • Prchal, J. (1971). Teorie informace. ČVUT Praha (skriptum).
  • Uhlíř, J., Sovka, P. (2002). Číslicové zpracování signálů. ČVUT Praha.
  • Yeung, R.W. (2002). A First Course in Information Theory. Springer. New York, USA.
  • Young, P.H. (1985). Electronic communication techniques. Ch.E.Merrill Publ. Comp. and Bell - Howel Comp. Columbus.

Study plans that include the course
Faculty Study plan (Version) Branch of study Category Recommended year of study Recommended semester
Faculty of Science Applied Physics (2015) Physics courses 1 Summer