Lecturer
Review of related probability and statistics related topics.
1st
Definition of random variable, definition of Alphabet, definition of
joint probability.
2nd
Conditional probabilities and Bayes rule .Independence of two
random variables .Venn's diagram.
3rd
Model of information transmission system. Common sense
definition of information .Logarithmic measure of information.
Self-information.
4th
Definition of information for noisy channel .Posteriori
probabilities.
Average mutual information for noisy channel.
5th
Shannon representation diagram of information source.
Parameters of discrete channel.
Material File