Logo

Information Theory and Coding

Small book cover: Information Theory and Coding

Information Theory and Coding
by

Publisher: University of Cambridge
Number of pages: 75

Description:
The aims of this course are to introduce the principles and applications of information theory. The course will study how information is measured in terms of probability and entropy, and the relationships among conditional and joint entropies; how these are used to calculate the capacity of a communication channel, with and without noise; coding schemes, including error correcting codes; how discrete channels and measures of information generalize to their continuous forms; etc.

Home page url

Download or read it online for free here:
Download link
(1.4MB, PDF)

Similar books

Book cover: A primer on information theory, with applications to neuroscienceA primer on information theory, with applications to neuroscience
by - arXiv
This chapter is supposed to give a short introduction to the fundamentals of information theory, especially suited for people having a less firm background in mathematics and probability theory. The focus will be on neuroscientific topics.
(5997 views)
Book cover: Algorithmic Information TheoryAlgorithmic Information Theory
by - CWI
We introduce algorithmic information theory, also known as the theory of Kolmogorov complexity. We explain this quantitative approach to defining information and discuss the extent to which Kolmogorov's and Shannon's theory have a common purpose.
(7475 views)
Book cover: Information Theory and Statistical PhysicsInformation Theory and Statistical Physics
by - arXiv
Lecture notes for a graduate course focusing on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, or graduate students in Physics.
(9880 views)
Book cover: Data CompressionData Compression
- Wikibooks
Data compression is useful in some situations because 'compressed data' will save time (in reading and on transmission) and space if compared to the unencoded information it represent. In this book, we describe the decompressor first.
(6644 views)