A Mathematical Theory of Communication
by Claude Shannon
Number of pages: 79
The person who wrote this paper is the father of modern communication theory, Claude Shannon. In this seminal work Shannon presents results that were previously found nowhere else, and today many professors refer to it as the best exposition still on the subject of the mathematical limits on communication (such as bandwidth). Further, it laid the modern foundations for what is now coined Information Theory. Classic work.
Download or read it online for free here:
by David Feldman - College of the Atlantic
This e-book is a brief tutorial on information theory, excess entropy and statistical complexity. From the table of contents: Background in Information Theory; Entropy Density and Excess Entropy; Computational Mechanics.
by Alexander Shen - arXiv.org
Algorithmic information theory studies description complexity and randomness. This text covers the basic notions of algorithmic information theory: Kolmogorov complexity, Solomonoff universal a priori probability, effective Hausdorff dimension, etc.
by Gregory J. Chaitin - World Scientic
In this mathematical autobiography, Gregory Chaitin presents a technical survey of his work and a non-technical discussion of its significance. The technical survey contains many new results, including a detailed discussion of LISP program size.
by David J. C. MacKay - Cambridge University Press
A textbook on information theory, Bayesian inference and learning algorithms, useful for undergraduates and postgraduates students, and as a reference for researchers. Essential reading for students of electrical engineering and computer science.