Logo

Information Theory and Statistical Physics

Small book cover: Information Theory and Statistical Physics

Information Theory and Statistical Physics
by

Publisher: arXiv
Number of pages: 176

Description:
This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism between Information Theory and Statistical Physics, as well as to the insights, the analysis tools and techniques that can be borrowed from Statistical Physics and 'imported' to certain problem areas in Information Theory.

Home page url

Download or read it online for free here:
Download link
(1.2MB, PDF)

Similar books

Book cover: A Mathematical Theory of CommunicationA Mathematical Theory of Communication
by
Shannon presents results previously found nowhere else, and today many professors refer to it as the best exposition on the subject of the mathematical limits on communication. It laid the modern foundations for what is now coined Information Theory.
(51934 views)
Book cover: A primer on information theory, with applications to neuroscienceA primer on information theory, with applications to neuroscience
by - arXiv
This chapter is supposed to give a short introduction to the fundamentals of information theory, especially suited for people having a less firm background in mathematics and probability theory. The focus will be on neuroscientific topics.
(3849 views)
Book cover: Data Compression ExplainedData Compression Explained
by - mattmahoney.net
This book is for the reader who wants to understand how data compression works, or who wants to write data compression software. Prior programming ability and some math skills will be needed. This book is intended to be self contained.
(5258 views)
Book cover: Information Theory, Excess Entropy and Statistical ComplexityInformation Theory, Excess Entropy and Statistical Complexity
by - College of the Atlantic
This e-book is a brief tutorial on information theory, excess entropy and statistical complexity. From the table of contents: Background in Information Theory; Entropy Density and Excess Entropy; Computational Mechanics.
(7694 views)