**Information Theory and Statistical Physics**

by Neri Merhav

**Publisher**: arXiv 2010**Number of pages**: 176

**Description**:

This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information Theory, as well as to graduate students in Physics who have basic background in Information Theory. Strong emphasis is given to the analogy and parallelism between Information Theory and Statistical Physics, as well as to the insights, the analysis tools and techniques that can be borrowed from Statistical Physics and 'imported' to certain problem areas in Information Theory.

Download or read it online for free here:

**Download link**

(1.2MB, PDF)

## Similar books

**Conditional Rate Distortion Theory**

by

**Robert M. Gray**-

**Information Systems Laboratory**

The conditional rate-distortion function has proved useful in source coding problems involving the possession of side information. This book represents an early work on conditional rate distortion functions and related theory.

(

**5310**views)

**Information Theory, Inference, and Learning Algorithms**

by

**David J. C. MacKay**-

**Cambridge University Press**

A textbook on information theory, Bayesian inference and learning algorithms, useful for undergraduates and postgraduates students, and as a reference for researchers. Essential reading for students of electrical engineering and computer science.

(

**20057**views)

**Essential Coding Theory**

by

**Venkatesan Guruswami, Atri Rudra, Madhu Sudan**-

**University at Buffalo**

Error-correcting codes are clever ways of representing data so that one can recover the original information even if parts of it are corrupted. The basic idea is to introduce redundancy so that the original information can be recovered ...

(

**3675**views)

**Network Coding Theory**

by

**Raymond Yeung, S-Y Li, N Cai**-

**Now Publishers Inc**

A tutorial on the basics of the theory of network coding. It presents network coding for the transmission from a single source node, and deals with the problem under the more general circumstances when there are multiple source nodes.

(

**12243**views)