Relating Thermodynamics to Information Theory: The Equality of Free Energy and Mutual Information

Information theory, thermodynamcs, mutual information, free energy

Feinstein, David I. ; Cohen, Donald S.

University:California Institute of Technology

Department:Physics, Mathematics and Astronomy

关键词: Information theory, thermodynamcs, mutual information, free energy;   

Others  :  https://thesis.library.caltech.edu/7537/1/Feinstein%201986.pdf

美国|英语

来源: Caltech THESIS

【 摘 要 】

In this thesis we uncover a new relation which links thermodynamics and information theory. We consider time as a channel and the detailed state of a physical system as a message. As the system evolves with time, ever present noise insures that the "message" is corrupted. Thermodynamic free energy measures the approach of the system toward equilibrium.Information theoretical mutual information measures the loss of memory of initial state. We regard the free energy and the mutual information as operators which map probability distributions over state space to real numbers. In the limit of long times, we show how the free energy operator and the mutual information operator asymptotically attain a very simple relationship to one another. This relationship is founded on the common appearance of entropy in the two operators and on an identity between internal energy and conditional entropy. The use of conditional entropy is what distinguishes our approach from previous efforts to relate thermodynamics and information theory.