The Entropy of a Discrete Real Variable

Entropy

关键词: Shannon entropy;    information entropy;    information theory;   

DOI  :  10.3390/e14081522

来源: mdpi

【 摘 要 】

The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set of probabilities, but the indeterminacy in a real-valued discrete variable depends on both the allowed outcomesis derived here from the total differential entropy of a continuous real variable and its conjugate in the discrete limit, where the conjugate is universally eliminated. The asymptotic differential entropy recovers H plus the new measure, named Ξ, which provides a novel probe of intrinsic organization in sequences of real numbers.

【 授权许可】

CC BY   
© 2012 by the author; licensee MDPI, Basel, Switzerland.