A Representation of the Relative Entropy with Respect to a Diffusion Process in Terms of Its Infinitesimal Generator

Entropy

Olivier Faugeras¹ 

关键词: relative entropy;    Kullback–Leibler;    diffusion;    martingale formulation;   

DOI  :  10.3390/e16126705

来源: mdpi

【 摘 要 】

In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback–Leibler Divergence) R(μ||P), where μ and P are measures on C([0, T]; ℝ^d)_. The underlying measure P is a weak solution to a martingale problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging). Since R(μ||P) governs the exponential rate of convergence of the empirical measure (according to Sanov’s theorem), this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions.

【 授权许可】

CC BY   
© 2014 by the authors; licensee MDPI, Basel, Switzerland