期刊论文详细信息
Entropy
Statistical Divergences between Densities of Truncated Exponential Families with Nested Supports: Duo Bregman and Duo Jensen Divergences
Frank Nielsen1 
[1] Sony Computer Science Laboratories, Tokyo 141-0022, Japan;
关键词: exponential family;    statistical divergence;    truncated exponential family;    truncated normal distributions;   
DOI  :  10.3390/e24030421
来源: DOAJ
【 摘 要 】

By calculating the Kullback–Leibler divergence between two probability measures belonging to different exponential families dominated by the same measure, we obtain a formula that generalizes the ordinary Fenchel–Young divergence. Inspired by this formula, we define the duo Fenchel–Young divergence and report a majorization condition on its pair of strictly convex generators, which guarantees that this divergence is always non-negative. The duo Fenchel–Young divergence is also equivalent to a duo Bregman divergence. We show how to use these duo divergences by calculating the Kullback–Leibler divergence between densities of truncated exponential families with nested supports, and report a formula for the Kullback–Leibler divergence between truncated normal distributions. Finally, we prove that the skewed Bhattacharyya distances between truncated exponential families amount to equivalent skewed duo Jensen divergences.

【 授权许可】

Unknown   

  文献评价指标  
  下载次数:0次 浏览次数:0次