A closed-form expression for the Sharma-Mittal entropy of exponential families

Frank Nielsen; Richard Nock

doi:10.1088/1751-8113/45/3/032003

A closed-form expression for the Sharma-Mittal entropy of exponential families

Frank Nielsen^*, Richard Nock

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

65 Citations (Scopus)

Abstract

The Sharma-Mittal entropies generalize the celebrated Shannon, Rényi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We explicitly instantiate the formula for the case of the multivariate Gaussian distributions and discuss its estimation.

Original language	English
Article number	032003
Journal	Journal of Physics A: Mathematical and Theoretical
Volume	45
Issue number	3
DOIs	https://doi.org/10.1088/1751-8113/45/3/032003
Publication status	Published - 27 Jan 2012
Externally published	Yes

Access to Document

10.1088/1751-8113/45/3/032003

Cite this

@article{5c1808a344c648ae810c6fa91a420775,

title = "A closed-form expression for the Sharma-Mittal entropy of exponential families",

abstract = "The Sharma-Mittal entropies generalize the celebrated Shannon, R{\'e}nyi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We explicitly instantiate the formula for the case of the multivariate Gaussian distributions and discuss its estimation.",

author = "Frank Nielsen and Richard Nock",

year = "2012",

month = jan,

day = "27",

doi = "10.1088/1751-8113/45/3/032003",

language = "English",

volume = "45",

journal = "Journal of Physics A: Mathematical and Theoretical",

issn = "1751-8113",

publisher = "IOP Publishing Ltd.",

number = "3",

}

TY - JOUR

T1 - A closed-form expression for the Sharma-Mittal entropy of exponential families

AU - Nielsen, Frank

AU - Nock, Richard

PY - 2012/1/27

Y1 - 2012/1/27

N2 - The Sharma-Mittal entropies generalize the celebrated Shannon, Rényi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We explicitly instantiate the formula for the case of the multivariate Gaussian distributions and discuss its estimation.

AB - The Sharma-Mittal entropies generalize the celebrated Shannon, Rényi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We explicitly instantiate the formula for the case of the multivariate Gaussian distributions and discuss its estimation.

UR - https://www.scopus.com/pages/publications/84555190989

U2 - 10.1088/1751-8113/45/3/032003

DO - 10.1088/1751-8113/45/3/032003

M3 - Article

SN - 1751-8113

VL - 45

JO - Journal of Physics A: Mathematical and Theoretical

JF - Journal of Physics A: Mathematical and Theoretical

IS - 3

M1 - 032003

ER -

A closed-form expression for the Sharma-Mittal entropy of exponential families

Abstract

Access to Document

Other files and links

Fingerprint

Cite this