Jensen–Fisher information and Jensen–Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life

Omid Kharazmi, Javier E. Contreras-Reyes, Narayanaswamy Balakrishnan

Research output: Contribution to journalArticlepeer-review

15 Scopus citations

Abstract

Several information and divergence measures existing in the literature assist in measuring the knowledge contained in sources of information. Studying an information source from both positive and negative aspects will result in more accurate and comprehensive information. In many cases, extracting information through the positive approach could be not an easy task while it may be feasible when dealing with the negative aspect. Negation is a new perspective and direction to quantify the information or knowledge in a given system from the negative approach. In this work, we study some new information measures, such as Fisher information, Fisher information distance, Jensen–Fisher information and Jensen–Shannon entropy measures, based on complementary distributions. We then show that the proposed Jensen–Fisher information measure can be expressed based on Fisher information distance measure. We have further shown that the Jensen–Shannon entropy measure has two representations in terms of Kullback–Leibler divergence and Jensen–extropy measures. Some illustrations related to complementary distribution of Bernoulli and Poisson random variables are then presented. Finally, for illustrative purpose, we have examined a real example on Conway's game of life and have presented some numerical results in terms of the proposed information measures.

Original languageEnglish
Article number133822
JournalPhysica D: Nonlinear Phenomena
Volume453
DOIs
StatePublished - Nov 2023
Externally publishedYes

Keywords

  • Complementary distribution
  • Conway's game of life
  • Extropy measure
  • Fisher information
  • Jensen–Fisher information
  • Jensen–Shannon entropy

Fingerprint

Dive into the research topics of 'Jensen–Fisher information and Jensen–Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life'. Together they form a unique fingerprint.

Cite this