Learn R Programming

entropy (version 1.3.1)

Estimation of Entropy, Mutual Information and Related Quantities

Description

Implements various estimators of entropy for discrete random variables, including the shrinkage estimator by Hausser and Strimmer (2009), the maximum likelihood and the Millow-Madow estimator, various Bayesian estimators, and the Chao-Shen estimator. It also offers an R interface to the NSB estimator. Furthermore, the package provides functions for estimating the Kullback-Leibler divergence, the chi-squared divergence, mutual information, and the chi-squared divergence of independence. It also computes the G statistic and the chi-squared statistic and corresponding p-values. Furthermore, there are functions for discretizing continuous random variables.

Copy Link

Version

Install

install.packages('entropy')

Monthly Downloads

6,165

Version

1.3.1

License

GPL (>= 3)

Last Published

October 2nd, 2021

Functions in entropy (1.3.1)

entropy.empirical

Empirical Estimators of Entropy and Mutual Information and Related Quantities
KL.plugin

Plug-In Estimator of the Kullback-Leibler divergence and of the Chi-Squared Divergence
Gstat

G Statistic and Chi-Squared Statistic
entropy.Dirichlet

Dirichlet Prior Bayesian Estimators of Entropy, Mutual Information and Other Related Quantities
entropy

Estimating Entropy From Observed Counts
discretize

Discretize Continuous Random Variables
entropy.ChaoShen

Chao-Shen Entropy Estimator
entropy-internal

Internal entropy functions
entropy.NSB

R Interface to NSB Entropy Estimator
entropy.MillerMadow

Miller-Madow Entropy Estimator
entropy-package

The entropy Package
entropy.plugin

Plug-In Entropy Estimator
mi.plugin

Plug-In Estimator of Mutual Information and of the Chi-Squared Statistic of Independence
entropy.shrink

Shrinkage Estimators of Entropy, Mutual Information and Related Quantities