An auxiliary function for the qualityF
parameter in the FS.greedy.heuristic.reduct.RST
, FS.DAAR.heuristic.RST
and FS.greedy.heuristic.superreduct.RST
functions.
It is based on entropy as a measure of information(Shannon, 1948).
X.entropy(decisionDistrib)
a numeric value indicating entropy of an attribute.
an integer vector corresponding to a distribution of attribute values
Andrzej Janusz
C. E. Shannon, "A Mathematical Theory of Communication", Bell System Technical Journal, vol. 27, p. 379 - 423, 623 - 656 (1948).