Learn R Programming

FNN (version 1.1.4.1)

crossentropy: Cross Entropy

Description

KNN Cross Entropy Estimators.

Usage

crossentropy(X, Y, k=10, algorithm=c("kd_tree", "cover_tree", "brute"))

Value

a vector of length k for crossentropy estimates using 1:k nearest neighbors, respectively.

Arguments

X

an input data matrix.

Y

an input data matrix.

k

the maximum number of nearest neighbors to search. The default value is set to 10.

algorithm

nearest neighbor search algorithm.

Author

Shengqiao Li. To report any bugs or suggestions please email: lishengqiao@yahoo.com

Details

If p(x) and q(x) are two continuous probability density functions, then the cross-entropy of p and q is defined as \(H(p;q) = E_p[-\log q(x)]\).

References

S. Boltz, E. Debreuve and M. Barlaud (2007). “kNN-based high-dimensional Kullback-Leibler distance for tracking”. Image Analysis for Multimedia Interactive Services, 2007. WIAMIS '07. Eighth International Workshop on.