Table_dofbypct

a vector of integers indicating the degrees of freedom

doflist

a vector of numbers between 0 and 1 standing for the percentile of noise

pctlist

order

ndecimals

a character string naming a standard fit metric (R2, rmse, or user)

fitmetric

a character string "Increasing", "Decreasing", "Flat", "Uncertain" which describes the general slope of the fitmetric function.

trend

any argument that functions within this routine might use


Constructs a table in the form of a data frame of threshold noise values for a given fit metric, a given set of possible degrees of freedom and a given set of percentiles


Goodness-of-fit metrics, such as R-Squared, RMSE, etc., share a sensitivity to noise, dependent on the degrees of freedom.  Some metrics, such as R-Squared, decrease with increasing dof and some, such as RMSE, increase with increasing dof.  This package calculates the noise baseline (ceiling) by random sampling, calculating the metric’s value for each sample and counting the number of samples below a desired level, 95% by default. If one’s measure is above (below) the calculation corresponding to the desired level, then the measurement is distinguishable from noise.  In addition, the ratio of the measurement to the calculated level provides a way to compare measurements of different degrees of freedom.

Table_dofbypct: Noise Threshold Table

Description

Usage

Arguments

Value

Examples