Compute a cutoff value given the scores of a person-fit statistic.
cutoff(x,
ModelFit = "NonParametric", Nreps=1000,
IP=x$IP, IRT.PModel=x$IRT.PModel, Ability=x$Ability,
Ability.PModel=x$Ability.PModel, mu=0, sigma=1,
Blvl = 0.05, Breps = 1000, CIlvl = 0.95,
UDlvl = NA)
Object of class "PerFit".
Method required to compute model-fitting item score patterns. The options available are "NonParametric"
(default) and "Parametric"
.
Number of model-fitting item score patterns generated. Default is 1000.
Matrix with previously estimated item parameters. Default is x$IP
.
Parametric IRT model (required if "ModelFit=Parametric"
or if the person fit statistic is parametric). Default is x$IRT.PModel
.
Matrix with previously estimated item parameters. Default is x$Ability
.
Method to use in order to estimate the latent ability parameters (required if "ModelFit=Parametric"
or if the person fit statistic is parametric). Default is x$Ability.PModel
.
Mean of the apriori distribution. Only used when method="BM"
. Default is 0.
Standard deviation of the apriori distribution. Only used when method="BM"
. Default is 1.
Significance level for bootstrap distribution (value between 0 and 1). Default is 0.05.
Number of bootstrap resamples. Default is 1000.
Level of bootstrap percentile confidence interval for the cutoff statistic.
User-defined cutoff level.
An object of class "PerFit.cutoff", which is a list with 5 elements:
Numeric. Value of the computed cutoff.
Numeric. Bootstrap estimated standard error of the cutoff value.
Numeric. Proportion of respondents flagged (that is, with person-fit scores at or more extreme than the cutoff).
String with values "lower" or "upper". It indicates the type of person-fit statistic.
Numeric. Percentile bootstrap (CIlvl)% confidence interval for the cutoff value.
This function computes a reference value (referred to as a 'cutoff') associated to the values of a person-fit statistic computed from a sample. The idea is to create a decision rule: Individual person-fit values at or more extreme than the cutoff result in flagging the corresponding respondents as (potentially) displaying aberrant response behavior.
Depending on the person-fit statistic, an "extreme" score might be a very small (e.g., for Ht
) or a very large (e.g., for G
) value. The cutoff
function routinely reports of which type the person-fit statistic being used is (Tail="lower"
or Tail="upper"
, respectively).
The procedure consists of generating Nreps
model-fitting item response vectors based on parametric model parameters (when ModelFit="Parametric"
) or on proportion of respondents per answer category (when ModelFit="NonParametric"
). This allows computing a sample of Nreps
values of the person fit statistic corresponding to model-fitting item response patterns. A bootstrap procedure is then used to approximate the sampling distribution of the quantile of level Blvl
(resp., 1-Blvl
) for "lower" (resp. "upper") types of person fit statistics, based on Breps
resamples. The cutoff (and its standard error) is given by the median (standard deviation) of this bootstrap distribution. Alternatively, the cutoff can be manually entered by the user (e.g., when it is available from prior data calibration) by means of UDlvl
.
# NOT RUN {
# Load the inadequacy scale data (dichotomous item scores):
data(InadequacyData)
# As an example, compute the Ht person-fit scores:
Ht.out <- Ht(InadequacyData)
# Compute the cutoff value at 1% level:
cutoff(Ht.out, Blvl=.01)
# }
Run the code above in your browser using DataLab