MachineShop (version 3.3.0)

diff: Model Performance Differences

Description

Pairwise model differences in resampled performance metrics.

Usage

# S3 method for MLModel
diff(x, ...)
# S3 method for Performance
diff(x, ...)
# S3 method for Resample
diff(x, ...)

Arguments

x

model performance or resample result.

...

arguments passed to other methods.

Value

PerformanceDiff class object that inherits from Performance.

See Also

t.test, plot, summary

Examples

# NOT RUN {
## Requires prior installation of suggested package gbm to run

## Survival response example
library(survival)

fo <- Surv(time, status) ~ .
control <- CVControl()

gbm_res1 <- resample(fo, data = veteran, GBMModel(n.trees = 25), control)
gbm_res2 <- resample(fo, data = veteran, GBMModel(n.trees = 50), control)
gbm_res3 <- resample(fo, data = veteran, GBMModel(n.trees = 100), control)

res <- c(GBM1 = gbm_res1, GBM2 = gbm_res2, GBM3 = gbm_res3)
res_diff <- diff(res)
summary(res_diff)
plot(res_diff)
# }
# NOT RUN {
# }