Keep in mind that ncp
confidence intervals are inverted significance tests,
and only inform us about which values are not significantly different than
our sample estimate. (They do not inform us about which values are
plausible, likely or compatible with our data.) Thus, when CIs contain the
value 0, this should not be taken to mean that a null effect size is
supported by the data; Instead this merely reflects a non-significant test
statistic - i.e. the p-value is greater than alpha (Morey et al., 2016).
For positive only effect sizes (Eta squared, Cramer's V, etc.; Effect sizes
associated with Chi-squared and F distributions), this applies also to cases
where the lower bound of the CI is equal to 0. Even more care should be taken
when the upper bound is equal to 0 - this occurs when p-value is greater
than 1-alpha/2 making, the upper bound cannot be estimated, and the upper
bound is arbitrarily set to 0 (Steiger, 2004). For example:
eta_squared(aov(mpg ~ factor(gear) + factor(cyl), mtcars[1:7, ]))
## # Effect Size for ANOVA (Type I)
##
## Parameter | Eta2 (partial) | 90% CI
## --------------------------------------------
## factor(gear) | 0.58 | [0.00, 0.84]
## factor(cyl) | 0.46 | [0.00, 0.78]