In basic data analysis it is vital to get basic descriptive statistics.
Procedures such as summary
and Hmisc::describe do so. The describe function in the psych
package is meant to produce the most frequently requested stats in psychometric and psychology studies, and to produce them in an easy to read data.frame. If a grouping variable is called for in formula mode, it will also call describeBy
to the processing. The results from describe can be used in graphics functions (e.g., error.crosses
).
The range statistics (min, max, range) are most useful for data checking to detect coding errors, and should be found in early analyses of the data.
Although describe will work on data frames as well as matrices, it is important to realize that for data frames, descriptive statistics will be reported only for those variables where this makes sense (i.e., not for alphanumeric data).
If the check option is TRUE, variables that are categorical or logical are converted to numeric and then described. These variables are marked with an * in the row name. This is somewhat slower. Note that in the case of categories or factors, the numerical ordering is not necessarily the one expected. For instance, if education is coded "high school", "some college" , "finished college", then the default coding will lead to these as values of 2, 3, 1. Thus, statistics for those variables marked with * should be interpreted cautiously (if at all).
In a typical study, one might read the data in from the clipboard (read.clipboard
), show the splom plot of the correlations (pairs.panels
), and then describe the data.
na.rm=FALSE is equivalent to describe(na.omit(x))
When finding the skew and the kurtosis, there are three different options available. These match the choices available in skewness and kurtosis found in the e1071 package (see Joanes and Gill (1998) for the advantages of each one).
If we define \(m_r = [\sum(X- mx)^r]/n\) then
Type 1 finds skewness and kurtosis by \(g_1 = m_3/(m_2)^{3/2} \) and \(g_2 = m_4/(m_2)^2 -3\).
Type 2 is \(G1 = g1 * \sqrt{n *(n-1)}/(n-2)\) and \(G2 = (n-1)*[(n+1)g2 +6]/((n-2)(n-3))\).
Type 3 is \(b1 = [(n-1)/n]^{3/2} m_3/m_2^{3/2}\) and \(b2 = [(n-1)/n]^{3/2} m_4/m_2^2)\).
The additional helper function describeData
just scans the data array and reports on whether the data are all numerical, logical/factorial, or categorical. This is a useful check to run if trying to get descriptive statistics on very large data sets where to improve the speed, the check option is FALSE.
An even faster overview of the data is describeFast
which reports the number of total cases, number of complete cases, number of numeric variables and the number which are factors.
The fast=TRUE option will lead to a speed up of about 50% for larger problems by not finding all of the statistics (see NOTE)
To describe the data for different groups, see describeBy
or specify the grouping variable(s) in formula mode (see the examples).