Journal Article
© Jun 2013 Volume 11 Issue 1, Editor: Ann Brown, pp1 - 50
Look inside Download PDF (free)
Abstract
Likert‑type data are often assumed to be equidistant by applied researchers so that they can use parametric methods to analyse the data. Since the equidistance assumption rarely is tested, the validity of parametric analyses of Likert‑type data is often unclear. This paper consists of two parts where we deal with this validity problem in two different respects. In the first part, we use an experimental design to show that the perceived distance between scale points on a regular five‑point Likert‑type scale depends on how the verbal anchors are used. Anchors only at the end points create a relatively larger perceived distance between points near the ends of the scale than in the middle (end‑of‑scale effect), while anchors at all points create a larger perceived distance between points in the middle of the scale (middle‑of‑scale effect). Hence, Likert‑type scales are generally not perceived as equidistant by subjects. In the second part of the paper, we use Monte Carlo simulations to explore how parametric methods commonly used to compare means between several
groups perform in terms of actual significance and power when data are assumed to be equidistant even though they are not. The results show that the preferred statistical method to analyse Likert‑type data depends on the nature of their nonequidistance as well as their skewness. Under middle‑of‑scale effect, the omnibus one‑way ANOVA works best when data are relatively symmetric. However, the Kruskal‑Wallis test works better when data are skewed except when sample sizes are unequal, in which case the Brown‑Forsythe test is better. Under end‑of‑scale effect, on the other hand, the Kruskal‑Wallis test should be preferred in most cases when data are at most moderately skewed. When data are heavily skewed, ANOVA works best unless when sample sizes are unequal, in which case the Brown‑Forsythe test should be preferred.
Journal Article
© Jul 2014 Volume 12 Issue 1, Editor: Ann Brown, pp1 - 74
Look inside Download PDF (free)
Abstract
Abstract: The normality assumption behind ANOVA and other parametric methods implies not only mound shape, symmetry, and zero excess kurtosis, but also that data are equidistant. This paper uses a simulation approach to explore the impact of non‑equidista
nce on the performance of statistical methods commonly used to compare locations across several groups. These include the one‑way ANOVA and its robust alternatives, the Brown‑Forsythe test, and the Welch test. We show that non‑equidistance does affect the
se methods with respect to both significance level and power, but the impact differs between the methods. In general, the ANOVA is less sensitive to non‑equidistance than the other two methods are and should therefore be the primary choice when analyzing
potentially non‑equidistant data.