Why Welch’s test is Type I error robust

Derrick, Ben; Toher, Deirdre; White, Paul

Abstract

The comparison of two means is one of the most commonly applied statistical procedures in psychology. The independent samples t-test corrected for unequal variances is commonly known as Welch’s test, and is widely considered to be a robust alternative to the independent samples t-test. The properties of Welch’s test that make it Type I error robust are examined. The degrees of freedom used in Welch’s test are a random variable, the distributions of which are examined using simulation. It is shown how the distribution for the degrees of freedom is dependent on the sample sizes and the variances of the samples. The impact of sample variances on the degrees of freedom, the resultant critical value and the test statistic is considered, and hence gives an insight into why Welch’s test is Type I error robust under normality.

• Journal Article Type: Article
• Publication Date: Jan 1, 2016
• Deposit Date: Oct 13, 2015
• Publicly Available Date: Feb 16, 2016
• Journal: The Quantitative Methods in Psychology
• Print ISSN: 2292-1354
• Publisher: University of Ottawa, School of Psychology
• Peer Reviewed: Peer Reviewed
• Volume: 12
• Issue: 1
• Pages: 30-38
• Keywords: Welch's test, type I error, psychology
• Public URL: https://uwe-repository.worktribe.com/output/915692
• Publisher URL: http://www.tqmp.org/RegularArticles/vol12-1/p030/index.html
• Contract Date: Feb 16, 2016