Preliminary testing: The devil of statistics?

Pearce, Jack; Derrick, Ben

Abstract

In quantitative research, the selection of the most appropriate statistical test for the comparison of two-independent samples can be problematic. There is a lack of consensus in the Statistics community regarding the appropriate approach; particularly towards assessing assumptions of normality and equal variances. The lack of clarity in the appropriate strategy affects the reproducibility of results. Statistical packages performing different tests under the same name, only adds to this issue.
The process of preliminary testing assumptions of a test using the sample data, before performing a test conditional upon the preliminary test, is performed by some researchers; this practice is often criticised in the literature. Preliminary testing is typically performed at the arbitrary 5% significance level. In this paper this process is reviewed, and additional results are given using simulation, examining a procedure with normality and equal variance preliminary tests.

• Journal Article Type: Article
• Acceptance Date: Apr 3, 2019
• Online Publication Date: Oct 5, 2019
• Publication Date: 2019
• Deposit Date: Apr 11, 2019
• Publicly Available Date: Apr 11, 2019
• Journal: Reinvention: An International Journal of Undergraduate Research
• Print ISSN: 1755-7429
• Peer Reviewed: Peer Reviewed
• Volume: 12
• Issue: 2
• DOI: https://doi.org/10.31273/reinvention.v12i2.339
• Keywords: statistics, robustness, t-test, preliminary testing, conditional tests, independent samples
• Public URL: https://uwe-repository.worktribe.com/output/849125
• Publisher URL: https://doi.org/10.31273/reinvention.v12i2.339
• Contract Date: Apr 11, 2019