Review of the partially overlapping samples framework: Paired observations and independent observations in two samples

Derrick, Ben; White, Paul

Abstract

A frequently asked question in quantitative research is how to compare two samples that include some combination of paired observations and unpaired observations. In our publications and R package, we refer to the scenario as ‘partially overlapping samples’. Most frequently the desired comparison is that of central location. Depending on the context, the research question could be a comparison of means, distributions, proportions or variances. In the 20th century, traditional approaches that discard either the paired observations or the independent observations were customary. In the 21st century approaches that make use of all available data are becoming more prominent. Traditional and modern approaches for the analyses for each of these research questions are reviewed. We conclude that tests that report a directly measurable difference between the two groups provide the best solutions.

• Journal Article Type: Article
• Acceptance Date: Jan 25, 2022
• Publication Date: 2022
• Deposit Date: Jan 29, 2022
• Publicly Available Date: Mar 17, 2022
• Journal: Quantitative Methods for Psychology
• Print ISSN: 2292-1354
• Publisher: University of Ottawa, School of Psychology
• Peer Reviewed: Peer Reviewed
• Volume: 18
• Issue: 1
• Pages: 55-65
• DOI: https://doi.org/10.20982/tqmp.18.1.p055
• Keywords: missing observations, paired samples, partially overlapping samples, partially paired data
• Public URL: https://uwe-repository.worktribe.com/output/8704227
• Publisher URL: https://www.tqmp.org/