Test statistics for comparing two proportions with partially overlapping samples

Derrick, Ben; Dobson-Mckittrick, Anselma; Toher, Deirdre; White, Paul

Abstract

Standard tests for comparing two sample proportions of a dichotomous dependent variable where there is a combination of paired and unpaired samples are considered. Four new tests are introduced and compared against standard tests and an alternative proposal by Choi and Stablein (1982). The Type I error robustness is considered for each of the test statistics. The results show that Type I error robust tests that make use of all the available data are more powerful than Type I error robust tests that do not. The Type I error robustness and the power among tests introduced in this paper using the phi correlation coefficient is comparable to that of Choi and Stablein (1982). The use of the test statistics to form confidence intervals is considered. A general recommendation of the best test statistic for practical use is made.

• Journal Article Type: Article
• Acceptance Date: Nov 30, 2015
• Publication Date: Sep 30, 2015
• Deposit Date: Nov 30, 2015
• Publicly Available Date: Jan 10, 2019
• Journal: Journal of Applied Quantitative Methods
• Peer Reviewed: Peer Reviewed
• Volume: 10
• Issue: 3
• Keywords: partially overlapping samples, partially matched pairs, partially correlated data, equality of proportions
• Public URL: https://uwe-repository.worktribe.com/output/805270
• Publisher URL: http://www.jaqm.ro/issues/volume-10,issue-3/0_BEANDEPA.PHP
• Contract Date: Jan 10, 2019