3

Is there a test I can use to compare two proportions from the same sample that are not mutually exclusive?

For example, I would like see if the proportion of people that answered "yes" to a particular question is significantly different from the proportion of people that answered "yes" to a different question.

gung - Reinstate Monica
  • 132,789
  • 81
  • 357
  • 650
user42087
  • 31
  • 1
  • 2

2 Answers2

7

The within-subjects test of equality of proportions is McNemar's test. I discuss it fairly thoroughly here: What is the difference between McNemar's test and the chi-squared test, and how do you know when to use each? The answer also provides an example demo in R, should you use that, but it should be easy to do in any software.

gung - Reinstate Monica
  • 132,789
  • 81
  • 357
  • 650
1

You could state as your null hypothesis the possibility that both answer statistics are drawn from the same binomial distribution, for the binomial that maximizes the chance that they are drawn from the same binomial.

I think @gung provides the better answer here. Note that the McNemar's test wikipedia article describes the use of the exact binomial sign test for small sample size (assuming equal population for both questions).

jrennie
  • 394
  • 1
  • 5