7

I am trying to compare the efficacy of two devices. Three different operators tested each device for a parameter of interest (the same 3 operators for each device) and yielded two data sets for each device. My first thought was to perform a simple two sample t-test on the data sets; however, it occurred to me that this would be ignoring which data was collected by which operator. It is suspected that the devices perform differently depending on who is using them and I would thus like to be able to mitigate this additional source of variability by blocking the data based on which operator collected it. After doing some research it appears that ANOVA can take into account such blocking. My two questions are:

  1. Am I correct that ANOVA is the appropriate test to use in this case?

  2. Is ANOVA always going to be more powerful than a two-sample t-test in this case or would I be just as well off simply performing the t-test?

Just to be extra clear, my goal is not to assess the degree of variability introduced my using multiple operators but simply to remove it as a confounding variable and only compare the efficacy of one device to the other.

kjetil b halvorsen
  • 63,378
  • 26
  • 142
  • 467
David Webb
  • 367
  • 1
  • 5
  • I don't quite follow this. If you have 3 different operators who use each device, why don't you have 3 datasets instead of 2? – gung - Reinstate Monica Dec 07 '15 at 18:37
  • 1
    @gung Data set 1 contains data for device 1 which was collected by operators 1, 2, and 3. Data set 2 contains data for device 2 which was also collected by operators 1, 2, and 3. I could further divide the data so that I have 6 data sets for each device and each operator and then perform 3 two sample t-tests (one for each operator), but I believe that would increase the likelihood of type I error, correct? That would also be undesirable as it would be possible for one test to reject the null and the other two not reject it or vice versa. – David Webb Dec 07 '15 at 19:29

0 Answers0