0

I have a 2 level repeated measures DV of accuracy, and a covariate of response bias. As response bias increases, accuracy level 1 increases while level 2 decreases. I want to see if there is a difference in the means of the groups after controlling for response bias.

I can't do it with an ANCOVA. Can I just manually calculate expected values based on a regression equation, and run an ANOVA?

I'd like to do it in R or SPSS, so specifics for either would be welcome, but not necessary.

Charlie
  • 275
  • 3
  • 13
  • It's hard to tell for sure, but your situation sounds a lot like [signal detection theory](http://en.wikipedia.org/wiki/Detection_theory). You may want to look into that. If you could extract d' for each unit, you will have a measure of accuracy separated from response bias. – gung - Reinstate Monica Sep 06 '12 at 16:27
  • 1
    You're right! I ruled out SDT a while ago because I only had my two accuracy measures, but then worked out a way to get the reponse bias measure and didn't consider it properly again. Curious to see how it compares to the below suggestion... – Charlie Sep 07 '12 at 00:31
  • I can't quite follow your questions? Does "accuracy level 1 and accuracy level 2" mean just two measurement for different kind of accuracy? Or is it that the level 2 accuracy is the group accuracy that only differs from group to group? I think for SDT, we only need 1-FAR and HIT rate, two different accuracy, at least for basic SDT model. Can you elaborate your question and how you pulled it out? – KH Kim Oct 15 '12 at 11:20
  • each participant had one accuracy score for stimulus x and one for stimulus y. While I believe SDT would work, and may use it if I go back to the data, I ended up using observed response bias of each participant to calculate a 'response bias predicted' accuracy score for each accuracy score, then subtracted that from the observed accuracy scores. this left me with the improvement in accuracy not attributable to response bias, (but with a fair bit of error) and I compared these in a repeated measures anova. – Charlie Oct 15 '12 at 23:29

1 Answers1

1

You're testing the interaction between a 2-level repeated measures variable and a quantitative between-subjects variable. I gave a rather extensive answer for how to analyze repeated measures models in R a few days ago here.

Community
  • 1
Patrick S. Forscher
  • 3,122
  • 23
  • 43
  • And you gave a really nice answer then, OP should carefully read it (+1). – Henrik Sep 06 '12 at 14:50
  • Excellent, thanks for the link - still grappling with why exactly it's the interaction I'm interested in but the results themselves make sense. – Charlie Sep 07 '12 at 00:34