26

I have performed a repeated measures ANOVA in R, as follows:

aov_velocity = aov(Velocity ~ Material + Error(Subject/(Material)), data=scrd)
summary(aov_velocity)
  • What syntax in R can be used to perform a post hoc test after an ANOVA with repeated measures?
  • Would Tukey's test with Bonferroni correction be appropriate? If so, how could this be done in R?
Jeromy Anglim
  • 42,044
  • 23
  • 146
  • 250
L_T
  • 1,463
  • 7
  • 20
  • 25
  • 1
    see this related question on post hoc tests for repeated measures designs http://stats.stackexchange.com/questions/575/post-hocs-for-within-subjects-tests – Jeromy Anglim Aug 11 '11 at 10:08
  • 3
    About your 2nd point: [Tukey's HSD](http://bit.ly/oxasU8) already includes a "correction" for multiplicity (at the level of the test statistic, not the alpha level like in Bonferroni's method). So, there's no need to combine both. – chl Aug 11 '11 at 11:35
  • 1
    @chl: so we don't need to correct the alpha level during the multiple pairwise comparisons in the case of Tukey's HSD ? – abc Sep 26 '11 at 03:46
  • 3
    @stan No. (Note: Unplanned (post-hoc) tests should be performed after the ANOVA showed a significant result, especially if it concerns a confirmatory approach.) – chl Sep 26 '11 at 08:15
  • I cannot find the data scrd to run the example – Dimitrios Zacharatos Feb 03 '20 at 11:30

3 Answers3

21

What you could do is specify the model with lme and then use glht from the multcomp package to do what you want. However, lme gives slightly different F-values than a standard ANOVA (see also my recent questions here).

lme_velocity = lme(Velocity ~ Material, data=scrd, random = ~1|Subject)
anova(lme_velocity)

require(multcomp)
summary(glht(lme_velocity, linfct=mcp(Material = "Tukey")), test = adjusted(type = "bonferroni"))

For other contrasts then bonferroni, see e.g., the book on multcomp from the authors of the package.

You may also want to see this post on the R-mailing list, and this blog post for specifying a repeated measures ANOVA in R.

However, as shown in this question from me I am not sure if this approachs is identical to an ANOVA. Furthermore, glht only reports z-values instead of the usual t or F values. This seems to be uncommon, too.

So far, I haven't encountered another way of doing this.

Community
  • 1
Henrik
  • 13,314
  • 9
  • 63
  • 123
5

If you want to stick with the aov() function you can use the emmeans package which can handle aovlist (and many other) objects. 

library("emmeans")
# set orthogonal contrasts
options(contrasts = c("contr.sum", "contr.poly"))

aov_velocity <- aov(Velocity ~ Material + Error(Subject / Material), data = scrd)

After creating an emmGrid object as follows

emm <- emmeans(aov_velocity, ~ Material)

it is very easy to get all (post hoc) pairwise comparisons using the pairs() function or any desired contrast using the contrast() function of the emmeans package. Multiple-testing adjustments can be achieved via the adjust argument of these functions:

pairs(emm)  # adjust argument not specified -> default p-value adjustment in this case is "tukey"

For more information on this I found the detailed emmeans vignettes and the documentation to be very helpful.

Also, you can find a complete (reproducible) example including a description on how to get the correct contrast weights in my answer here.

Note, however, that using a univariate model for the post hoc tests can result in anti-conservative p-values if sphericity is violated.

statmerkur
  • 1,115
  • 1
  • 9
  • 26
-3

If sphericity is met then you can run a two-way ANOVA: 

aov_velocity = aov(Velocity~Material+Subject, data=scrd)
posthoc      = TukeyHSD(aov_velocity, 'Material', conf.level=0.95).
gung - Reinstate Monica
  • 132,789
  • 81
  • 357
  • 650
Juan José González Henríquez
  • 1