1

I have total 22 participants in my treatment group, I have three DVs, and I asked my participants fill out the survey three times (beginning, middle, and the end) throughout of the treatment. I want to examine the changes of DVs throughout of the treatment.

21 participants filled out the survey at time 1, 20 participants filled out the survey at time 2, and 21 participants filled out the survey at time 3.

So I have two questions here:

  1. Should I run MANOVA with time as the independent variable or should I run repeated measures ANOVA for each DV?
  2. If I run MANOVA, how many cases do I have? Can I say I have 62 (21+20+21) cases?
amoeba
  • 93,463
  • 28
  • 275
  • 317
L. Ding
  • 11
  • 1
  • 1
    Which depends on your question. Have a look [here](http://stats.stackexchange.com/questions/13197/differences-between-manova-and-repeated-measures-anova) and [here](http://stats.stackexchange.com/questions/99053/should-i-use-anova-or-manova?rq=1) That should give you some directions. – Stefan Dec 22 '15 at 17:24
  • How many participants filled out the survey at all three times? Is it 20? – amoeba Dec 22 '15 at 18:42
  • I have 18 participants filled out the survey at all three times. – L. Ding Dec 22 '15 at 20:31

2 Answers2

1

There are multiple ways of looking at this and it depends on what questions you want to answer. As you have already realized, separate assessments on the same individuals are not the same as the same total number of assessments on separate individuals. The issue is that observations on the same individual will typically be correlated over time in some manner.

If the responses are sufficiently continuous, one reasonable approach would be to use a mixed effect repeated measures model (assuming that residuals turn out to to be reasonably close to normal). It is typically suggested that in the absence of definite knowledge on the correlation structure, it is sensible to assume an unstructured covariance matrix of the observations over time. Depending on whether the assessment at the beginning is prior to the start of the intervention of interest, this measurement could be a covariate (if it is prior to the start of the intervention) or be treated as a measurement (in either case). However, often it is problematic to treat it as an observation, if it was pre-intervention and some inclusion cut-off was applied to only include patients above or below certain values. If it is being used as a covariate, then one would typically also a assessment time by covariate interaction term (in addition to an asessment time model term).

The next big question is, which comparisons you actually want to do and what assumptions you are making. E.g. are you estimating a separate effect of the intervention at each time? Or are you assuming there is an effect of identical size at each time that is being estimated across all times? Depending on this your model might have further terms for intervention (e.g. dummy coded to 1=intervention group, 0=control group) and/or also time by intervention interaction terms (e.g. effect at beginning, effect at middle time, effect at end of study).

The denominator degrees of freedom (in part answering the question you were asking regarding the effective number of observations) would have to be estimated, one method that is supposed to have good operating characteristics is the Kenward-Rogers method implemented in many software packages (e.g. SAS).

A MANOVA would have at most 21 complete records (depending on whether missing values are always in the same individuals) and some use could be made of the incomplete records. E.g. the repeated measures model I described above would implicitly impute by the type of model I am describing, which would occur under a missing at random assumption, which may or may not be valid.

Björn
  • 21,227
  • 2
  • 26
  • 65
  • What would one do about three DVs in the mixed model with repeated measures approach that you advocate? Would you have three separate models, one for each DV? Or one model with varying random terms for each DV (so that there is some shrinkage over three DVs towards each other)? – amoeba Dec 22 '15 at 18:40
0

Thank you very much for your reply Björn, it helped a lot. I only got one group (treatment group), and I want to examine that if there is a time effect on the group. The first assessment was prior the treatment, so I think it should be treated as covariance. So I think I should run repeated measures ANCOVA for each DV, am I right?

L. Ding
  • 11
  • 1