0

What makes the results differ for fixed-effects models vis-à-vis random effects models? The Cochrane Collaboration's website indicated that two models can produce different results for a meta analysis. I would like to understand this point better.

mdewey
  • 16,541
  • 22
  • 30
  • 57

1 Answers1

2

The incorporation, or lack, of a measure of statistical heterogeneity (Tau2) between the data sets into the pooled effect estimate is the main difference between the two models. If there is minimal (to almost no) between data statistical heterogeneity, then the results are almost identical. On other hand, the more heterogeneity, the wider the confidence intervals in a random-effects model. In most circumstances, it has been shown that a random-effects model is more conservative and gives wider confidence intervals than a fixed effect model. There have been examples when this is not the case. In addition, in a random-effects model, the amount of weight given to each data set is not only based on variance and studies with relatively larger variance (e.g. smaller studies) get more weight than they would in a fixed-effect model. This is also called the 'small study bias' with a random-effects model.

It really helps to visualize these concepts and there are lots of slides online from systematic review courses. Also, a PubMed search will reveal a lot of intro meta-analysis papers that describe these concepts in more detail. I will update this post once I have a chance to search for them.

Related threads on Cross Validated that may be helpful:

amoeba
  • 93,463
  • 28
  • 275
  • 317
abousetta
  • 1,030
  • 5
  • 9
  • The response has certain substance. Therefore, I must appreciate your effort and vote it up. I think that Tau square needs rank data. How do we go about it when the data is sample correlations. –  May 12 '14 at 15:27
  • This might be helpful (http://www.meta-analysis.com/downloads/Meta-analysis%20fixed%20effect%20vs%20random%20effects.pdf). – abousetta May 12 '14 at 19:08