1

In the following linear model:

$y = \beta_0 +\beta_1 x_1 +\beta_2 x_2 + \beta_3x_1x_2 + \epsilon$

what are called $x_i$? The term $x_1x_2$ is the interaction. In ANOVA, $x_i$ are named "main effects", but in regression I saw a paper mentioning that it is wrong in the context of regression (even though I see it all the times in papers and on CV) and they should be called "simple effects" or "simple main effects". Is it really wrong? Would it be really better to call them "conditional relationship" or something similar?

POC
  • 346
  • 1
  • 8
  • 23
  • 2
    Here, $\beta_1$ and $\beta_2$ would be the main effects. The $x_i$ are the predictors, not their effects. It would be more clear to refer to $\beta_1$ and $\beta_2$ as linear main effects, and to $\beta_3$ as the effect of the interaction of $x_1$ and $x_2$. The name 'simple' is not very clear, because main effects might be non-linear (although there are linear here) too. – Marjolein Fokkema Mar 31 '21 at 16:48

1 Answers1

2

I try to avoid the term "main effect" when there's an interaction, or at least wrap it in quotes if I feel forced to use it. The reason is perhaps mostly psychological, but avoiding the term can help avoid a lot of confusion.

The problem is that, with an interaction term involving a predictor, changing the reference value of its interacting predictor can change its own apparent "main effect"! See this page for a worked-through example. In your equation, if $\beta_3$ is non-zero, the value of $\beta_1$ will change if you change the centering of $x_2$ (continuous case) or change the $x_2$ reference level (categorical case).

I have frequently answered questions on this site about mysterious unexpected "lack of significance" of "main effects" known to be "important" when they are involved in interactions. The confusion always results from an attempt to interpret the "significance" of a "main effect" coefficient as representing the "importance" of a predictor that is involved in an interaction. If there's an interaction, evaluating the "importance" of the predictor must take into account its interaction coefficients too.

Why should something that sounds so definitive as a "main effect" of one predictor depend on how you have handled another predictor? The term "simple effect" sounds appropriately less definitive.

EdM
  • 57,766
  • 7
  • 66
  • 187
  • I always thought a simple effect was the impact of one variable on the dependent variable at a specific level of another variable. Which of course only really matters if there is interaction between the two predictors. That is a slope or effect size of variable a on b at some specific level of c when c and a predict b. Like this http://web.pdx.edu/~newsomj/uvclass/ho_factorial%20follow-ups.pdf – user54285 Apr 01 '21 at 00:20