4

I am comparing two different models (multiple linear model).

Basically the explanatory variables remain the same while response variable are different.

$Model\ 1 - Y_1 = X_1+X_2+X_3$

$Model\ 2 - Y_2 = X_1+X_2+X_3$

I have results from R for both models.

I am just wondering if two of these results eg $F$-statistics, $p$-value, $R^2$, RSS are comparable. So can I say model 1 is better because p-value is smaller. etc ?

From what I learned from class, I only compared models which had the same response variable and different explanatory variables.

Nick Cox
  • 48,377
  • 8
  • 110
  • 156
  • Have a look at the following posts, maybe they are helpful: [first](http://stats.stackexchange.com/questions/33013/what-test-can-i-use-to-compare-slopes-from-two-or-more-regression-models?lq=1), [second](http://stats.stackexchange.com/questions/59327/how-to-compare-two-regression-slopes-for-one-predictor-on-two-different-outcomes/59331#59331), [third](http://stats.stackexchange.com/questions/1735/method-to-compare-variable-coefficient-in-two-regression-models?lq=1). – COOLSerdash Jun 06 '13 at 16:33
  • Is there a functional relationship between $Y_1$ and $Y_2$, ie, can we write $Y_1=g(Y_2)$? Or merely a stochastic relationship ($Y_1 = g(Y_2) +$ error)? – Andrew M Oct 09 '14 at 17:30
  • If $Y_1$ and $Y_2$ are both measuring the same kind of variable in the same units, so that the coefficients in the two equations are measuring the same thing, the coefficients can be compared (indeed a CI for their difference can be generated, for example). However, in that case it's more common to combine the two into a single equation and add a dummy variable for the data set (which main effect picks up difference in intercept), whose interactions can be used to pick up differences in slope coefficients. – Glen_b Nov 11 '14 at 22:28

1 Answers1

1

Yes, you can only really compare two models with the same dependent variable for an F-test. How similar are the two dependent variables? Are they the same outcome from different samples? Or are they two very separate responses?

Francisco Arceo
  • 582
  • 3
  • 7
  • One response variable is total volume and another one is the partial volume. So they are very correlated. – user1925750 Jun 06 '13 at 15:29
  • They have similar distributions but not exactly the same. Perhaps, I can compare them ? What do you think? – user1925750 Jun 06 '13 at 15:32
  • user1925750, what would it mean to compare them? What does it actually tell you? – Glen_b Aug 06 '13 at 01:24
  • I think what Glen_b means is that testing a difference will likely only tell you that there is a difference. But, it doesn't make sense to even do the test because this particular test strictly needs the same dependent variable. – Francisco Arceo Aug 06 '13 at 15:15