Questions tagged [multiple-regression]

Regression that includes two or more non-constant independent variables. Also known as multivariable regression.

For two or more dependent variables, use .

Linear regression models a variable (the "dependent variable") as varying randomly with respect to a linear combination of other variables (the "independent variables"). Multiple regression includes two or more non-constant independent variables (whence, three or more variables in toto). This adds complications not present with only one independent variable, including complex forms of correlation and interaction effects.

Use this multiple-regression tag instead of the more generic regression tag when your question focuses on an issue specifically related to including two or more independent variables in a regression model.

Multiple regression concerns the so-called "general linear model," not to be confused with the generalized linear model despite the close similarity of their names.

4906 questions
380
votes
7 answers

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?

In some literature, I have read that a regression with multiple explanatory variables, if in different units, needed to be standardized. (Standardizing consists in subtracting the mean and dividing by the standard deviation.) In which other cases…
mathieu_r
  • 4,211
  • 3
  • 14
  • 5
107
votes
12 answers

When should linear regression be called "machine learning"?

In a recent colloquium, the speaker's abstract claimed they were using machine learning. During the talk, the only thing related to machine learning was that they perform linear regression on their data. After calculating the best-fit coefficients…
81
votes
5 answers

Explain the difference between multiple regression and multivariate regression, with minimal use of symbols/math

Are multiple and multivariate regression really different? What is a variate anyways?
81
votes
0 answers

How can a regression be significant yet all predictors be non-significant?

My multiple regression analysis model has a statistically significant F value however all beta values are statistically non-significant. All the regression assumptions are met. No multicollinearity was found. Correlations among all predictors are…
Serene
  • 811
  • 1
  • 7
  • 3
76
votes
2 answers

Multivariate multiple regression in R

I have 2 dependent variables (DVs) each of whose score may be influenced by the set of 7 independent variables (IVs). DVs are continuous, while the set of IVs consists of a mix of continuous and binary coded variables. (In code below continuous…
74
votes
12 answers

What are some of the most common misconceptions about linear regression?

I'm curious, for those of you who have extensive experience collaborating with other researchers, what are some of the most common misconceptions about linear regression that you encounter? I think can be a useful exercise to think about common…
ST21
  • 155
  • 4
  • 10
71
votes
5 answers

How can adding a 2nd IV make the 1st IV significant?

I have what is probably a simple question, but it is baffling me right now, so I am hoping you can help me out. I have a least squares regression model, with one independent variable and one dependent variable. The relationship is not significant.…
EvKohl
  • 1,090
  • 2
  • 10
  • 14
64
votes
2 answers

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?

The coefficient of an explanatory variable in a multiple regression tells us the relationship of that explanatory variable with the dependent variable. All this, while 'controlling' for the other explanatory variables. How I have viewed it so…
Siddharth Gopi
  • 1,395
  • 1
  • 12
  • 22
62
votes
3 answers

What is the effect of having correlated predictors in a multiple regression model?

I learned in my linear models class that if two predictors are correlated and both are included in a model, one will be insignificant. For example, assume the size of a house and the number of bedrooms are correlated. When predicting the cost of a…
60
votes
5 answers

Is adjusting p-values in a multiple regression for multiple comparisons a good idea?

Lets assume you are a social science researcher/econometrician trying to find relevant predictors of demand for a service. You have 2 outcome/dependent variables describing the demand (using the service yes/no, and the number of occasions). You have…
56
votes
9 answers

Are we exaggerating importance of model assumption and evaluation in an era when analyses are often carried out by laymen

Bottom line, the more I learn about statistics, the less I trust published papers in my field; I simply believe that researchers are not doing their statistics well enough. I'm a layman, so to speak. I'm trained in biology but I have no formal…
Adam Robinsson
  • 2,083
  • 3
  • 19
  • 39
55
votes
4 answers

How to visualize a fitted multiple regression model?

I am currently writing a paper with several multiple regression analyses. While visualizing univariate linear regression is easy via scatter plots, I was wondering whether there is any good way to visualize multiple linear regressions? I am…
Shawn Wang
  • 1,245
  • 3
  • 12
  • 12
54
votes
3 answers

Multivariate linear regression vs neural network?

It seems that it is possible to get similar results to a neural network with a multivariate linear regression in some cases, and multivariate linear regression is super fast and easy. Under what circumstances can neural networks give better results…
Hugh Perkins
  • 4,279
  • 1
  • 23
  • 38
50
votes
3 answers

Suppression effect in regression: definition and visual explanation/depiction

What is a suppressor variable in multiple regression and what might be the ways to display suppression effect visually (its mechanics or its evidence in results)? I'd like to invite everybody who has a thought, to share.
ttnphns
  • 51,648
  • 40
  • 253
  • 462
47
votes
3 answers

Why is polynomial regression considered a special case of multiple linear regression?

If polynomial regression models nonlinear relationships, how can it be considered a special case of multiple linear regression? Wikipedia notes that "Although polynomial regression fits a nonlinear model to the data, as a statistical estimation…
1
2 3
99 100