Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [multivariate-regression]

Regression with more than one response (dependent) variable.

Use this tag to refer to cases where regression is used to model more than one response variable. Use when your question centers on cases with one response.

Special techniques may be used to regress more than one response variable onto a set of predictors. Examples:

More info and references:

323 questions
81
votes
5 answers

Explain the difference between multiple regression and multivariate regression, with minimal use of symbols/math

Are multiple and multivariate regression really different? What is a variate anyways?
Neil McGuigan
  • 9,292
  • 13
  • 54
  • 62
76
votes
2 answers

Multivariate multiple regression in R

I have 2 dependent variables (DVs) each of whose score may be influenced by the set of 7 independent variables (IVs). DVs are continuous, while the set of IVs consists of a mix of continuous and binary coded variables. (In code below continuous…
Andrej
  • 2,131
  • 2
  • 18
  • 26
46
votes
6 answers

Why do we need multivariate regression (as opposed to a bunch of univariate regressions)?

I just browsed through this wonderful book: Applied multivariate statistical analysis by Johnson and Wichern. The irony is, I am still not able to understand the motivation for using multivariate (regression) models instead of separate univariate…
KarthikS
  • 1,066
  • 1
  • 9
  • 18
21
votes
2 answers

Casting a multivariate linear model as a multiple regression

Is recasting a multivariate linear regression model as a multiple linear regression entirely equivalent? I'm not referring to simply running $t$ separate regressions. I have read this in a few places (Bayesian Data Analysis -- Gelman et al., and…
bill_e
  • 2,681
  • 1
  • 19
  • 33
15
votes
4 answers

Neural network for multiple output regression

I have a dataset containing 34 input columns and 8 output columns. One way to solve the problem is to take the 34 inputs and build individual regression model for each output column. I am wondering if this problem can be solved using just one model…
sjishan
  • 263
  • 1
  • 2
  • 7
12
votes
3 answers

gaussian process regression for large datasets

I've been learning about Gaussian process regression from online videos and lecture notes, my understanding of it is that if we have a dataset with $n$ points then we assume the data is sampled from an $n$-dimensional multivariate Gaussian. So my…
Iltl
  • 457
  • 3
  • 10
12
votes
1 answer

Multivariate linear regression with lasso in r

I'm trying to create a reduced model to predict many dependent variables (DV) (~450) that are highly correlated. My independent variables (IV) are also numerous (~2000) and highly correlated. If I use the lasso to select a reduced model for each…
kmace
  • 737
  • 4
  • 17
11
votes
1 answer

Multivariate linear regression vs. several univariate regression models

In the univariate regression settings, we try to model $$y = X\beta +noise$$ where $y \in \mathbb{R}^n$ a vector of $n$ observations and $X \in \mathbb{R}^{n \times m}$ the design matrix with $m$ predictors. The solution is $\beta_0 =…
Roy
  • 719
  • 6
  • 14
11
votes
2 answers

Methods to predict multiple dependent variables

I have a situation in which I have $n$ observations, each with $p$ independent variables and $q$ dependent variables. I would like to build a model or series of models to obtain predictions of the $q$ dependent variables for a new observation. One…
rguha
  • 213
  • 1
  • 2
  • 5
10
votes
1 answer

How to interpret coefficients of a multivariate mixed model in lme4 without overall intercept?

I'm trying to fit a multivariate (i.e., multiple response) mixed model in R. Aside from the ASReml-r and SabreR packages (which require external software), it seems this is only possible in MCMCglmm. In the paper that accompanies the MCMCglmm…
Chris
  • 799
  • 1
  • 7
  • 15
9
votes
2 answers

Coupling time series information from sources with multiple spatial resolutions/scales

I have many satellite raster images available from different sensors. From these, the coarser ones have a very abundant temporal resolution. The medium resolution rasters tend to have less acquisition dates but still some degree of information is…
JEquihua
  • 3,525
  • 2
  • 24
  • 44
8
votes
2 answers

Multivariate response regressions vs many linear models

Would anyone be willing to venture an intuitive description of the situations under which a multivariate response model is more appropriate than many linear regressions? As an example, take a randomly allocated agricultural extension program, and…
generic_user
  • 11,981
  • 8
  • 40
  • 63
8
votes
1 answer

Heteroskedasticity and Distribution of the Dependent Variable in Linear Models

I am running a multivariate ols model where my dependent variable is Food Consumption Score, an index created by the weighted sum of the consumption occurrences of some given food categories. Although I have tried different specifications of the…
Caserio
  • 376
  • 2
  • 14
7
votes
1 answer

What is the difference between multiple regression & mutivariate regression?

I have data on GDP growth as a dependent variable and growth in main production sectors of Pakistan such as mining, electricity, communication, manufacturing and electricity. I am supposed to run a regression on it. Is there any difference between…
maryiam
  • 71
  • 3
7
votes
2 answers

Simple, multiple, univariate, bivariate, multivariate - terminology

I do realise (some of) this has already been addressed here (e.g., Why do we need multivariate regression (as opposed to a bunch of univariate regressions)?, Explain the difference between multiple regression and multivariate regression, with…
Tilen
  • 740
  • 7
  • 18
1
2 3
…
21 22