Questions tagged [quantile-regression]

Quantile regression allows us to estimate the effect of a set of predictor variables over the entire distribution of the outcome variable or any particular quantile.

Most standard regression techniques focus on estimating how the conditional expectation of an outcome variable ($Y$) depends on a set of predictor variables ($X$). Quantile regression goes beyond mean effects, to estimate the impact of $X$ on any quantile or quantiles of $Y$. This enables researchers to assess many interesting questions like: what is the effect of smoking on infants with the lowest birth weight? How does a job market training program affect those at the bottom of the ability distribution? Or does smaller class size benefit the stronger or weaker students more?

338 questions
44
votes
2 answers

What is the difference between conditional and unconditional quantile regression?

The conditional quantile regression estimator by Koenker and Basset (1978) for the $\tau^{th}$ quantile is defined as $$ \widehat{\beta}_{QR} = \min_{b} \sum^{n}_{i=1} \rho_\tau (y_i - X'_i b_\tau) $$ where $\rho_\tau = u_i\cdot (\tau - 1(u_i<0))$…
AlexH
  • 946
  • 1
  • 9
  • 18
41
votes
1 answer

Quantile regression: Which standard errors?

The summary.rq function from the quantreg vignette provides a multitude of choices for standard error estimates of quantile regression coefficients. What are the special scenarios where each of these becomes optimal/desirable? "rank" which produces…
Jase
  • 1,904
  • 3
  • 20
  • 33
37
votes
2 answers

Quantile regression: Loss function

I am trying to understand the quantile regression, but one thing that makes me suffer is the choice of the loss function. $\rho_\tau(u) = u(\tau-1_{\{u<0\}})$ I know that the minimum of the expectation of $\rho_\tau(y-u)$ is equal to the…
CDO
  • 473
  • 1
  • 4
  • 6
28
votes
2 answers

How does quantile regression "work"?

I am hoping to get an intuitive, accessible explanation of quantile regression. Let's say I have a simple dataset of outcome $Y$, and predictors $X_1, X_2$. If, for example, I run a quantile regression at .25,.5,.75, and get back…
Jeremy
  • 1,259
  • 3
  • 12
  • 17
26
votes
1 answer

What diagnostic plots exists for quantile regression?

Following on my question for OLS, I wonder: what diagnostic plots exists for quantile regression? (and are there R implementation of them?) A quick google search already came up with the worm plot (which I have never heard about before), and I'd be…
Tal Galili
  • 19,935
  • 32
  • 133
  • 195
24
votes
5 answers

When is quantile regression worse than OLS?

Apart from some unique circumstances where we absolutely must understand the conditional mean relationship, what are the situations where a researcher should pick OLS over Quantile Regression? I don't want the answer to be "if there is no use in…
24
votes
2 answers

R-squared in quantile regression

I am using quantile regression to find predictors of 90th percentile of my data. I am doing this in R using the quantreg package. How can I determine $r^2$ for quantile regression which will indicate how much of variability is being explained by…
rnso
  • 8,893
  • 14
  • 50
  • 94
22
votes
2 answers

Is there such a thing as an adjusted $R^2$ for a quantile regression model?

Having included an quantile regression model in a paper, the reviewers want me to include adjusted $R^2$ in the paper. I have calculated the pseudo-$R^2$s (from Koenker and Machado's 1999 JASA paper) for the three quantiles of interest for my…
17
votes
3 answers

Literature on IV quantile regression

In the last months I have read intensively about quantile regression in preparation for my master thesis this summer. Specifically I have read most of Roger Koenker's 2005 book on the topic. Now I want to expand this existing knowledge to quantile…
16
votes
3 answers

What are the advantages of linear regression over quantile regression?

The linear regression model makes a bunch of assumptions that quantile regression does not and, if the assumptions of linear regression are met, then my intuition (and some very limited experience) is that median regression would give nearly…
Peter Flom
  • 94,055
  • 35
  • 143
  • 276
14
votes
2 answers

Model performance in quantile modelling

I am using quantile regression (for example via gbm or quantreg in R) - not focusing on the median but instead an upper quantile (e.g. 75th). Coming from a predictive modeling background, I want to measure how well the model fits on a test set and…
B_Miner
  • 7,560
  • 20
  • 81
  • 144
14
votes
2 answers

Explaining quantile regression to nonstatisticians

I recently submitted a paper, in which I used quantile regression, to a psychology journal. Although I thought I had already put enough thought in a clear exposition of quantile regression, the reviewers asked for better explanations of the quantile…
Johannes
  • 1,158
  • 1
  • 12
  • 13
13
votes
1 answer

Quantile regression estimator formula

I have seen two different representations of the quantile regression estimator which are $$Q(\beta_{q}) = \sum^{n}_{i:y_{i}\geq x'_{i}\beta} q\mid y_i - x'_i \beta_q \mid + \sum^{n}_{i:y_{i}< x'_{i}\beta} (1-q)\mid y_i - x'_i \beta_q…
AlexH
  • 946
  • 1
  • 9
  • 18
13
votes
2 answers

Quantile regression prediction

I am interested in using quantile regression for some of my models, but would like to have some clarifications on what can I achieve using this methodology. I understand I can obtain a more robust analysis of IV/DV relationship, especially when…
Robert Kubrick
  • 4,078
  • 8
  • 38
  • 55
13
votes
0 answers

What is tantile regression?

My question follows on this discussion of medials and tantiles vs medians and quantiles from earlier this year: When would we use tantiles and the medial, rather than quantiles and the median? As described in the link, medials are a measure of…
Mike Hunter
  • 9,682
  • 2
  • 20
  • 43
1
2 3
22 23