Questions tagged [treatment-effect]

A treatment effect is the causal effect of some "treatment" or policy intervention on an outcome variable. Such effects can be estimated with data from randomized or quasi experiments, and clinical trials or with observational data and methods for causal inference.

A treatment effect is the causal effect of some "treatment" or policy intervention on an outcome variable. Typical examples are the effect of participation in a job market program or the effect of a particular drug. The usual difficulty is to control for selection bias which arises if treated units are different from non-treated units due to reasons which are unrelated to the treatment itself. This can be achieved by utilizing data from randomized or quasi experiments, and clinical trials or with observational data and methods for causal inference (e.g. instrumental variables or matching).

Treatments can have continuous intensity but in the standard potential outcomes framework they are assumed to be binary. The two most commonly used measures are the average treatment effect (ATE) and the average treatment effect on the treated (ATT): $$\begin{align} ATE &= E[y_1 - y_0] \newline ATT &= E[y_1 - y_0|D = 1] \end{align}$$ where the dummy $D$ denotes treatment status ($1 =$ treated, $0$ otherwise), whilst $y_1$ and $y_0$ denoted the potential outcomes in the two states. ATE is the expected treatment effect on a randomly extracted unit from the population. ATT is the expected treatment effect on a randomly extracted unit from the sub-population that has been exposed to the treatment.

426 questions
29
votes
2 answers

Propensity score matching - What is the problem?

In estimation of treatment effects a commonly used method is matching. There are of course several techniques used for matching but one of the more popular techniques is propensity-score matching. However, I sometimes stumble upon contexts where it…
23
votes
1 answer

Which Theories of Causality Should I know?

Which theoretical approaches to causality should I know as an applied statistician/econometrician? I know the (a very little bit) Neyman–Rubin causal model (and Roy, Haavelmo etc.) Pearl's Work on Causality Granger Causality (though less…
18
votes
2 answers

Unconfoundedness in Rubin's Causal Model- Layman's explanation

When implementing Rubin's causal model, one of the (untestable) assumptions that we need is unconfoundedness, which means $$(Y(0),Y(1))\perp T|X$$ Where the LHS are the counterfactuals, the T is the treatment, and X are the covariates that we…
RayVelcoro
  • 1,039
  • 1
  • 10
  • 19
14
votes
3 answers

Strong ignorability: confusion on the relationship between outcomes and treatment

In the research area of potential outcomes and individual treatment effect (ITE) estimation, a common assumption called ''strong ignorability'' is often made. Given a graphical model with the following variables: treatment $T=\{0,1\}$ (e.g. giving…
10
votes
2 answers

Using control variables in experiments?

Why would one want to control for any number of baseline covariates in a situation where the assignment to treatment group is random? My understanding is that randomly assigning treatment should make the treatment variable strictly exogenous,…
Robb
  • 185
  • 1
  • 9
9
votes
0 answers

Propensity Score Matching – How do the mechanics lead to a different result than unmatched?

The gist of propensity score matching, as I understand it, is as follows: You want to estimate the average treatment effect (ATE) of a treatment on some outcome. However, if you simply calculate the difference between the average outcome of the…
9
votes
3 answers

What are the use cases for Propensity Score Matching?

I have asked here whether, in order to establish causal relationships, the treated group and the control group must be similar on all covariates. The answer was no, if we control for the covariates in an OLS regression. So what are the use cases for…
9
votes
3 answers

Assess temporary effect of treatment

Imagine that I have a treatment that reduces the likelihood of response to a stimulus. This could be anything you like, but the simplest example is of a treatment (e.g., hand washing, mask wearing, etc.) that prevents disease when exposed. For…
9
votes
1 answer

ATT vs ATE in propensity score matching when using DiD estimates

According to Lee and Little 2017, when using propensity score (PS) methods, weighting on odds will generate the Average Treatment Effect on the Treated (ATT), while using subclassification and weighting by the inverse probability of treatment (IPTW)…
9
votes
1 answer

What is the best way to visualize difference-in-differences (multi-period) regression?

What's the best way to visualize difference-in-differences for both binary and continuous treatment? Do I regress the outcome variable on the set of controls but exclude the treatment variable and plot the residuals in each group (binary case)? Is…
9
votes
1 answer

How do I interpret a "difference-in-differences" model with continuous treatment?

How do I interpret the ATE coefficient (i.e., the post-treatment indicator interacted with the continuous variable)? Does it make sense? Should I break it down into subgroups and just run a fixed effects model instead (interact an indicator for each…
8
votes
3 answers

How to design experiment and holdout for two types of treatment at the same time

Let's say there are two types of treatment, namely treatment A and treatment B. A subject can be in one of these categories: get treatment A and then treatment B. get treatment B and then treatment A. get only treatment A. get only treatment B. get…
8
votes
1 answer

Difference between marginal and conditional treatment effect? Relating to regression vs. propensity score methods

Peter Austin has a nice introduction to propensity score methods (citation below), and he states that one of the differences between PS methods and plain regression is that PS methods give you a marginal treatment effect, while regression gives you…
7
votes
1 answer

Treatment Effect Bounds

My supervisor and I have run a randomized experiment in a developing country. Due to administrative problems there we unfortunately have the problem of non-response. This non-response is also not random because of a flaw in the experiment that…
7
votes
1 answer

How to calculate and interpret a marginal treatment effect (local instrumental variable)? (Intuition through simple example.)

I am working on the intuition behind local instrumental variables (LIV), also known as the marginal treatment effect (MTE), developed by Heckman & Vytlacil. I have worked some time on this and would benefit from solving a simple example. I hope I…
1
2 3
28 29