6

It is always argued that the posterior median is the Bayes estimate associated to the absolute loss function. The proofs I have come across rely on differentiating the conditional Bayesian risk and equating this to zero. However, this shows that this is an inflection point, but not that it is a minimum. How can one prove that the posterior median indeed minimizes the Bayesian risk?

enter image description here

Most, if not all, textbooks just go next level and just leave it as an exercise to the poor reader.

Richard Hardy
  • 54,375
  • 10
  • 95
  • 219
Valley
  • 63
  • 1
  • 4

2 Answers2

5

Second derivative yields

$$2 \pi (\delta | x) \geq 0$$

So the original function is convex and hence the median corresponds to a minimum not an inflection point

Xiaomi
  • 2,276
  • 6
  • 19
  • How do you get Zero? Are you using $d/dx \int_a^x f(y)dy =f(x)$ and $. - \int_x^a f(y)dy = \int_a^x f(y)dy $? – Xiaomi Nov 14 '18 at 01:58
  • The second derivative as a function of $\delta$ is not zero everywhere. The first derivative is $ 2 \int^\delta \pi(y)dy - 1$. Taking the derivative a second time gives the above result which is clearly not zero everywhere – Xiaomi Nov 14 '18 at 02:13
1

Adding to Xiaomi answer, here is the derivation, using Leibnitz rule:

$\require{cancel} \frac{\partial \rho}{\partial \delta} = \int_{-\infty}^{\delta}\pi(\theta|x)d\theta - \int_{\delta}^{\infty}\pi(\theta|x)d\theta \\ \frac{\partial^2 \rho}{\partial \delta^2} = \pi(\delta|x)\cdot1 - \cancel{\pi(\delta|x)\cdot0} + \cancel{\int_{-\infty}^{\delta}0d\theta} - [\cancel{\pi(\delta|x)\cdot0} - \pi(\delta|x)\cdot1 + \cancel{\int_{\delta}^{\infty}0d\theta}] = 2\pi(\delta|x) $

Maverick Meerkat
  • 2,147
  • 14
  • 27