5

Every lecture and book says that the denominator in Bayes' Rule does not depend on the parameter $\theta$. However, the denominator also includes $\theta$ in the formula of Bayes' Rule. I just cannot understand what it really says.

Frans Rodenburg
  • 10,376
  • 2
  • 25
  • 58
StoryMay
  • 2,273
  • 9
  • 25

1 Answers1

6

In the Bayesian formula:

$$\text{posterior} = \,\frac{\text{likelihood} \cdot \text{prior}}{\text{normalizing constant}}$$

If we call the observations $y$ and the parameters $\theta$, then this equates:

$$p(\theta | y) = \, \frac{p(y | \theta) \cdot p(\theta)}{p(y)}$$

Here, the normalizing constant $p(y)$ is calculated as:

$$p(y) = \int p(y | \theta) \cdot p(\theta) \,\mathrm{d}\theta$$

Since you integrate out $\theta$ (the parameters), the denominator no longer depends on it.

Frans Rodenburg
  • 10,376
  • 2
  • 25
  • 58