8

Importance Sampling can estimated the normalizing constant by averaging the weights (the ratio of unnoramlized distribution and importance distribution). Is there anyway that MCMC algorithm can estimate the normalizing constant as well?

kjetil b halvorsen
  • 63,378
  • 26
  • 142
  • 467
ElleryL
  • 669
  • 3
  • 10
  • 1
    The most common way is Charles Geyers' reverse logistic regression method, which is published as a [Tech Report here](https://conservancy.umn.edu/handle/11299/58433). – Greenparker Feb 07 '19 at 09:57

1 Answers1

4

While I produced a detailed answer to an earlier X validated question, let me recall here that there are many ways of approximating the normalising constant, besides importance sampling:

  1. Chib's (1994) (or the candidate's) formula
  2. Gelfand and Dey's (1995) representation, which includes the infamous harmonic mean estimator
  3. particle filters and sequential Monte Carlo
  4. nested sampling
  5. reversible jump MCMC
  6. path sampling or thermodynamic integration
  7. bridge sampling
  8. Geyer's (1994) logistic regression
  9. the Savage-Dickey representation

some of which are unbiased and most of which are described in Chen, Shao and Ibrahim (2001).

Xi'an
  • 90,397
  • 9
  • 157
  • 575