2

I am using Kullback–Leibler divergence criteria for comparing my estimation and true density functions, but I have zero value on my estimation function when I have a testing set of size 10000, mostly in the last testing points. Finally, I get infinity because of the formula of KL as follow,

$$ KL = \int_R f(x) \log\left\{\frac{f(x)}{\hat{f}(x)}\right\} dx$$

Could I still use this criteria ? If yes, how can I use it? if not, is there any other criteria and what's their formula?

kjetil b halvorsen
  • 63,378
  • 26
  • 142
  • 467
rose
  • 493
  • 1
  • 4
  • 14
  • 1
    Somewhat related: http://stats.stackexchange.com/q/6907/2970 – cardinal May 03 '14 at 20:45
  • @cardinal: I saw that question, it means that instead I can use Hellinger distance with the this formula: $$HD = \int_R \right\{\hat(f)^1/2 - f(x)^1/2\left\}^{2}$$. – rose May 04 '14 at 01:33

0 Answers0