-3

$$\begin{aligned}f_Y(y_i)&=\frac{{\theta_i}^2\left(y_i+\theta_i+2\right)}{\left(1+\theta_i\right)^{y_i+3}}\\ &=\exp\ \log\left[\frac{{\theta_i}^2\left(y_i+\theta_i+2\right)}{\left(1+\theta_i\right)^{y_i+3}}\right]\\ &=\exp\left[\log\left(\frac{{\theta_i}^2\left(y_i+\theta_i+2\right)}{\left(1+\theta_i\right)^{y_i+3}}\right)\right]\\ &=\exp\left[\log\left({\theta_i}^2\right)+\log\left(y_i+\theta_i+2\right)-\log\left(1+\theta_i\right)^{y_i+3}\right] \end{aligned}$$

Need to write in the form

$$f(y) = \exp{ [y(\theta) - b(\theta)]/ a(thi) + c(y, thi)}$$

I am actually stuck here and I am not sure about whether it can be written as canonical form or not. I have read somewhere that mixed distributions are not members of the exponential family.

The Pointer
  • 1,064
  • 13
  • 35
CORNICHON
  • 9
  • 3

1 Answers1

5

In many cases there's a relatively simple, mindless test you can apply.

Recall that an Exponential family of distributions has densities of the form

$$f(x,\theta) = \exp(\eta(\theta)T(x) + A(\theta)+B(x)).$$

Suppose there is a region of values of $(x,\theta)$ in which $\eta,$ $T,$ $A,$ and $B$ are differentiable. Applying the logarithm and taking derivatives shows

$$\frac{\partial^2}{\partial x\partial \theta}\log f(x,\theta) = \eta^\prime(\theta)T^\prime(x),\tag{*}$$

effectively "killing off" the $A$ and $B$ terms.

If you can restrict this region to one where $\eta^\prime$ and $T^\prime$ each remain positive or negative, without equaling zero, and each is differentiable, you can repeat this process (after taking absolute values, if necessary, to assure the log can be applied):

$$\frac{\partial^2}{\partial x\partial \theta} \log|\frac{\partial^2}{\partial x\partial \theta}\log f(x,\theta)| = 0.$$

The result is zero because taking the log splits $(*)$ into a sum of a function of $\theta$ and a function of $x;$ just as at the outset, the mixed partial derivative kills both terms.

The Lindley-Poisson distribution is a discrete distribution on the values $x\in\{0,1,2,\ldots\}$ with probabilities

$$f(x,\theta) = \frac{\theta^2(x+\theta+2)}{(\theta+1)^{x+3}}$$

for $\theta\gt 0,$ giving

$$\log f(x,\theta) = 2\log\theta + \log(x+\theta+2) - (x+3)\log(\theta+1).$$

Its mixed partial derivative can be mechanically computed using basic laws of differentiation as

$$\frac{\partial^2}{\partial x\partial \theta}\log f(x,\theta) = 0 - \frac{1}{(x+\theta+2)^2} - \frac{1}{\theta+1}.$$

This is constantly negative. Repeating this operation on its absolute value gives (again purely mechanically)

$$\frac{\partial^2}{\partial x\partial \theta} \log|\frac{\partial^2}{\partial x\partial \theta}\log f(x,\theta)| = \frac{6}{(x+\theta+2)^4}\ne 0,$$

proving this is not an Exponential family.

whuber
  • 281,159
  • 54
  • 637
  • 1,101
  • Hello @Whuber, thank you for the response. But can you please clarify why is that for distribution to belong to the exponential family the above differentiation should equal to zero? – CORNICHON Apr 14 '21 at 18:47
  • In fact, I wanted to write it in the form which is in the link below. https://www.stat.purdue.edu/~ovitek/STAT526-Spring11_files/pdfs/hw8-sol.pdf – CORNICHON Apr 14 '21 at 18:48
  • (1) I searched that pdf file for "Lindley" but found nothing, then searched for "Poisson" but still found nothing about the Poisson-Lindley distribution. (2) Re your request for clarification, I gave the full derivation in the first half of this answer between the lines "Recall that" and "kills both terms." – whuber Apr 14 '21 at 19:48
  • I meant in this form: f(y)=exp{ [y(theta) - b(theta)]/ a(thi) + c(y, thi)} – CORNICHON Apr 15 '21 at 06:16
  • That form might be reminiscent of an Exponential family but it is not the same. – whuber Apr 15 '21 at 15:48
  • "Suppose there is a region of values of $(x,\theta)$ in which $\eta,$ $T,$ $A,$ and $B$ are differentiable." do we know that this is safe to assume? For instance, if I want to apply this to the examples presented here https://stats.stackexchange.com/q/520049/163242 , how do I know I can do so? – The Pointer Apr 16 '21 at 16:01
  • @Pointer It's not safe to assume that: it's something you have to check in any given instance. (It's virtually always the case, though.) – whuber Apr 16 '21 at 16:26
  • Based on the pdf linked by OP, looks like they were interested in an exponential dispersion family instead. – StubbornAtom May 18 '21 at 18:02