Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [jacobian]

For statistical questions involving the Jacobian matrix (or determinant) of first partial derivatives. For purely mathematical questions about the Jacobian it is better to ask at math SE https://math.stackexchange.com/.

Wikipedia has an article https://en.wikipedia.org/wiki/Jacobian_matrix_and_determinant with further references.

78 questions
32
votes
1 answer

Derivation of change of variables of a probability density function?

In the book pattern recognition and machine learning (formula 1.27), it gives $$p_y(y)=p_x(x) \left | \frac{d x}{d y} \right |=p_x(g(y)) | g'(y) |$$ where $x=g(y)$, $p_x(x)$ is the pdf that corresponds to $p_y(y)$ with respect to the change of the…
dontloo
  • 13,692
  • 7
  • 51
  • 80
18
votes
2 answers

Suppose $Y_1, \dots, Y_n \overset{\text{iid}}{\sim} \text{Exp}(1)$. Show $\sum_{i=1}^{n}(Y_i - Y_{(1)}) \sim \text{Gamma}(n-1, 1)$

What is the easiest way to see that the following statement is true? Suppose $Y_1, \dots, Y_n \overset{\text{iid}}{\sim} \text{Exp}(1)$. Show $\sum_{i=1}^{n}(Y_i - Y_{(1)}) \sim \text{Gamma}(n-1, 1)$. Note that $Y_{(1)} = \min\limits_{1 \leq i…
Clarinetist
  • 3,761
  • 3
  • 25
  • 70
16
votes
3 answers

Generating random points uniformly on a disk

I have to randomly generate 1000 points over a unit disk such that are uniformly distributed on this disk. Now, for that, I select a radius $r$ and angular orientation $\alpha$ such that the radius $r$ is a uniformly distributed variate from $r \in…
ubuntu_noob
  • 327
  • 3
  • 8
11
votes
2 answers

How can I obtain a Cauchy distribution from two standard normal distributions?

I am interested in Let $X\sim N(0,1), Y \sim N(0,1)$ independently. Show $\frac{X}{X+Y}$ is a Cauchy random variable. My work: $f_{X,Y}(x,y)=\frac{1}{2\pi} e^{\frac{-1}{2}(x^2+y^2)}, -\infty
Jen Snow
  • 1,595
  • 2
  • 18
10
votes
1 answer

If $X_1,X_2$ are independent beta then show $\sqrt{X_1X_2}$ is also beta

Here is a problem that came in a semester exam in our university few years back which I am struggling to solve. If $X_1,X_2$ are independent $\beta$ random variables with densities $\beta(n_1,n_2)$ and $\beta(n_1+\dfrac{1}{2},n_2)$ respectively…
Landon Carter
  • 1,295
  • 11
  • 21
9
votes
1 answer

Relation between Covariance matrix and Jacobian in Nonlinear Least Squares

I saw that CovB = inv(J'*J)*MSE in a MATLAB documentation here at http://www.mathworks.com/help/stats/nlinfit.html However, I cant find any sources for the relationship . I believe in it but I need to find a source to refer it. I have looked but I…
Sayantan Roy
  • 103
  • 1
  • 1
  • 9
8
votes
2 answers

Sample random variables conditional on their sum

Let $(X_1, \dots, X_n)$ be an iid sample of random variables with a known continuous distribution. I would like to simulate such a sample, conditional on the value of its sum, that is: $$ X_1, \dots, X_n | \sum_{k=1}^n X_k = s $$ If I was…
thomas
  • 173
  • 1
  • 5
7
votes
1 answer

Reason for absolute value of Jacobian determinant in change-of-variable formula?

When we have a random variable $x$ with a probability density $p(x)$, and a function $y = f(x)$ that is differentiable and can be solved for $x = g(y)$, the change of variable formula leads us to a density for $y$ given by $$ p(x) \, dx = p(x)…
Durden
  • 860
  • 10
  • 12
6
votes
1 answer

Inverse Gaussian chi square connection

The inverse Gaussian distribution $IG(\mu,\lambda)$ is associated with the density $$f(x;\mu,\lambda) = \sqrt{\frac{\lambda}{2\pi x^3}}\,\exp\left\{-\frac{\lambda(x-\mu)^2}{2\mu^2x}\right\}\qquad \lambda,\mu,x>0$$ In Schuster (1968), the following…
Xi'an
  • 90,397
  • 9
  • 157
  • 575
5
votes
2 answers

Are Jacobian adjustments necessary when the target parameter is a difference between two parameters in Stan?

[Note on cross-posting: This question has now been posted on the Stan Forums as well.] I want to model the index called Delta P (e.g., p.144 of this paper), which is basically a difference between two proportions (i.e., $\frac{n_1}{N_1}$ -…
Akira Murakami
  • 263
  • 2
  • 9
5
votes
2 answers

Higher Order of Vectorization in Backpropagation in Neural Network

I have a question about the dimensions of a Jacobian during backpropagation. The network looks like: The forward propagation can be defined as: where g is the activation function. The dimensions of each variable can also be given as: Now, for…
Wei
  • 51
  • 3
5
votes
3 answers

What is the jacobian for a neural network

I know that a Jacobian is a matrix holding all of the first-order derivatives for a vector-valued-function. What is the Jacobian of a neural network, though? What are the inputs and what are the outputs of the function to compute the derivative for?
Mr Tsjolder
  • 1,496
  • 1
  • 11
  • 25
5
votes
2 answers

Transformation of variables (Metropolis Hastings)

Say I have a bunch of data from a Poisson distribution and I want to find out my posterior i.e. I'm data fitting: $p(\lambda | X) \sim p(X|\lambda)p(\lambda)$ where $p(X|\lambda) = \frac{\exp(-\lambda)\lambda^x}{x!}$ so that my log-likelihood looks…
Sigmund Fraud
  • 53
  • 1
  • 3
4
votes
1 answer

conditional probability, change of variable and Jacobian

I have a question, and I am guessing that the question arises due to my lack of good understanding in the change of variable technique. I would like to evaluate $f_X(x)$. When $f_Y(y)$ exists, I can write $f_X(x)$ as: $$ f_X(x) = \int f_{X|Y}(x|y)…
FairyOnIce
  • 755
  • 1
  • 7
  • 15
3
votes
1 answer

How to know the number of dimensions of a Jacobian?

My question comes from a comment in this question Vector Jacobian product in automatic differentiation The question states... $$ t = Wz, \,\,\, z\in \mathbb{R}^{m\times 1}, t \in \mathbb{R}^{n \times 1}, W\in\mathbb{R}^{n \times…
Joff
  • 599
  • 2
  • 13
1
2 3 4 5 6