Questions tagged [wishart-distribution]

The Wishart distribution is a common matrix distribution on square symmetric semi-definite matrices.

The Wishart distribution is a common matrix distribution on square symmetric semi-definite matrices. It is usually denoted $\mathscr{W}_p(k,\Xi)$ where $p$ represents the dimension of the matrix, $k$ the degrees of freedom and $\Xi$ a $(p,p)$ ssd matrix, $k\Xi$ being the mean of the distribution.

Considering $k$ iid $\mathcal{N}_p(0,\Xi)$ vectors $X_i$, the $(p,p)$ matrix$$\mathbf{W}=\sum_{i=1}^k X_iX_i^\text{T}$$is a random $(p,p)$ symmetric semi-definite (ssd) matrix. The corresponding distribution is called the Wishart distribution and it is denoted $\mathscr{W}_p(k,\Xi)$ . Its density is $$p(\mathbf{w})=\dfrac{2^{-kp/2}}{\Gamma_p(k/2)|\mathbf{w}|^{k/2}}\,\exp\{-\text{tr}(\Xi^{-1}\mathbf{w}/2\}$$ where tr$(A)$ denotes the trace of the matrix $A$ and $\Gamma_p(k)$ is a generalised Gamma function. The matrix is almost surely positive definite when $k\ge p$ and $$\mathbb{E}[\mathbf{W}]=k\Xi$$ This distribution is commonly used in the Bayesian analysis of matrices and of graphical models, along with declinations like the inverse-Wishart distribution. The name comes from the physicist John Wishart.

101 questions
24
votes
0 answers

Distribution of inverse Wishart to a power?

In a related question, I had asked about the norm induced by an inverse Wishart matrix. I am interested in generalizing that result somewhat. Let $A\sim\mathcal{W}_p\left(I,n\right)$, a Wishart matrix with scale matrix $I$, the identity, and $n$…
17
votes
1 answer

Expected value of the log-determinant of a Wishart matrix

Let $\Lambda \sim \mathcal W_D(\nu, \Psi)$, i.e. distributed according to a $D \times D$ dimensional Wishart distribution with mean $\nu \Psi$ and degrees of freedom $\nu$. I would like an expression for $E(\log |\Lambda|)$ where $|\Lambda|$ is the…
guy
  • 7,737
  • 1
  • 26
  • 50
14
votes
2 answers

What are the parameters of a Wishart-Wishart posterior?

When infering the precision matrix $\boldsymbol{\Lambda}$ of a normal distribution used to generate $N$ D-dimensional vectors $\mathbf{x_1},..,\mathbf{x_N}$ \begin{align} \mathbf{x_i} &\sim \mathcal{N}(\boldsymbol{\mu, \Lambda^{-1}})…
11
votes
1 answer

Covariance matrix for Gaussian Process and Wishart distribution

I'm reading through this paper on Generalised Wishart Processes (GWP). The paper calculates the covariances between different random variables (following Gaussian Process) using squared exponential covariance function, i.e., $K(x,x') =…
11
votes
1 answer

Hyperprior distributions for the parameters (scale matrix and degrees of freedom) of a wishart prior to an inverse covariance matrix

I'm estimating several inverse covariance matrices of a set of measurements across different subpopulations using an wishart prior in jags/rjags/R. Instead of specifying a scale matrix and degrees of freedom on the inverse covariance matrix prior…
9
votes
1 answer

Entropy of Inverse-Wishart distribution

What is the entropy of the Inverse-Wishart distribution? I need just a reference, but derivation (e.g. using inverse property) would be interesting too.
sbos
  • 191
  • 3
9
votes
1 answer

Generate covariance matrix with fixed values in certain cells

I want to be able to generate a covariance matrix of dimensions $D$ x $D$, such that certain specified cells of this matrix contain a fixed predetermined values (at least approximately). For e.g. For matrix, $S$ = $$ \begin{matrix} a_{11} & a_{12}…
8
votes
0 answers

Sampling distribution of average of some covariance matrices

I have $K$ datasets, each with $N$ variables and $M$ samples (they are in fact EEG time series, but I discard time and treat them as $K$ iid multivariate samples) and assume they are coming from the same multivariate normal distribution. I am…
7
votes
0 answers

Intuitive explanation for Marchenko-Pastur law

I am looking for an intuitive reasoning behind the Marchenko Pastur law, which is described as a law of large numbers analog for random matrices. I know the law gives the probability density function of eigenvalues values of a large Wishart matrix…
7
votes
1 answer

Distribution of Trace of non-centered Wishart matrix

I am looking for the distribution of trace of the non-central Wishart matrix with different variations along different axes. Is there a general formula for such distribution? If not, is there a general formula for the distribution of eigenvalues of…
6
votes
2 answers

Posterior covariance of Normal-Inverse-Wishart not converging properly

I am trying to implement a simple normal-inverse-Wishart conjugate prior distribution for a multivariate normal with unknown mean and covariance in numpy/scipy such that it can take a data vector and construct a posterior. I'm using the update…
Wesley Tansey
  • 367
  • 2
  • 12
6
votes
1 answer

How to specify the Wishart distribution scale matrix

I'm running the below Bayesian mixing model in R using the rjags package, but I am having difficultly in specifying the scale matrix for the Wishart distribution. Essentially, I want Sigma.inv to be a covariance matrix that accounts for instrumental…
Richard
  • 61
  • 1
  • 3
6
votes
1 answer

Downsides of inverse Wishart prior in hierarchical models

I am working with a Bayesian hierarchical model that has a number of parameters for each experimental unit (6 parameters). I really do not know all that much about them a-priori, but it is quite plausible that they could somehow be correlated. Thus,…
5
votes
0 answers

Sum of independent Wishart with same degrees of freedom but different scale matrices

Is there any result showing that a sum of independent Wishart with same degrees of freedom but different scale matrices is a Wishart? For example, if I have two random variables: $$ Y \sim W_p(n,\sigma_1)\ \\ X \sim W_p(n, \sigma_2), $$ where $p$…
5
votes
1 answer

What is the expectation of the Cholesky factor of a Wishart distributed random matrix?

Let a $d-\text{dimensional}$ Wishart random variable with $\nu$ degrees of freedom $\Sigma$ be distributed according to $\mathcal{W}(\Sigma|\Sigma_0, \nu) \propto |\Sigma|^\frac{\nu-d-1}2\exp{(-\frac12\text{tr}\ \Sigma_0^{-1}\Sigma)}$. What is the…
1
2 3 4 5 6 7