1

The following statement is given in Unsupervised Learning chapter of the book Elements of Statistical Learning.

Since the multivariate Gaussian distribution is determined by its second moments alone, it is the exception, and any Gaussian independent components can be determined only up to a rotation, as before.

I just want to know,

How is multivariate Gaussian distribution is determined by its second moments alone? And

how does any Gaussian independent components can be determined only up to a rotation?

This is not making any sense to me.

ironman
  • 652
  • 7
  • 23
  • 1
    Good question - I am curious to see the answer - see [here](https://www.ucl.ac.uk/mssl/research-degrees/Lectures_and_Seminars/LecturesArchive1516/IgnacioFerreras) for some slides which seem to hint at the answers – Xavier Bourret Sicotte Jun 15 '18 at 12:06
  • 2
    Do they restrict to a *centered* multivariate Gaussian distribution ? The multivariate Gaussian distribution is determined by its mean and its variance-covariance matrix (= the second moments), this is well-known. For the second point, if you rotate a multivariate Gaussian with independent components around its mean, you don't change the distribution. – Stéphane Laurent Jun 15 '18 at 13:05
  • I think they so. But I am not clear from the text. You can go through this section in the book. It is availble for free. – ironman Jun 15 '18 at 13:24
  • The second question was answered for your question about non Gaussianality for ICA https://stats.stackexchange.com/questions/351294/independent-component-analysis two Gaussians have a circular joint distribution, so there is no single rotation solution to optimise. I think the first is only strictly true for mean centred data, although after accounting for the largest source of variance it will the be true of any other smaller sources of variance. I'd need to think about it a bit more to make sure my intuition isn't off whack. – ReneBt Jun 16 '18 at 05:35
  • In many (if not most) texts, the multivariate Gaussian distribution is *defined* in terms of parameters that are obviously coincident with its first two moments (usually by writing its characteristic or moment generating function explicitly). It then is an easy step to show that *independent* and *uncorrelated* are equivalent conditions. The statement about "Gaussian independent components," as I interpret it, is false: it requires you to assume all *covariances* are equal as well. Perhaps some such limitation is implied by the context of this quotation. – whuber Jun 16 '18 at 12:01

0 Answers0