Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [determinant]

determinant of a matrix. For purely mathematical questions about determinant, better ask at mathSE

45 questions
50
votes
3 answers

Why does correlation matrix need to be positive semi-definite and what does it mean to be or not to be positive semi-definite?

I have been researching the meaning of positive semi-definite property of correlation or covariance matrices. I am looking for any information on Definition of positive semi-definiteness; Its important properties, practical implications; The…
Melon
  • 509
  • 1
  • 5
  • 4
11
votes
1 answer

Do the Determinants of Covariance and Correlation Matrices and/or Their Inverses Have Useful Interpretations?

While learning to calculate covariance and correlation matrices and their inverses in VB and T-SQL a few years ago, I learned that the various entries have interesting properties that can make them useful in the right data mining scenarios. One…
SQLServerSteve
  • 1,121
  • 1
  • 13
  • 34
11
votes
1 answer

How to generate uniformly random orthogonal matrices of positive determinant?

I've got probably a silly question about which, I must confess, I'm confused. Imagine repeated generating of uniformly distributed random orthogonal (orthonormal) matrix of some size $p$. Sometimes the generated matrix has determinant $1$ and…
ttnphns
  • 51,648
  • 40
  • 253
  • 462
10
votes
2 answers

Fisher information matrix determinant for an overparameterized model

Consider a Bernoulli random variable $X\in\{0,1\}$ with parameter $\theta$ (probability of success). The likelihood function and Fisher information (a $1 \times 1$ matrix) are: $$ \begin{align} \mathcal{L}_1(\theta;X) &= p(\left.X\right|\theta) =…
Tyler Streeter
  • 1,035
  • 9
  • 21
9
votes
3 answers

Why do we use the determinant of the covariance matrix when using the multivariate normal?

I am not well versed in statistics. I wanted to know why we use the determinant of the covariance matrix instead of having the covariance matrix itself when writing down the multivariate normal distribution. Why do we do this and what is the…
Sophie
  • 93
  • 1
  • 1
  • 4
9
votes
1 answer

Why people often optimize the determinant of $(X'\Sigma X)^{-1}$

Say I have a random vector $Y\sim N(X\beta,\Sigma)$ and $\Sigma\neq\sigma^2 I$. That is, the elements of $Y$ (given $X\beta$) are correlated. The natural estimator of $\beta$ is $(X'\Sigma^{-1}X)^{-1}X'\Sigma^{-1}Y$, and…
qoheleth
  • 1,210
  • 1
  • 12
  • 25
7
votes
1 answer

Reason for absolute value of Jacobian determinant in change-of-variable formula?

When we have a random variable $x$ with a probability density $p(x)$, and a function $y = f(x)$ that is differentiable and can be solved for $x = g(y)$, the change of variable formula leads us to a density for $y$ given by $$ p(x) \, dx = p(x)…
Durden
  • 860
  • 10
  • 12
7
votes
1 answer

How is the determinant of $(X'X)$ related to variance?

I'm working on a problem (and actually have the answer) but I don't know why this is the answer, can someone explain this equality?. It has to do with the the determinant of the partitioned matrix $(X'X).$ Let $$X=[x_0, x_1,…
Joel Sinofsky
  • 741
  • 7
  • 18
6
votes
1 answer

What is the meaning of $\sqrt{\mathrm{var}(X)\mathrm{var}(P)-[\mathrm{cov}(X,P)]^2}$?

What is the meaning of the quantity: $$\varepsilon=\sqrt{\mathrm{var}(X)\mathrm{var}(P)-[\mathrm{cov}(X,P)]^2}$$ Is there, for example, a geometric explanation? Is there a term for it in statistics?
apadana
  • 161
  • 3
5
votes
1 answer

Is there a formula for the determinant of the covariance matrix $\mathbf{X_n}^T \mathbf{X_n}$ in the case of multiple regression?

Consider the standard simple linear regression model: $$ Y_i = \beta_0 + \beta_1 X_i + \epsilon_i, $$ for $i=1,\dots,n$. In matrix-vector form this is $$ \mathbf{Y} = \mathbf{X_n}\beta + \epsilon, $$ where, in…
sonicboom
  • 780
  • 1
  • 6
  • 13
5
votes
1 answer

Why does the determinant of the Hessian grow with n?

Context: I'm trying to understand BIC on a deeper level. I'm using BIC for model/structure selection for Bayesian networks. I'm confused because BIC is an approximation to the likelihood of a model, and the likelihood should never decrease when the…
Lizzie Silver
  • 1,009
  • 10
  • 22
4
votes
1 answer

Factor analysis: What to do when determinant is almost zero and when KMO for a variable is low?

I'm conducting a factor analysis on 40 interval-level variables, and have two immediate concerns: The determinant is 6.608E-006, which is much lower than the cut-off of 0.00001. I went back and screened the correlation matrix to find significant,…
Maria
  • 41
  • 1
  • 1
  • 2
4
votes
1 answer

Singular Matrix and Linear Dependency

Singular matrix is defined as a square matrix with determinant of zero. I am aware that linear dependency among columns or rows leads to determinant being equal to zero (e.g. one column is a linear composite of other columns). I am interested…
PsychometStats
  • 2,147
  • 1
  • 11
  • 27
4
votes
1 answer

How to model for independent determinants in several groups based on follow-up time

I want to answer the research question which determinants are associated with long-term survival after a myocardial infarction (MI) in a prospective patient cohort study. More precisely: I want to compare patients who have more than 10 years healthy…
Tami
  • 320
  • 1
  • 9
4
votes
1 answer

Determinant of a block matrix with sparse elements

I have a positive definite symmetric matrix that looks like $$\pmatrix{A & 0 & 0 & E \\ 0 & B & 0 & F \\ 0 & 0 & C & G \\ E^\prime & F^\prime & G^\prime & D}$$ where matrices $A,B,C,D,$ are positive definite symmetric matrices. Is there a nice way…
Wis
  • 2,044
  • 14
  • 31
1
2 3