23

Assume $X,Y$ are continuous random variables with finite second moments. The population version of Spearman's rank correlation coefficient $ρ_s$ can be defined as the Pearson's product-moment coefficient ρ of the probability integrals transforms $F_X(X)$ and $F_Y(Y)$, where $F_X,F_Y$ are the cdf's of $X$ and $Y$, i.e.,

$ρ_s(X,Y)=ρ(F(X),F(Y))$.

I wonder whether one can generally conclude that

$ρ(X,Y)≠0↔ρ(F(X),F(Y))≠0$?

I.e., do we have linear correlation if and only if we have linear correlation between the ranks?

Update: In the comments two examples are given why

$\rho(F_X(X),F_Y(Y))=0\rightarrow \rho(X,Y) = 0$

is not true in general, even if $X$ and $Y$ have the same distribution. So the question should be reformulated as

$\rho(X,Y) = 0 \rightarrow \rho(F_X(X),F_Y(Y))$?

It is also of great interest to me whether this is true/false if $X$ and $Y$ have the same distribution.

(Note: If $X$ and $Y$ are positively quadrant dependent, i.e., $δ(x,y)=F_{X,Y}(x,y)−F_X(x)F_Y(y)>0$ then Hoeffding's covariance formula $Cov(X,Y)=∫∫δ(x,y)dxdy$ yields that $ρ(X,Y)>0$ and $ρ(F(X),F(Y))>0$.)

amoeba
  • 93,463
  • 28
  • 275
  • 317
FSpanhel
  • 231
  • 1
  • 3
  • 4
    Hint: To obtain an answer, think about what happens to each correlation measure under an arbitrary strictly monotonic transformation. – cardinal Nov 16 '12 at 17:44
  • 1
    @cardinal: well, spearman's rho is invariant under strictly monotonic transformations, the classical linear correlation coefficient will change, but its unclear how (?)...in particular I do not know whether the linear correlation value can change its value form zero to non-zero under strictly monotonic transformations...but maybe I missed your point? – FSpanhel Nov 16 '12 at 18:00
  • You are on the right track! Let $X \sim \mathcal{N}(0,1)$ and $Y = X^2$. Now, look at strictly monotonic transformations of these two. I have not explicitly checked, but $g(z) = \exp(-z/2)$ is likely to work. – cardinal Nov 16 '12 at 18:44
  • @cardinal: Fantastic! Your example shows that $cov(X,Y) = 0, cov(g(X),g(Y)<0$ but $cov(F_X(X),F_Y(Y))=0$, so we can conclude that $cov(F_X(X),F_Y(Y))=0 \rightarrow Cov(X,Y) = 0$ is false. Many thanks! The remaining question then is whether $Cov(X,Y) = 0 \rightarrow Cov(F_X(X),F_Y(Y))=0$. Looking at the definition of these covariance measures I suspect that this also isn't true in general. But once again I cannot think of a counterexample...Any ideas? – FSpanhel Nov 16 '12 at 19:22
  • Again, I have not checked explicitly, but try $U \sim \mathcal{U}(-1,1)$ and $V = |U|$. – cardinal Nov 16 '12 at 19:46
  • I also have not checked this analytically but simulating 1000 times 1000 realizations of (U,V) indicate that $cov(U,V)=cov(F_U(U),F_V(V))=0$. I also recognized that if (X,Y) are connected with a t copula with zero correlation and degrees of freedom >2 and have both exponential margins then $cov(X,Y)\neq 0, cov(F_X(X),F_Y(Y))=0$, so even if the margins are identical then zero Spearman's correlation does not imply zero Pearson's correlation. – FSpanhel Nov 17 '12 at 13:38
  • 2
    You're correct. The second example does not work out as I intended/suspected. However, the general principle on how to construct such a counterexample still holds. And, yes, this matter can be tied in tightly with copulas. :-) – cardinal Nov 17 '12 at 22:11
  • 2
    Once you have confirmed your counterexamples, please consider writing them up in an answer to this post. I will be happy to upvote it. Cheers. – cardinal Nov 17 '12 at 22:13

1 Answers1

9

Neither correlation being zero necessarily tells you much about the other, since they 'weight' the data - especially extreme data - quite differently. I am just going to play with samples, but similar examples could be constructed with bivariate distributions / copulas.

1. Spearman correlation 0 doesn't imply Pearson correlation 0:

As mentioned in the question, there are examples in the comments, but the basic structure is "construct a case where Spearman correlation is 0, then take an extreme point and make it more extreme without changing the Spearman correlation"

The examples in comments cover that very well, but I am just going to play with a more 'random' example here. So consider this data (in R), which by construction has both Spearman and Pearson correlation 0:

x=c(0.660527211673069, 0.853446087136149, -0.00673848667511427, 
-0.730570343152498, 0.0519171047989013, 0.00190761493801791, 
-0.72628058443299, 2.4453231076856, -0.918072410495674, -0.364060229489348, 
-0.520696233492491, 0.659907250608776)
y=c(-0.0214697990371976, 0.255615059485107, 1.10561181413232, 0.572216886959267, 
-0.929089680725018, 0.530329993414123, -0.219422799586819, -0.425186120279194, 
-0.848952532832652, 0.859700836483046, -0.00836246690850083, 
1.43806947831794)

cor(x,y);cor(x,y,method="sp")
[1] 1.523681e-18
[1] 0

Now add 1000 to y[12] and subtract 0.6 from x[9]; the Spearman correlation is unchanged but the Pearson correlation is now 0.1841:

  ya=y
  ya[12]=ya[12]+1000
  xa=x
  xa[9]=xa[9]-.6
  cor(xa,ya);cor(xa,ya,method="sp")
[1] 0.1841168
[1] 0

(If you want strong significance on that Pearson correlation, just replicate the entire sample several times.)

2. Pearson correlation 0 doesn't imply Spearman correlation 0:

Here's two examples with zero Pearson correlation but nonzero Spearman correlation (and again, if you want strong significance on these Spearman correlations, just replicate the entire sample several times).

Example 1:

 x1=c(rep(-3.4566679074320789866,20),-2:5)
 y1=x1*x1
 cor(x1,y1);cor(x1,y1,method="spe")
[1] -8.007297e-17 
[1] -0.3512699   

points on a parabola arranged to give 0 Pearson, but nonzero Spearman correlation

Example 2:

 k=16.881943016134132 
 x2=c(-9:9,-k,k)
 y2=c(-9:9,k,-k)
 cor(x2,y2);cor(x2,y2,method="spe")
[1] -9.154471e-17
[1] 0.4805195

points on a y=x line, except the smallest and largest which lie on y=-x

In this last example, the Spearman correlation can be made stronger by adding more points on y=x while making the two points at the top left and bottom right more extreme to maintain the Pearson correlation at 0.

Glen_b
  • 257,508
  • 32
  • 553
  • 939