2

I am studying lexical semantics. I have 65 pairs of synonyms with their sense relatedness. The dataset is derived from the paper:

Rubenstein, Herbert, and John B. Goodenough. "Contextual correlates of synonymy." Communications of the ACM 8.10 (1965): 627-633.

I extract sentences containing those synonyms, transfer the neighbouring words appearing in those sentences to vectors, calculate the cosine distance between different vectors, and finally get the Pearson correlation between the sense relatedness given by Rubenstein and Goodenough and our distances.

I get the Pearson correlation for Method 1 is 0.79, and for Method 2 is 0.78, for example. How do I measure if Method 1 is significantly better than Method 2 or not?

Meng Zhang
  • 111
  • 6

1 Answers1

0

You can try the R package of cocor, which provides statistical tests between correlation coeffients. It seems that cocor.dep.groups.overlap() function works for you.

Leo Yu
  • 1
  • 1