Questions tagged [d-prime]

d' (also called sensitivity index) is a measure used in signal detection theory to quantify how well a signal can be distinguished from noise.

$d'$ (also called sensitivity index) is a measure used in signal detection theory to quantify how well a signal can be distinguished from noise.

Given that a signal may be present or not, and the receiver may assert that the signal is present or not, there are four possibilities:

                                         Signal:
                                  Present     Not present
            Receiver:          ---------------------------
                              |             |             |
                'Present'     |     Hit     | False alarm |
                              |             |             |
                               ---------------------------
                              |             |             |
                'Not present' |    Miss     |   Correct   |
                              |             |  rejection  |
                               ---------------------------

The number of Hits divided by (Hits + Misses) is the hit rate ($h$), and the number of False alarms divided by (False alarms + Correct rejections) is the false alarm rate ($fa$). These can be decomposed into the sensitivity ($d'$) of the receiver:
$$ d' = \Phi^{-1}(h) - \Phi^{-1}(fa) $$ To completely specify a receiver's behavior, sensitivity is usually paired with bias ($c$):
$$ c = \frac{\Phi^{-1}(h) + \Phi^{-1}(fa)}{2} $$

Although the conceptual background is slightly different, it is interesting to note that sensitivity / $d'$ here is computed the same as the sensitivity that is used to assess classification performance.

15 questions
13
votes
1 answer

Connections between $d^\prime$ (d-prime) and AUC (Area Under the ROC Curve); underlying assumptions

In machine learning we may use the area under the ROC curve (often abbreviated AUC, or AUROC) to summarise how well a system can discriminate between two categories. In signal detection theory often the $d'$ (sensitivity index) is used for a similar…
Dan Stowell
  • 1,262
  • 1
  • 12
  • 22
11
votes
2 answers

d prime with 100% hit rate probability and 0% false alarm probability

I would like to calculate d prime for a memory task that involves detecting old and new items. The problem I have is that some of the subjects have hit rate of 1 and/or false alarm rate of 0, which makes the probabilities 100% and 0%, respectively. …
A.Rainer
  • 217
  • 1
  • 2
  • 8
6
votes
1 answer

Why use d-prime instead of percent correct?

In signal detection theory, people often use $d'$ to assess performance. Apart from the fact that $d'$ is in $z$ units (units of measurement transformed to standard deviation units, i.e., $z$ scores), making it comparable regardless of the original…
user41270
  • 215
  • 1
  • 3
  • 8
6
votes
1 answer

Are Cohen's d (effect size) and d prime from the signal detection theory measuring the same thing?

Are d prime (d') in signal detection theory and Cohen's d (mainly reported in the context of the general linear model) measures for the same thing (i.e., the difference of the means in SD-units), and just termed differently? Or is there any…
2
votes
2 answers

How do I calculate d' from experimental data?

In Signal Detection Theory, d' is defined by the z-scores of Hits and False Alarms: d' = z(Hits) - z(False Alarms). Say the task is to detect if a certain object is present in a series of pictures, and for one particular subject we have a hit rate…
user24544
2
votes
0 answers

A' (A prime) for extreme Hit rates and False Alarms

I am trying to compute the non parametric measure of sensitivity A' according to the following formula reported by Stanislav & Todorov (1999): $$ A'= .5+sign(H-F)*((H-F)^2+abs(H-F))/(4*max(H,F)-4*H*F) $$ where H is Hit Rate and F is False Alarm…
1
vote
0 answers

Can Splithalf Reliability Be Caclulated for an Aggregate Measure?

I have been asked by a journal editor to provide the splithalf reliability for an aggregate dependent variable, d', which is a Signal Detection parameter that captures perceptual sensitivity. However, d' cannot be calculated on a trial-by-trial…
1
vote
0 answers

ROC curve, d' A' - assumption-free?

In my research I want to know how reliably certain feature of a sentence indicates the class that sentence belongs to. So, according to that feature (=how many elements X they contain), the sentences have been classified in three groups…
1
vote
0 answers

d prime correction to use with a low number of trials

I am doing a psycholinguistic experiment, where I want to calculate d’ for each participant’s test scores. In the test, participants listen to 4 familiar words and 8 novel distractor words, and have to decide for each stimulus whether they have…
Theresa
  • 11
  • 2
1
vote
0 answers

Negative D-prime values; use absolute values?

I have calculated D-prime measurements for for a memory performance task. Subjects viewed images that were either old or new and had to indicate their response via a button press. Thus, their response was either correct or wrong. From the subjects…
Inkling
  • 265
  • 3
  • 15
0
votes
0 answers

Calculating d prime (d') using the Log-linear method (Hautus, 1995) in R

I have data from a memory test. I created a table with the absolute number of hits, misses, false alarms, and correct rejections. Each participant had 10 targets and 10 non-targets at each test (there are three tests). Now, I have observations with…
Lili
  • 77
  • 6
0
votes
0 answers

If I need to report false alarms instead of correct rejections, would it be ok if I use the results from the model but swap the signs?

I ran an experiment in which people are presented with a list of target items, and then get tested on their memory for those items. For the test, they are presented with the target items, but also with an identical number of non-target items. Their…
0
votes
0 answers

Exclusion of participants based on sensitivity and criterion (SDT)

When I check the histogram of the participants' bias (measured by c), the distribution is right-skewed (i.e., more values are less than zero as expected). This indicates that the participants were more inclined to say "Yes". I was wondering whether…
0
votes
1 answer

Understanding and implementing the dprime measure in Python

According to Wikipedia, the dprime score (aka 'sensitivity index') can be expressed as $$ d' = Z(\text{hit rate}) - Z(\text{false alarm rate})$$ hit rate (aka recall aka sensitivity) and false alarm rate (equal to 1-specificity). These quantities…
andandandand
  • 133
  • 6
0
votes
1 answer

Is there an accepted way to interpret d' (d-prime) for evidence of detection

I have run a learning experiment, with a yes-no familiarity test at the end, and computed d' across various conditions. Is there some rule of thumb (perhaps dependent on sample size) as to how d' measures can be interpreted? Is there some level at…