Abstract
It has been known for over 40 years that there are two fundamentally different kinds of detection tasks in the theory of signal detectability. The Type 1 task is to distinguish between events defined independently of the observer; the Type 2 task is to distinguish between one’s own correct and incorrect decisions about those Type 1 events. For the Type 1 task, the behavior of the detector can be summarized by the traditional receiver operating characteristic (ROC) curve. This curve can be compared with a theoretical ROC curve, which can be generated from overlapping probability functions conditional on the Type 1 events on an appropriate decision axis. We show how to derive the probability functions underlying Type 2 decisions from those for the Type 1 task. ROC curves and the usual measures of performance are readily obtained from those Type 2 functions, and some relationships among various Type 1 and Type 2 performance measures are presented. We discuss the relationshiPbetween Type 1 and Type 2 confidence ratings and caution against the practice of presenting transformed Type 2 ratings as empirical Type 1 ratings.
Article PDF
Similar content being viewed by others
References
Banks, W. P. (1970). Signal detection theory and human memory.Psychological Bulletin,74, 81–99.
Baranski, J. V., &Petrusic, W. M. (1998). Probing the locus of confidence judgements: Experiments on the time to determine confidence.Journal of Experimental Psychology: Human Perception & Performance,24, 929–945.
Birdsall, T. G. (1955). The theory of signal detectability. In H. Quastler (Ed.),Information theory in psychology (pp. 391–402). Glencoe, IL: Free Press.
Busey, T. A., Tunnicliff, J., Loftus, G. R., &Loftus, E. F. (2000). rAccounts of the confidence-accuracy relation in recognition memory.Psychonomic Bulletin & Review,7, 26–48.
Clarke, F. R., Birdsall, T. G., &Tanner, W. P., Jr. (1959). Two types of ROC curves and definitions of parameters.Journal of the Acoustical Society of America,31, 629–630.
Critchfield, T. S. (1993). Signal-detection properties of verbal selfreports.Journal of the Experimental Analysis of Behavior,60, 495–514.
Egan, J. P. (1975).Signal detection theory and ROC analysis. New York: Academic Press.
Egan, J. P., &Clarke, F. R. (1956). Source and receiver behavior in the use of a criterion.Journal of the Acoustical Society of America,28, 1267–1269.
Egan, J. P., Clarke, F. R., &Carterette, E. C. (1956). On the transmission and confirmation of messages in noise.Journal of the Acoustical Society of America,28, 536–550.
Ferrell, W. R., &McGoey, P. J. (1980). A model of calibration for subjective probabilities.Organizational Behavior & Human Performance,26, 32–53.
Galvin, S. J. (1988).The theory of Type II ROC analysis. Unpublished master’s thesis, Victoria University, Wellington, New Zealand.
Galvin, S. J., Beuke, C. J., Keogh, D., &Robinson, T. (2000). Can utrocular discrimination be subliminal?Investigative Ophthalmology & Visual Science,41(Suppl.), S732.
Gigerenzer, G., Hoffrage, U., &Kleinbš lting, H. (1991). Probabilistic mental models: A Brunswikian theory of confidence.Psychological Review,98, 506–528.
Green, D. M., &Swets, J. A. (1966).Signal detection theory and psychophysics. New York: Wiley.
Healy, A. F., &Jones, C. (1973). Criterion shifts in recall.Psychological Bulletin,79, 335–340.
Higham, P. A. (2002). Strong cues are not necessarily weak: Thomson and Tulving (1970) and the encoding specificity principle revisited.Memory & Cognition,30, 67–80.
Hosseini, J., &Ferrell, W. R. (1982). Detectability of correctness: A measure of knowing that one knows.Instructional Science,11, 113–127.
Keren, G. (1988). On the ability of monitoring non-veridical perceptions and uncertain knowledge: Some calibration studies.Acta Psychologica,67, 95–119.
Keren, G. (1991). Calibration and probability judgements: Conceptual and methodological issues.Acta Psychologica,77, 217–273.
Kolb, F. C., &Braun, J. (1995). Blindsight in normal observers.Nature,377, 336–338.
Kunimoto, C., Miller, J., &Pashler, H. (2001). Confidence and accuracy of near-threshold discrimination responses.Consciousness & Cognition,10, 294–340.
Lichtenstein, S., Fischhoff, B., &Phillips, L. D. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.),Judgement under uncertainty: Heuristics and biases (pp. 306–334). Cambridge: Cambridge University Press.
Link, S. W. (1992).The wave theory of difference and similarity. Hillsdale, NJ: Erlbaum.
Luce, R. D. (1997). Some unresolved conceptual problems in mathematical psychology.Journal of Mathematical Psychology,41, 79–87.
Macmillan, N. A., &Creelman, C. D. (1991).Detection theory: A user9s guide. Cambridge: Cambridge University Press.
McFadden, D., & Greeno, J. G. (1966). Verbal learning: A some-or-none process (Tech. Report).Indiana University Hearing and Communication Laboratory..
Merikle, P. M., Smilek, D., &Eastwood, J. D. (2001). Perception without awareness: Perspectives from cognitive psychology.Cognition,79, 115–134.
Mood, A. M., Graybill, F. A., &Boes, D. C. (1974).Introduction to the theory of statistics (3rd ed., International Student Edition). Singapore: McGraw-Hill.
Murdock, B. B., Jr. (1966). The criterion problem in short term memory.Journal of Experimental Psychology,72, 317–324.
Murdock, B. B., Jr. (1974).Human memory: Theory and data. Potomac, MD: Erlbaum.
Norman, D. A., &Wickelgren, W. (1969). Strength theory of decision rules and latency in retrieval from short-term memory.Journal of Mathematical Psychology,6, 192–208.
Peirce, C. S., &Jastrow, J. (1884). On small differences in sensation.Memoirs of the National Academy of Sciences,3, 73–83.
Podd, J. V. (1975).Type I and Type II ROC analysis of change in human decision axis. Unpublished master’s thesis, Victoria University, Wellington, New Zealand.
Pollack, I. (1959). On indices of signal and response discriminability.Journal of the Acoustical Society of America,31, 1031.
Pollack, I., &Decker, L. R. (1958). Confidence ratings, message reception, and the receiver operating characteristic.Journal of the Acoustical Society of America,30, 286–292.
Reber, A. S., Kassin, S. M., Lewis, S., &Cantor, G. W. (1980). On the relationshiPbetween implicit and explicit modes in the learning of a complex rule structure.Journal of Experimental Psychology: Human Learning & Memory,6, 492–502.
Swets, J. A. (1973). The relative operating characteristic in psychology.Science,182, 990–1000.
Swets, J. A., Tanner, W. P., Jr., &Birdsall, T. G. (1961). Decision processes in perception.Psychological Review,68, 301–340.
Taylor, A., Boven, R., &Whitmore, J. (1991). Reduction of unique noise in the psychophysics of hearing by grouPoperating characteristic analysis.Psychological Bulletin,109, 133–146.
Van Zandt, T. (2000). ROC curves and confidence judgements in recognition memory.Journal of Experimental Psychology: Learning, Memory & Cognition,26, 582–600.
Vickers, D. (1979).Decision processes in visual perception. New York: Academic Press.
Weiskrantz, L. (1986).Blindsight: A case study and its implications. Oxford: Oxford University Press.
Weiskrantz, L. (1998). Consciousness and commentaries.International Journal of Psychology,33, 227–233.
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is based in part on the masters dissertations of J.V.P. (1975) and S.J.G. (1988). The derivation of the general equations for Type 2 probability functions was presented at the 1987 meeting of the New Zealand Psychological Society, Dunedin, New Zealand.
Note—This article was accepted by the previous editorial team, while John T. Wixted was editor.
Rights and permissions
About this article
Cite this article
Galvin, S.J., Podd, J.V., Drga, V. et al. Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions. Psychonomic Bulletin & Review 10, 843–876 (2003). https://doi.org/10.3758/BF03196546
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03196546