A signal detection theory analysis of racial and ethnic disproportionality in the referral and substantiation processes of the U.S. child welfare services system
Journal Title: Judgment and Decision Making - Year 2014, Vol 9, Issue 2
Abstract
Signal detection theory (SDT) was developed to analyze the behavior of a single judge but also can be used to analyze decisions made by organizations or other social systems. SDT quantifies the ability to distinguish between signal and noise by separating accuracy of the detection system from response bias—the propensity to over-warn (too many false positives) or under-warn (too many misses). We apply SDT techniques to national and state-level data sets to analyze the ability of the child welfare services systems to detect instances of child maltreatment. Blacks have higher rates of referral and the system is less accurate for them than for Whites or Hispanics. The incidence of false positives—referrals leading to unsubstantiated findings—is higher for Blacks than for other groups, as is the incidence of false negatives—children for whom no referral was made but who are in fact neglected or abused. The rate of true positives–children for whom a referral was made and for whom the allegation was substantiated–is higher for Blacks. Values of d′ (signal strength) are roughly the same for Whites, Blacks, and Hispanics but there are pronounced group differences in C (a measure of the location of the decision threshold). Analyses show that the child welfare services system treats Blacks differently from Hispanics and Whites in ways that cannot be justified readily in terms of objective measures of group differences. This study illustrates the potential for JDM techniques such as SDT to contribute to understanding of system-level decision making processes.
Authors and Affiliations
Jeryl L. Mumpower and Gary H. McClelland
Keywords
Related Articles
- EP ID EP678115
- DOI -
- Views 140
- Downloads 0
The impact of excess choice on deferment of decisions to volunteer
Excess choice has previously been shown to have detrimental effects on decisions about consumer products. As the number of options increases, people are more likely to put off making an active choice (i.e., defer) and sh...
The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken...
People respond to GM food with disgust more than fear: Comment on Royzman, Cusimano and Leeman (2017)
Scott, Inbar and Rozin (2016) reported an association between greater disgust sensitivity (DS) and more negative attitudes towards genetically modified (GM) food. Royzman, Cusimano and Leeman (2017) replicated this assoc...
Aggregating multiple probability intervals to improve calibration
We apply the principles of the “Wisdom of Crowds (WoC)” to improve the calibration of interval estimates. Previous research has documented the significant impact of the WoC on the accuracy of point estimates but only a f...
Choice blindness in financial decision making
Choice Blindness is an experimental paradigm that examines the interplay between individuals’ preferences, decisions, and expectations by manipulating the relationship between intention and choice. This paper expands upo...