Proficiency tests to estimate error rates in the forensic sciences

Jonathan J. Koehler*

*Corresponding author for this work

Research output: Contribution to journalComment/debate

20 Citations (Scopus)

Abstract

The reliability and probative value of forensic science evidence is inextricably linked to the rates at which examiners make errors. Jurors and others cannot rationally assess the significance of a reported forensic science match without having some information about the rate at which false positive errors occur. This article calls for the implementation of proficiency tests that are designed and administered for the express purpose of providing factfinders with reasonable first pass estimates of error rates across forensic disciplines and techniques. The composition of the test designers and administrators, the features of tests and reference samples, the composition and selection of test participants, the use of blind test protocols and the coding of test responses are critical elements in this endeavour. A proficiency testing plan that addresses each of these issues is identified.

Original languageEnglish (US)
Pages (from-to)89-98
Number of pages10
JournalLaw, Probability and Risk
Volume12
Issue number1
DOIs
StatePublished - Mar 1 2013

Fingerprint

Forensic Science
Error Rate
science
Estimate
examiner
False Positive
Proficiency
coding
Express
Coding
Testing
evidence

Keywords

  • Base rates
  • Blind testing
  • Error rates
  • Forensic science
  • Proficiency tests

ASJC Scopus subject areas

  • Philosophy
  • Statistics, Probability and Uncertainty
  • Law

Cite this

@article{82a7a7f12a79478a80906a9e8a86d2b5,
title = "Proficiency tests to estimate error rates in the forensic sciences",
abstract = "The reliability and probative value of forensic science evidence is inextricably linked to the rates at which examiners make errors. Jurors and others cannot rationally assess the significance of a reported forensic science match without having some information about the rate at which false positive errors occur. This article calls for the implementation of proficiency tests that are designed and administered for the express purpose of providing factfinders with reasonable first pass estimates of error rates across forensic disciplines and techniques. The composition of the test designers and administrators, the features of tests and reference samples, the composition and selection of test participants, the use of blind test protocols and the coding of test responses are critical elements in this endeavour. A proficiency testing plan that addresses each of these issues is identified.",
keywords = "Base rates, Blind testing, Error rates, Forensic science, Proficiency tests",
author = "Koehler, {Jonathan J.}",
year = "2013",
month = "3",
day = "1",
doi = "10.1093/lpr/mgs013",
language = "English (US)",
volume = "12",
pages = "89--98",
journal = "Law, Probability and Risk",
issn = "1470-8396",
publisher = "Bell & Bain Ltd",
number = "1",

}

Proficiency tests to estimate error rates in the forensic sciences. / Koehler, Jonathan J.

In: Law, Probability and Risk, Vol. 12, No. 1, 01.03.2013, p. 89-98.

Research output: Contribution to journalComment/debate

TY - JOUR

T1 - Proficiency tests to estimate error rates in the forensic sciences

AU - Koehler, Jonathan J.

PY - 2013/3/1

Y1 - 2013/3/1

N2 - The reliability and probative value of forensic science evidence is inextricably linked to the rates at which examiners make errors. Jurors and others cannot rationally assess the significance of a reported forensic science match without having some information about the rate at which false positive errors occur. This article calls for the implementation of proficiency tests that are designed and administered for the express purpose of providing factfinders with reasonable first pass estimates of error rates across forensic disciplines and techniques. The composition of the test designers and administrators, the features of tests and reference samples, the composition and selection of test participants, the use of blind test protocols and the coding of test responses are critical elements in this endeavour. A proficiency testing plan that addresses each of these issues is identified.

AB - The reliability and probative value of forensic science evidence is inextricably linked to the rates at which examiners make errors. Jurors and others cannot rationally assess the significance of a reported forensic science match without having some information about the rate at which false positive errors occur. This article calls for the implementation of proficiency tests that are designed and administered for the express purpose of providing factfinders with reasonable first pass estimates of error rates across forensic disciplines and techniques. The composition of the test designers and administrators, the features of tests and reference samples, the composition and selection of test participants, the use of blind test protocols and the coding of test responses are critical elements in this endeavour. A proficiency testing plan that addresses each of these issues is identified.

KW - Base rates

KW - Blind testing

KW - Error rates

KW - Forensic science

KW - Proficiency tests

UR - http://www.scopus.com/inward/record.url?scp=84875346850&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875346850&partnerID=8YFLogxK

U2 - 10.1093/lpr/mgs013

DO - 10.1093/lpr/mgs013

M3 - Comment/debate

AN - SCOPUS:84875346850

VL - 12

SP - 89

EP - 98

JO - Law, Probability and Risk

JF - Law, Probability and Risk

SN - 1470-8396

IS - 1

ER -