The long awaited/dreaded return of the “Dad Joke Intro”! In this episode, Todd Weller (firearms expert) returns to the show to talk to Eric and Glenn about the article on inconclusive decisions by Itiel Dror and Nicholas Scurich [(Mis)use of scientific measurements in forensic science; Forensic Science International, 2020; 2:333-338]. Todd gives his views on how the article mischaracterizes the error rate computations and designs of various firearms studies. The guys try to relate it back to their view on the article and fingerprint studies.
More episodes from "Double Loop Podcast"
Episode 241 - Blind Proficiency Testing Paper
55:13Eric Ray and Glenn Langenburg discuss the recent paper on Blind Proficiency Testing from the Houston Forensic Science Center: "Latent print quality in blind proficiency testing: Using quality metrics to examine laboratory performance" by Brett O. Gardner, Maddisen Neuman, and Sharon Kelley. The paper describes the results of over two years of blind proficiency testing in the latent print unit. No false positive errors were detected over all samples when the examiners were not aware that they were being tested. The paper also describes the use of LQMetric in measuring the Quality of the sample latent prints. A fantastic paper and a great model for other agencies to imitate.
Episode 240 - Todd Weller returns to discuss inconclusives
1:08:49The long awaited/dreaded return of the “Dad Joke Intro”! In this episode, Todd Weller (firearms expert) returns to the show to talk to Eric and Glenn about the article on inconclusive decisions by Itiel Dror and Nicholas Scurich [(Mis)use of scientific measurements in forensic science; Forensic Science International, 2020; 2:333-338]. Todd gives his views on how the article mischaracterizes the error rate computations and designs of various firearms studies. The guys try to relate it back to their view on the article and fingerprint studies.
Episode 239 - 2021 IAI Conference
36:48Return with Glenn and Eric to the IAI Conference in Nashville, TN. The guys are joined by Josh Connelly, Kurt Aebersold, JP Rodriguez, and Claudine Carter Pereira. New accuracy studies, open field research, and stat talk. And we're already looking forward to next year's conference in Nebraska!
Episode 238 - Dror and Scurich Article
1:16:10Glenn Langenburg and Eric Ray review the 2020 article from Itiel Dror and Nicholas Scurich. "(Mis)use of scientific measurements in forensic science" was published in Forensic Science International: Synergy. The article criticizes published accuracy studies in the latent print and firearms disciplines and suggests an alternative method for handling inconclusive decisions and calculating an error rate for the field. The episode details factual errors in almost every part of the article and suggests the real motivation behind these arguments. But first Eric and Glenn read some emails and catch up on our return to conferences.
Episode 237 - Testifying After an Error
1:13:25Glenn Langenburg and Eric Ray discuss how to testify in court after an error occurs. Examiners nervous about upcoming testimony can find tips whether you made the error or a co-worker made an error and whether it was an erroneous identification or an erroneous exclusion. The court and juries do not expect us to be perfect, and we should claim to be. It's important to be able to discuss the Quality Assurance protocols that our labs have in place. Watch Eric and Glenn compare fingerprints here - https://youtu.be/C5KmM6cAKpk And join us for Wed Happy Hour here - https://discord.gg/b39pp6j
Episode 236 - Mindset Paper (Eldridge & Champod, Part Deux!)
1:06:25In this episode, the guys return for Round 2 with Dr. Heidi Eldridge and Prof. Christophe Champod. This time, they discuss the second paper arising from the palm print black box study (discussed in DLP Episode #234). The focus in this episode is “Mind-set – How bias leads to errors in friction ridge comparisons” by Eldridge, de Donno, and Champod in Forensic Science Int’l 318 (2021). This paper explores how instances of false positives and false negatives may have resulted from cognitive biases and assumptions formed about the latent print during the examination. The authors discuss some of the differences between mindset in false positives versus false negatives. They end the interview with suggestions for breaking mindset and reducing errors. Link to paper: http://dx.doi.org/10.1016/j.forsciint.2020.110545
Episode 235 - Todd Weller Interview
1:37:53Glenn Langenburg and Eric Ray are joined by Todd Weller to discuss the firearms/toolmarks discipline. Todd was involved in the NY firearms case from Episode 227 and shares his experiences there. The guys then talk through accuracy studies for firearms examiners and similarities and differences between firearms and fingerprints. Lots to cover in an extra-long episode.
Episode 234 - Palm Print Black Box Study
1:28:49In this episode, Eric and Glenn are joined by Dr. Heidi Eldridge and Prof, Christophe Champod, the authors of "Testing the accuracy and reliability of palmar friction ridge comparisons - A black box study". The guests describe the design, the aims, and the results of the study. We get into discussions about the meaning and usefulness of error rate statistics and confidence intervals from performance studies such as this. Link to the Article (open source): http://dx.doi.org/10.1016/j.forsciint.2020.110457 Link to study results in shinyapp: https://cchampod.shinyapps.io/Results_BBStudy/ Link to confidence interval tools in shinyapp: https://cchampod.shinyapps.io/app_CI/ Link to error rate primer prepared by Champod, Eldridge, Lambert: zenodo.org/record/3734560#.YB8Ki5NKhbt
Episode 233 - GYRO Accuracy Paper
1:09:21Glenn Langenburg and Eric Ray finally get back on track with a review of a recent article on GYRO markings. "Evaluating the Accuracy and Weight of Confidence in Examiner Minutiae Annotations" was written by Jeremy John and Henry Swofford and published in the JFI. The study measured whether examiners placed minutiae markers on true minutiae using Green, Yellow, and Red markers. It then compared the color choices of examiners against the color choices of the automatic LQMetric and DFIQI algorithms. Eric and Glenn will soon be publishing videos of themselves conducting comparisons, using GYRO, and discussing their similarities and differences. Keep an eye out for those coming soon. Also, the 8pm (ET) Wednesday night virtual Happy Hour continues at https://discord.gg/b39pp6j
Episode 232 - Differing Conclusions Article
1:29:10Glenn Langenburg and Eric Ray review the newest article from Austin Hicklin, Bradford Ulery, Madeline Ausdemore, and JoAnn Buscaglia. Why do latent fingerprint examiners differ in their conclusions? reviews data from the Black Box, White Box, and Eye Tracking papers, summarizes trends through all of that research, and recommends changes for the fingerprint field.