Deception Detection: Using Machine Learning to Analyze 911 Calls

Pers Soc Psychol Bull. 2024 Nov 7:1461672241287064. doi: 10.1177/01461672241287064. Online ahead of print.

Abstract

This study examined the use of machine learning in detecting deception among 210 individuals reporting homicides or missing persons to 911. The sample included an equal number of false allegation callers (FAC) and true report callers (TRC) identified through case adjudication. Independent coders, unaware of callers' deception, analyzed each 911 call using 86 behavioral cues. Using the random forest model with k-fold cross-validation and repeated sampling, the study achieved an accuracy rate of 68.2% for all 911 calls, with sensitivity and specificity at 68.7% and 67.7%, respectively. For homicide reports, accuracy was higher at 71.2%, with a sensitivity of 77.3% but slightly lower specificity at 65.0%. In contrast, accuracy decreased to 61.4% for missing person reports, with a sensitivity of 49.1% and notably higher specificity at 73.6%. Beyond accuracy, key cues distinguishing FACs from TRCs were identified and included cues like "Blames others," "Is self-dramatizing," and "Is uncertain and insecure."

Keywords: 911 calls; deception; machine learning; social behavior; violent crime.