Daily stress detection from real-life speeches using acoustic and semantic information

Ergonomics. 2024 Nov 25:1-24. doi: 10.1080/00140139.2024.2430370. Online ahead of print.

Abstract

Detecting daily stress is of vital importance for workplace safety and health, and natural speech is recommended as one of the main methods of mental stress detection. This study developed machine-learning models for daily stress detection from real-life speeches by fusing its acoustic and semantic signals. First, we collected real-life speech data from life-stress-catharsis room of online chat platform and established a speech database with real daily stress. Second, we obtained the model performances of common machine-learning classifiers for stress detection and compared them with human performance. The stress-detection classifiers achieved a promising performance of 74.25% accuracy and 83.73% F1-score using only acoustic signal. By fusing with the semantic signal, the stress detection model performance was significantly improved and achieved a performance of 81.20% accuracy and 87.46% F1-score, which validated the importance of semantic information in daily stress detection. Meanwhile, the best performance of the machine learning model was close to the human recognition capability. The results of this study validated the feasibility of detecting daily stress based on real speech. The models developed in this study could be used for daily stress detection in real life and can provide information for stress interventions to ease the negative effects on health.

Keywords: Acoustic signal; daily stress; real-life speech; semantic signal.

Plain language summary

This study developed machine-learning models for daily stress detection from real-life speeches by fusing its acoustic and semantic signals. The results validated the feasibility of detecting daily stress based on real speech, and the importance of semantic information in daily stress detection. The model developed in this study could be used for daily stress detection in real life.