Make patient consultation warmer: A clinical application for speech emotion recognition

Huan Chung Li, Telung Pan, Man Hua Lee, Hung Wen Chiu

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)


In recent years, many types of research have continued to improve the environment of human speech and emotion recognition. As facial emotion recognition has gradually matured through speech recognition, the result of this study provided more accurate recognition of complex human emotional performance, and speech emotion identification will be derived from human subjective interpretation into the use of computers to automatically interpret the speaker’s emotional expression. Focused on use in medical care, which can be used to understand the current feelings of physicians and patients during a visit, and improve the medical treatment through the relationship between illness and interaction. By transforming the voice data into a single observation segment per second, the first to the thirteenth dimensions of the frequency cestrum coefficients are used as speech emotion recognition eigenvalue vectors. Vectors for the eigenvalue vectors are maximum, minimum, average, median, and standard deviation, and there are 65 eigenvalues in total for the construction of an artificial neural network. The sentiment recognition system developed by the hospital is used as a comparison between the sentiment recognition results of the artificial neural network classification, and then use the foregoing results for a comprehensive analysis to understand the interaction between the doctor and the patient. Using this experimental module, the emotion recognition rate is 93.34%, and the accuracy rate of facial emotion recognition results can be 86.3%.

Original languageEnglish
Article number4782
JournalApplied Sciences (Switzerland)
Issue number11
Publication statusPublished - Jun 1 2021


  • Doctor-patient communication
  • Mel Frequency Cepstrum Coefficients
  • Speech emotion recognition

ASJC Scopus subject areas

  • Materials Science(all)
  • Instrumentation
  • Engineering(all)
  • Process Chemistry and Technology
  • Computer Science Applications
  • Fluid Flow and Transfer Processes


Dive into the research topics of 'Make patient consultation warmer: A clinical application for speech emotion recognition'. Together they form a unique fingerprint.

Cite this