Comparing the Performance of Mathematical Models for Surgical Decisions on Head Injury Patients

Yu-Chuan Li, Ten-Fang Yang, Li Liu, Wen-Ta Chiu

Research output: Contribution to journalArticle

Abstract

Computerized medical decision support systems have been a major research topic in recent years. Intelligent computer programs were implemented to aid physicians and other medical professionals in making difficult medical decisions. This report compares three different mathematical models for building a head injury medical decision support system (MDSS). These models were developed based on a large head-injury patient database. This MDSS accepts a set of patient data such as the types of skull fracture, Glasgow Coma Scale (GCS), episode of convulsion and return the chance that a neurosurgeon would recommend an openskull surgery for this patient. The three mathematical models described in this report including a logistic regression model, a multi-layer perceptron (MLP) neural network and a radial-basisfunction (RBF) neural network. From the 12,640 patients selected from the database. A randomly drawn 9480 cases were used as the training group to develop/train our models. The other 3160 cases were in the validation group, which we used to evaluate the performance of these models. We used sensitivity, specificity, areas under ROC curve and calibration curves as the indicator of how accurate these models are in predicting a neurosurgeon's decision on open-skull surgery. The results showed that, assuming equal importance of sensitivity and specificity, the logistic regression model had a (sensitivity, specificity) of (73%, 68%), compared to (80%, 80%) from the RBF model and (88%, 80%) from the MLP model. The resultant areas under ROC curve for logistic regression, RBF and MLP neural networks are 0.761, 0.880 and 0.897 respectively (P < 0.05). Among these models, the logistic regression has noticeably poorer calibration. This study demonstrated the feasibility of applying neural networks as the mechanism for head-injury decision support systems based on clinical databases. The results also suggest that neural networks may be a better solution for complex, non-linear medical decision support systems than conventional statistical techniques such as logistic regression.
Original languageEnglish
Pages (from-to)870-
JournalJournal of the American Medical Informatics Association : JAMIA
Publication statusPublished - 1997

Fingerprint

Craniocerebral Trauma
Theoretical Models
Logistic Models
Neural Networks (Computer)
Databases
Sensitivity and Specificity
ROC Curve
Calibration
Area Under Curve
Skull Fractures
Glasgow Coma Scale
Feasibility Studies
Skull
Seizures
Software
Physicians
Research

Cite this

Comparing the Performance of Mathematical Models for Surgical Decisions on Head Injury Patients. / Li, Yu-Chuan; Yang, Ten-Fang; Liu, Li; Chiu, Wen-Ta.

In: Journal of the American Medical Informatics Association : JAMIA, 1997, p. 870-.

Research output: Contribution to journalArticle

@article{9cf61e52b2b842ebacc3334f25ab4acc,
title = "Comparing the Performance of Mathematical Models for Surgical Decisions on Head Injury Patients",
abstract = "Computerized medical decision support systems have been a major research topic in recent years. Intelligent computer programs were implemented to aid physicians and other medical professionals in making difficult medical decisions. This report compares three different mathematical models for building a head injury medical decision support system (MDSS). These models were developed based on a large head-injury patient database. This MDSS accepts a set of patient data such as the types of skull fracture, Glasgow Coma Scale (GCS), episode of convulsion and return the chance that a neurosurgeon would recommend an openskull surgery for this patient. The three mathematical models described in this report including a logistic regression model, a multi-layer perceptron (MLP) neural network and a radial-basisfunction (RBF) neural network. From the 12,640 patients selected from the database. A randomly drawn 9480 cases were used as the training group to develop/train our models. The other 3160 cases were in the validation group, which we used to evaluate the performance of these models. We used sensitivity, specificity, areas under ROC curve and calibration curves as the indicator of how accurate these models are in predicting a neurosurgeon's decision on open-skull surgery. The results showed that, assuming equal importance of sensitivity and specificity, the logistic regression model had a (sensitivity, specificity) of (73{\%}, 68{\%}), compared to (80{\%}, 80{\%}) from the RBF model and (88{\%}, 80{\%}) from the MLP model. The resultant areas under ROC curve for logistic regression, RBF and MLP neural networks are 0.761, 0.880 and 0.897 respectively (P < 0.05). Among these models, the logistic regression has noticeably poorer calibration. This study demonstrated the feasibility of applying neural networks as the mechanism for head-injury decision support systems based on clinical databases. The results also suggest that neural networks may be a better solution for complex, non-linear medical decision support systems than conventional statistical techniques such as logistic regression.",
author = "Yu-Chuan Li and Ten-Fang Yang and Li Liu and Wen-Ta Chiu",
year = "1997",
language = "English",
pages = "870--",
journal = "Journal of the American Medical Informatics Association : JAMIA",
issn = "1067-5027",
publisher = "Oxford University Press",

}

TY - JOUR

T1 - Comparing the Performance of Mathematical Models for Surgical Decisions on Head Injury Patients

AU - Li, Yu-Chuan

AU - Yang, Ten-Fang

AU - Liu, Li

AU - Chiu, Wen-Ta

PY - 1997

Y1 - 1997

N2 - Computerized medical decision support systems have been a major research topic in recent years. Intelligent computer programs were implemented to aid physicians and other medical professionals in making difficult medical decisions. This report compares three different mathematical models for building a head injury medical decision support system (MDSS). These models were developed based on a large head-injury patient database. This MDSS accepts a set of patient data such as the types of skull fracture, Glasgow Coma Scale (GCS), episode of convulsion and return the chance that a neurosurgeon would recommend an openskull surgery for this patient. The three mathematical models described in this report including a logistic regression model, a multi-layer perceptron (MLP) neural network and a radial-basisfunction (RBF) neural network. From the 12,640 patients selected from the database. A randomly drawn 9480 cases were used as the training group to develop/train our models. The other 3160 cases were in the validation group, which we used to evaluate the performance of these models. We used sensitivity, specificity, areas under ROC curve and calibration curves as the indicator of how accurate these models are in predicting a neurosurgeon's decision on open-skull surgery. The results showed that, assuming equal importance of sensitivity and specificity, the logistic regression model had a (sensitivity, specificity) of (73%, 68%), compared to (80%, 80%) from the RBF model and (88%, 80%) from the MLP model. The resultant areas under ROC curve for logistic regression, RBF and MLP neural networks are 0.761, 0.880 and 0.897 respectively (P < 0.05). Among these models, the logistic regression has noticeably poorer calibration. This study demonstrated the feasibility of applying neural networks as the mechanism for head-injury decision support systems based on clinical databases. The results also suggest that neural networks may be a better solution for complex, non-linear medical decision support systems than conventional statistical techniques such as logistic regression.

AB - Computerized medical decision support systems have been a major research topic in recent years. Intelligent computer programs were implemented to aid physicians and other medical professionals in making difficult medical decisions. This report compares three different mathematical models for building a head injury medical decision support system (MDSS). These models were developed based on a large head-injury patient database. This MDSS accepts a set of patient data such as the types of skull fracture, Glasgow Coma Scale (GCS), episode of convulsion and return the chance that a neurosurgeon would recommend an openskull surgery for this patient. The three mathematical models described in this report including a logistic regression model, a multi-layer perceptron (MLP) neural network and a radial-basisfunction (RBF) neural network. From the 12,640 patients selected from the database. A randomly drawn 9480 cases were used as the training group to develop/train our models. The other 3160 cases were in the validation group, which we used to evaluate the performance of these models. We used sensitivity, specificity, areas under ROC curve and calibration curves as the indicator of how accurate these models are in predicting a neurosurgeon's decision on open-skull surgery. The results showed that, assuming equal importance of sensitivity and specificity, the logistic regression model had a (sensitivity, specificity) of (73%, 68%), compared to (80%, 80%) from the RBF model and (88%, 80%) from the MLP model. The resultant areas under ROC curve for logistic regression, RBF and MLP neural networks are 0.761, 0.880 and 0.897 respectively (P < 0.05). Among these models, the logistic regression has noticeably poorer calibration. This study demonstrated the feasibility of applying neural networks as the mechanism for head-injury decision support systems based on clinical databases. The results also suggest that neural networks may be a better solution for complex, non-linear medical decision support systems than conventional statistical techniques such as logistic regression.

UR - https://www.researchgate.net/profile/Yu-Chuan_Li/publication/25901275_Comparing_the_Performance_of_Mathematical_Models_for_Surgical_Decisions_on_Head_Injury_Patients/links/0912f50cfddda71e60000000.pdf

UR - http://libir.tmu.edu.tw/bitstream/987654321/9702/1/%E6%91%98%E8%A6%81.pdf

M3 - Article

SP - 870-

JO - Journal of the American Medical Informatics Association : JAMIA

JF - Journal of the American Medical Informatics Association : JAMIA

SN - 1067-5027

ER -