Development of a computerized adaptive test for assessing balance function in patients with stroke

I. Ping Hsueh, Jyun Hong Chen, Chun Hou Wang, Cheng Te Chen, Ching Fan Sheu, Wen Chung Wang, Wen Hsuan Hou, Ching Lin Hsieh

研究成果: 雜誌貢獻文章

32 引文 (Scopus)

摘要

Background. An efficient and precise measure of balance is needed to improve administration efficiency and to reduce the assessment burden for patients. Objective. The purpose of this study was to develop a computerized adaptive testing (CAT) system for assessing balance function in an efficient, reliable, and valid fashion in patients with stroke. Design. Two cross-sectional prospective studies were conducted. Setting. This study was conducted in the departments of physical medicine and rehabilitation in 6 hospitals. Patients. The participants were inpatients and outpatients who were receiving rehabilitation. Measurements. A balance item pool (41 items) was developed on the basis of predefined balance concepts, expert opinions, and field testing. The items were administered by 5 raters to 764 patients. An item response theory model was fit to the data, and the item parameters were estimated. A simulation study was used to determine the performance (eg, reliability, efficiency) of the Balance CAT. The Balance CAT and the Berg Balance Scale (BBS) then were tested on another independent sample of 56 patients to determine the concurrent validity and time needed for administration. Results. Seven items did not meet the model's expectations and were excluded from further analysis. The remaining 34 items formed the item bank of the Balance CAT. Two stopping rules (ie, reliability coefficient >0.9 or ≤6 items) were set for the CAT. The simulation study showed that the patients' balance scores estimated by the CAT had an average reliability value of .94. The scores obtained from the CAT were closely associated with those of the full item set (Pearson r=.98). The scores of the Balance CAT were highly correlated with those of the BBS (Pearson r=.88). The average time needed to administer the Balance CAT (83 seconds) was only 18% of that of the BBS. Limitations. The convenience sampling of both samples may limit the generalization of the results. Further psychometric investigation of the Balance CAT is needed. Conclusion, The results provide strong evidence that the Balance CAT is efficient and has reliability and validity for patients with stroke.

原文英語
頁(從 - 到)1336-1344
頁數9
期刊Physical Therapy
90
發行號9
DOIs
出版狀態已發佈 - 九月 2010
對外發佈Yes

指紋

Stroke
Physical and Rehabilitation Medicine
Expert Testimony
Psychometrics
Reproducibility of Results
Inpatients
Outpatients
Rehabilitation
Cross-Sectional Studies
Prospective Studies

ASJC Scopus subject areas

  • Physical Therapy, Sports Therapy and Rehabilitation

引用此文

Hsueh, I. P., Chen, J. H., Wang, C. H., Chen, C. T., Sheu, C. F., Wang, W. C., ... Hsieh, C. L. (2010). Development of a computerized adaptive test for assessing balance function in patients with stroke. Physical Therapy, 90(9), 1336-1344. https://doi.org/10.2522/ptj.20090395

Development of a computerized adaptive test for assessing balance function in patients with stroke. / Hsueh, I. Ping; Chen, Jyun Hong; Wang, Chun Hou; Chen, Cheng Te; Sheu, Ching Fan; Wang, Wen Chung; Hou, Wen Hsuan; Hsieh, Ching Lin.

於: Physical Therapy, 卷 90, 編號 9, 09.2010, p. 1336-1344.

研究成果: 雜誌貢獻文章

Hsueh, IP, Chen, JH, Wang, CH, Chen, CT, Sheu, CF, Wang, WC, Hou, WH & Hsieh, CL 2010, 'Development of a computerized adaptive test for assessing balance function in patients with stroke', Physical Therapy, 卷 90, 編號 9, 頁 1336-1344. https://doi.org/10.2522/ptj.20090395
Hsueh, I. Ping ; Chen, Jyun Hong ; Wang, Chun Hou ; Chen, Cheng Te ; Sheu, Ching Fan ; Wang, Wen Chung ; Hou, Wen Hsuan ; Hsieh, Ching Lin. / Development of a computerized adaptive test for assessing balance function in patients with stroke. 於: Physical Therapy. 2010 ; 卷 90, 編號 9. 頁 1336-1344.
@article{d0e1387059be4405829d8ef361a697e6,
title = "Development of a computerized adaptive test for assessing balance function in patients with stroke",
abstract = "Background. An efficient and precise measure of balance is needed to improve administration efficiency and to reduce the assessment burden for patients. Objective. The purpose of this study was to develop a computerized adaptive testing (CAT) system for assessing balance function in an efficient, reliable, and valid fashion in patients with stroke. Design. Two cross-sectional prospective studies were conducted. Setting. This study was conducted in the departments of physical medicine and rehabilitation in 6 hospitals. Patients. The participants were inpatients and outpatients who were receiving rehabilitation. Measurements. A balance item pool (41 items) was developed on the basis of predefined balance concepts, expert opinions, and field testing. The items were administered by 5 raters to 764 patients. An item response theory model was fit to the data, and the item parameters were estimated. A simulation study was used to determine the performance (eg, reliability, efficiency) of the Balance CAT. The Balance CAT and the Berg Balance Scale (BBS) then were tested on another independent sample of 56 patients to determine the concurrent validity and time needed for administration. Results. Seven items did not meet the model's expectations and were excluded from further analysis. The remaining 34 items formed the item bank of the Balance CAT. Two stopping rules (ie, reliability coefficient >0.9 or ≤6 items) were set for the CAT. The simulation study showed that the patients' balance scores estimated by the CAT had an average reliability value of .94. The scores obtained from the CAT were closely associated with those of the full item set (Pearson r=.98). The scores of the Balance CAT were highly correlated with those of the BBS (Pearson r=.88). The average time needed to administer the Balance CAT (83 seconds) was only 18{\%} of that of the BBS. Limitations. The convenience sampling of both samples may limit the generalization of the results. Further psychometric investigation of the Balance CAT is needed. Conclusion, The results provide strong evidence that the Balance CAT is efficient and has reliability and validity for patients with stroke.",
author = "Hsueh, {I. Ping} and Chen, {Jyun Hong} and Wang, {Chun Hou} and Chen, {Cheng Te} and Sheu, {Ching Fan} and Wang, {Wen Chung} and Hou, {Wen Hsuan} and Hsieh, {Ching Lin}",
year = "2010",
month = "9",
doi = "10.2522/ptj.20090395",
language = "English",
volume = "90",
pages = "1336--1344",
journal = "Physical Therapy",
issn = "0031-9023",
publisher = "American Physical Therapy Association",
number = "9",

}

TY - JOUR

T1 - Development of a computerized adaptive test for assessing balance function in patients with stroke

AU - Hsueh, I. Ping

AU - Chen, Jyun Hong

AU - Wang, Chun Hou

AU - Chen, Cheng Te

AU - Sheu, Ching Fan

AU - Wang, Wen Chung

AU - Hou, Wen Hsuan

AU - Hsieh, Ching Lin

PY - 2010/9

Y1 - 2010/9

N2 - Background. An efficient and precise measure of balance is needed to improve administration efficiency and to reduce the assessment burden for patients. Objective. The purpose of this study was to develop a computerized adaptive testing (CAT) system for assessing balance function in an efficient, reliable, and valid fashion in patients with stroke. Design. Two cross-sectional prospective studies were conducted. Setting. This study was conducted in the departments of physical medicine and rehabilitation in 6 hospitals. Patients. The participants were inpatients and outpatients who were receiving rehabilitation. Measurements. A balance item pool (41 items) was developed on the basis of predefined balance concepts, expert opinions, and field testing. The items were administered by 5 raters to 764 patients. An item response theory model was fit to the data, and the item parameters were estimated. A simulation study was used to determine the performance (eg, reliability, efficiency) of the Balance CAT. The Balance CAT and the Berg Balance Scale (BBS) then were tested on another independent sample of 56 patients to determine the concurrent validity and time needed for administration. Results. Seven items did not meet the model's expectations and were excluded from further analysis. The remaining 34 items formed the item bank of the Balance CAT. Two stopping rules (ie, reliability coefficient >0.9 or ≤6 items) were set for the CAT. The simulation study showed that the patients' balance scores estimated by the CAT had an average reliability value of .94. The scores obtained from the CAT were closely associated with those of the full item set (Pearson r=.98). The scores of the Balance CAT were highly correlated with those of the BBS (Pearson r=.88). The average time needed to administer the Balance CAT (83 seconds) was only 18% of that of the BBS. Limitations. The convenience sampling of both samples may limit the generalization of the results. Further psychometric investigation of the Balance CAT is needed. Conclusion, The results provide strong evidence that the Balance CAT is efficient and has reliability and validity for patients with stroke.

AB - Background. An efficient and precise measure of balance is needed to improve administration efficiency and to reduce the assessment burden for patients. Objective. The purpose of this study was to develop a computerized adaptive testing (CAT) system for assessing balance function in an efficient, reliable, and valid fashion in patients with stroke. Design. Two cross-sectional prospective studies were conducted. Setting. This study was conducted in the departments of physical medicine and rehabilitation in 6 hospitals. Patients. The participants were inpatients and outpatients who were receiving rehabilitation. Measurements. A balance item pool (41 items) was developed on the basis of predefined balance concepts, expert opinions, and field testing. The items were administered by 5 raters to 764 patients. An item response theory model was fit to the data, and the item parameters were estimated. A simulation study was used to determine the performance (eg, reliability, efficiency) of the Balance CAT. The Balance CAT and the Berg Balance Scale (BBS) then were tested on another independent sample of 56 patients to determine the concurrent validity and time needed for administration. Results. Seven items did not meet the model's expectations and were excluded from further analysis. The remaining 34 items formed the item bank of the Balance CAT. Two stopping rules (ie, reliability coefficient >0.9 or ≤6 items) were set for the CAT. The simulation study showed that the patients' balance scores estimated by the CAT had an average reliability value of .94. The scores obtained from the CAT were closely associated with those of the full item set (Pearson r=.98). The scores of the Balance CAT were highly correlated with those of the BBS (Pearson r=.88). The average time needed to administer the Balance CAT (83 seconds) was only 18% of that of the BBS. Limitations. The convenience sampling of both samples may limit the generalization of the results. Further psychometric investigation of the Balance CAT is needed. Conclusion, The results provide strong evidence that the Balance CAT is efficient and has reliability and validity for patients with stroke.

UR - http://www.scopus.com/inward/record.url?scp=77956898603&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956898603&partnerID=8YFLogxK

U2 - 10.2522/ptj.20090395

DO - 10.2522/ptj.20090395

M3 - Article

C2 - 20592269

AN - SCOPUS:77956898603

VL - 90

SP - 1336

EP - 1344

JO - Physical Therapy

JF - Physical Therapy

SN - 0031-9023

IS - 9

ER -