Validation of an operating room immersive microlaryngoscopy simulator

TY - JOUR

T1 - Validation of an operating room immersive microlaryngoscopy simulator

AU - Fleming, Jason

AU - Kapoor, Karan

AU - Sevdalis, Nick

AU - Harries, Meredydd

PY - 2012/5

Y1 - 2012/5

N2 - Objectives/Hypothesis: To assess the face and construct validity of two assessment tools for a microlaryngoscopy simulatora Checklist Assessment for Microlaryngeal Surgery and Global Rating Assessment for Microlaryngeal Surgery.Study Design: Blinded experimental simulator-based study.Methods: There were 15 candidates divided into a novice ( 50 procedures) group depending on their previous microlaryngoscopy experience. Each candidate undertook a 10-minute simulation of a microlaryngoscopy and excision biopsy, and two blinded experts rated their performance live on each of the two assessment tools. To assess face validity, each candidate subsequently completed a questionnaire about the simulator.Results: The model demonstrated good face validity across all levels of experience. The global rating assessment demonstrated excellent interrater reliability (0.9) compared to the checklist assessment (0.7). The checklist assessment was able to differentiate experienced and novice candidates and therefore demonstrated construct validity. The global rating tool, however, was unable to differentiate candidates. There was a significant correlation between the two assessment tools (correlation coefficient 0.624).Conclusions: This study is the first reported study of a high-fidelity microlaryngoscopy simulator with task-specific rating tools. Use of these tools is recommended within otolaryngology training programs, with the global rating assessment for use as a frequently used feedback tool, and the checklist assessment as a confirmatory evaluation of competency at transitions of professional training.

AB - Objectives/Hypothesis: To assess the face and construct validity of two assessment tools for a microlaryngoscopy simulatora Checklist Assessment for Microlaryngeal Surgery and Global Rating Assessment for Microlaryngeal Surgery.Study Design: Blinded experimental simulator-based study.Methods: There were 15 candidates divided into a novice ( 50 procedures) group depending on their previous microlaryngoscopy experience. Each candidate undertook a 10-minute simulation of a microlaryngoscopy and excision biopsy, and two blinded experts rated their performance live on each of the two assessment tools. To assess face validity, each candidate subsequently completed a questionnaire about the simulator.Results: The model demonstrated good face validity across all levels of experience. The global rating assessment demonstrated excellent interrater reliability (0.9) compared to the checklist assessment (0.7). The checklist assessment was able to differentiate experienced and novice candidates and therefore demonstrated construct validity. The global rating tool, however, was unable to differentiate candidates. There was a significant correlation between the two assessment tools (correlation coefficient 0.624).Conclusions: This study is the first reported study of a high-fidelity microlaryngoscopy simulator with task-specific rating tools. Use of these tools is recommended within otolaryngology training programs, with the global rating assessment for use as a frequently used feedback tool, and the checklist assessment as a confirmatory evaluation of competency at transitions of professional training.

KW - Simulation

KW - validity

KW - assessment

KW - microlaryngoscopy

KW - Level of Evidence: 2b

KW - TECHNICAL SKILLS

KW - RATING-SCALES

KW - RELIABILITY

KW - VALIDITY

KW - SURGERY

U2 - 10.1002/lary.23240

DO - 10.1002/lary.23240

M3 - Article

SN - 0023-852X

VL - 122

SP - 1099

EP - 1103

JO - Laryngoscope

JF - Laryngoscope

IS - 5

T2 - Annual Meeting of the American-Academy-of-Otolaryngology-Head-and-Neck-Surgery-Foundation

Y2 - 10 September 2011 through 14 September 2011

ER -