TY - JOUR

T1 - Assessing competence in cochlear implant surgery using the newly developed Cochlear Implant Surgery Assessment Tool

AU - Frendø, Martin

AU - Frithioff, Andreas

AU - Konge, Lars

AU - Foghsgaard, Søren

AU - Mikkelsen, Peter Trier

AU - Sørensen, Mads Sølvsten

AU - Cayé-Thomasen, Per

AU - Andersen, Steven Arild Wuyts

N1 - Publisher Copyright: © 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH, DE part of Springer Nature.

PY - 2022

Y1 - 2022

N2 - Purpose: To develop and gather validity evidence for a novel tool for assessment of cochlear implant (CI) surgery, including virtual reality CI surgery training. Methods: Prospective study gathering validity evidence according to Messick’s framework. Four experts developed the CI Surgery Assessment Tool (CISAT). A total of 35 true novices (medical students), trained novices (residents) and CI surgeons performed two CI-procedures each in the Visible Ear Simulator, which were rated by three blinded experts. Classical test theory and generalizability theory were used for reliability analysis. Results: The CISAT significantly discriminated between the three groups (p < 0.001). The generalizability coefficient was 0.76 and most of the score variance (53.3%) was attributable to the participant and only 6.8% to the raters. When exploring a standard setting for CI surgery, the contrasting groups method suggested a pass/fail score of 36.0 points (out of 55), but since the trained novices performed above this, we propose using the mean CI surgeon performance score (45.3 points). Conclusion: Validity evidence for simulation-based assessment of CI performance supports the CISAT. Together with the standard setting, the CISAT might be used to monitor progress in competency-based training of CI surgery and to determine when the trainee can advance to further training.

AB - Purpose: To develop and gather validity evidence for a novel tool for assessment of cochlear implant (CI) surgery, including virtual reality CI surgery training. Methods: Prospective study gathering validity evidence according to Messick’s framework. Four experts developed the CI Surgery Assessment Tool (CISAT). A total of 35 true novices (medical students), trained novices (residents) and CI surgeons performed two CI-procedures each in the Visible Ear Simulator, which were rated by three blinded experts. Classical test theory and generalizability theory were used for reliability analysis. Results: The CISAT significantly discriminated between the three groups (p < 0.001). The generalizability coefficient was 0.76 and most of the score variance (53.3%) was attributable to the participant and only 6.8% to the raters. When exploring a standard setting for CI surgery, the contrasting groups method suggested a pass/fail score of 36.0 points (out of 55), but since the trained novices performed above this, we propose using the mean CI surgeon performance score (45.3 points). Conclusion: Validity evidence for simulation-based assessment of CI performance supports the CISAT. Together with the standard setting, the CISAT might be used to monitor progress in competency-based training of CI surgery and to determine when the trainee can advance to further training.

KW - Cochlear implants

KW - Medical education

KW - Resident education

KW - Virtual reality

U2 - 10.1007/s00405-021-06632-9

DO - 10.1007/s00405-021-06632-9

M3 - Journal article

C2 - 33604749

AN - SCOPUS:85101108188

VL - 279

SP - 127

EP - 136

JO - Archiv fur klinische und experimentelle Ohren- Nasen- und Kehlkopfheilkunde

JF - Archiv fur klinische und experimentelle Ohren- Nasen- und Kehlkopfheilkunde

SN - 0942-8992

IS - 1

ER -