Assessing VATS competence based on simulated lobectomies of all five lung lobes
Research output: Contribution to journal › Journal article › Research › peer-review
Standard
Assessing VATS competence based on simulated lobectomies of all five lung lobes. / Haidari, Tamim Ahmad; Bjerrum, Flemming; Christensen, Thomas Decker; Vad, Henrik; Møller, Lars Borgbjerg; Hansen, Henrik Jessen; Konge, Lars; Petersen, René Horsleben.
In: Surgical Endoscopy, Vol. 36, No. 11, 2022, p. 8067-8075.Research output: Contribution to journal › Journal article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Assessing VATS competence based on simulated lobectomies of all five lung lobes
AU - Haidari, Tamim Ahmad
AU - Bjerrum, Flemming
AU - Christensen, Thomas Decker
AU - Vad, Henrik
AU - Møller, Lars Borgbjerg
AU - Hansen, Henrik Jessen
AU - Konge, Lars
AU - Petersen, René Horsleben
N1 - Publisher Copyright: © 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2022
Y1 - 2022
N2 - Objectives: To determine the number of procedures and expert raters necessary to provide a reliable assessment of competence in Video-Assisted Thoracoscopic Surgery (VATS) lobectomy. Methods: Three randomly selected VATS lobectomies were performed on a virtual reality simulator by participants with varying experience in VATS. Video recordings of the procedures were independently rated by three blinded VATS experts using a modified VATS lobectomy assessment tool (VATSAT). The unitary framework of validity was used to describe validity evidence, and generalizability theory was used to explore the reliability of different assessment options. Results: Forty-one participants (22 novices, 10 intermediates, and 9 experienced) performed a total of 123 lobectomies. Internal consistency reliability, inter-rater reliability, and test–retest reliability were 0.94, 0.85, and 0.90, respectively. Generalizability theory found that a minimum of two procedures and four raters or three procedures and three raters were needed to ensure the overall reliability of 0.8. ANOVA showed significant differences in test scores between the three groups (P < 0.001). A pass/fail level of 19 out of 25 points was established using the contrasting groups’ standard setting method, leaving one false positive (one novice passed) and zero false negatives (all experienced passed). Conclusion: We demonstrated validity evidence for a VR simulator test with different lung lobes, and a credible pass/fail level was identified. Our results can be used to implement a standardized mastery learning training program for trainees in VATS lobectomies that ensures that everyone reaches basic competency before performing supervised operations on patients.
AB - Objectives: To determine the number of procedures and expert raters necessary to provide a reliable assessment of competence in Video-Assisted Thoracoscopic Surgery (VATS) lobectomy. Methods: Three randomly selected VATS lobectomies were performed on a virtual reality simulator by participants with varying experience in VATS. Video recordings of the procedures were independently rated by three blinded VATS experts using a modified VATS lobectomy assessment tool (VATSAT). The unitary framework of validity was used to describe validity evidence, and generalizability theory was used to explore the reliability of different assessment options. Results: Forty-one participants (22 novices, 10 intermediates, and 9 experienced) performed a total of 123 lobectomies. Internal consistency reliability, inter-rater reliability, and test–retest reliability were 0.94, 0.85, and 0.90, respectively. Generalizability theory found that a minimum of two procedures and four raters or three procedures and three raters were needed to ensure the overall reliability of 0.8. ANOVA showed significant differences in test scores between the three groups (P < 0.001). A pass/fail level of 19 out of 25 points was established using the contrasting groups’ standard setting method, leaving one false positive (one novice passed) and zero false negatives (all experienced passed). Conclusion: We demonstrated validity evidence for a VR simulator test with different lung lobes, and a credible pass/fail level was identified. Our results can be used to implement a standardized mastery learning training program for trainees in VATS lobectomies that ensures that everyone reaches basic competency before performing supervised operations on patients.
KW - Assessment
KW - Competency
KW - Educating VATS surgeons
KW - Mastery learning
KW - VATS lobectomy
KW - Virtual reality simulation
U2 - 10.1007/s00464-022-09235-5
DO - 10.1007/s00464-022-09235-5
M3 - Journal article
C2 - 35467146
AN - SCOPUS:85128816820
VL - 36
SP - 8067
EP - 8075
JO - Surgical Endoscopy and Other Interventional Techniques
JF - Surgical Endoscopy and Other Interventional Techniques
SN - 0930-2794
IS - 11
ER -
ID: 314162273