Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Standard
Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy. / Guldager, Mads J; Melchiors, Jacob; Andersen, Steven Arild Wuyts.
I: Annals of Otology, Rhinology and Laryngology, Bind 129, Nr. 7, 07.2020, s. 715-721.Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Development and Validation of an Assessment Tool for Technical Skills in Handheld Otoscopy
AU - Guldager, Mads J
AU - Melchiors, Jacob
AU - Andersen, Steven Arild Wuyts
PY - 2020/7
Y1 - 2020/7
N2 - OBJECTIVE: Handheld otoscopy requires both technical and diagnostic skills, and is often reported to be insufficient after medical training. We aimed to develop and gather validity evidence for an assessment tool for handheld otoscopy using contemporary medical educational standards.STUDY DESIGN: Educational study.SETTING: University/teaching hospital.SUBJECTS AND METHODS: A structured Delphi methodology was used to develop the assessment tool: nine key opinion leaders (otologists) in undergraduate training of otoscopy iteratively achieved consensus on the content. Next, validity evidence was gathered by the videotaped assessment of two handheld otoscopy performances of 15 medical students (novices) and 11 specialists in otorhinolaryngology using two raters. Standard setting (pass/fail criteria) was explored using the contrasting groups and Angoff methods.RESULTS: The developed Copenhagen Assessment Tool of Handheld Otoscopy Skills (CATHOS) consists 10 items rated using a 5-point Likert scale with descriptive anchors. Validity evidence was collected and structured according to Messick's framework: for example the CATHOS had excellent discriminative validity (mean difference in performance between novices and experts 20.4 out of 50 points, P < .001); and high internal consistency (Cronbach's alpha = 0.94). Finally, a pass/fail score was established at 30 points for medical students and 42 points for specialists in ORL.CONCLUSION: We have developed and gathered validity evidence for an assessment tool of technical skills of handheld otoscopy and set standards of performance. Standardized assessment allows for individualized learning to the level of proficiency and could be implemented in under- and postgraduate handheld otoscopy training curricula, and is also useful in evaluating training interventions.LEVEL OF EVIDENCE: NA.
AB - OBJECTIVE: Handheld otoscopy requires both technical and diagnostic skills, and is often reported to be insufficient after medical training. We aimed to develop and gather validity evidence for an assessment tool for handheld otoscopy using contemporary medical educational standards.STUDY DESIGN: Educational study.SETTING: University/teaching hospital.SUBJECTS AND METHODS: A structured Delphi methodology was used to develop the assessment tool: nine key opinion leaders (otologists) in undergraduate training of otoscopy iteratively achieved consensus on the content. Next, validity evidence was gathered by the videotaped assessment of two handheld otoscopy performances of 15 medical students (novices) and 11 specialists in otorhinolaryngology using two raters. Standard setting (pass/fail criteria) was explored using the contrasting groups and Angoff methods.RESULTS: The developed Copenhagen Assessment Tool of Handheld Otoscopy Skills (CATHOS) consists 10 items rated using a 5-point Likert scale with descriptive anchors. Validity evidence was collected and structured according to Messick's framework: for example the CATHOS had excellent discriminative validity (mean difference in performance between novices and experts 20.4 out of 50 points, P < .001); and high internal consistency (Cronbach's alpha = 0.94). Finally, a pass/fail score was established at 30 points for medical students and 42 points for specialists in ORL.CONCLUSION: We have developed and gathered validity evidence for an assessment tool of technical skills of handheld otoscopy and set standards of performance. Standardized assessment allows for individualized learning to the level of proficiency and could be implemented in under- and postgraduate handheld otoscopy training curricula, and is also useful in evaluating training interventions.LEVEL OF EVIDENCE: NA.
KW - Adult
KW - Aged
KW - Clinical Competence
KW - Delphi Technique
KW - Education, Medical, Undergraduate
KW - Female
KW - Hospitals, University
KW - Humans
KW - Male
KW - Middle Aged
KW - Otolaryngology/education
KW - Otoscopy/standards
KW - Reproducibility of Results
KW - Young Adult
U2 - 10.1177/0003489420904734
DO - 10.1177/0003489420904734
M3 - Journal article
C2 - 32090596
VL - 129
SP - 715
EP - 721
JO - The Annals of otology, rhinology & laryngology. Supplement
JF - The Annals of otology, rhinology & laryngology. Supplement
SN - 0096-8056
IS - 7
ER -
ID: 250432567