TY - JOUR
T1 - Electronic assessment of clinical reasoning in clerkships: A mixed-methods comparison of long-menu key-feature problems with context-rich single best answer questions
AU - Huwendiek, Soren
AU - Reichert, Friedrich
AU - Duncker, Cecilia
AU - de Leng, Bas
AU - van der Vleuten, Cees
AU - Muitjens, Arno
AU - Bosse, Hans-Martin
AU - Haag, Martin
AU - Hoffmann, Georg
AU - Tonshoff, Burkhard
AU - Dolmans, Diana
PY - 2017/5/4
Y1 - 2017/5/4
N2 - Background: It remains unclear which item format would best suit the assessment of clinical reasoning: context-rich single best answer questions (crSBAs) or key-feature problems (KFPs). This study compared KFPs and crSBAs with respect to students’ acceptance, their educational impact, and psychometric characteristics when used in a summative end-of-clinical-clerkship pediatric exam. Methods: Fifth-year medical students (n = 377) took a computer-based exam that included 6–9 KFPs and 9–20 crSBAs which assessed their clinical reasoning skills, in addition to an objective structured clinical exam (OSCE) that assessed their clinical skills. Each KFP consisted of a case vignette and three key features using a “long-menu” question format. We explored students’ perceptions of the KFPs and crSBAs in eight focus groups and analyzed statistical data of 11 exams. Results: Compared to crSBAs, KFPs were perceived as more realistic and difficult, providing a greater stimulus for the intense study of clinical reasoning, and were generally well accepted. The statistical analysis revealed no difference in difficulty, but KFPs resulted more reliable and efficient than crSBAs. The correlation between the two formats was high, while KFPs correlated more closely with the OSCE score. Conclusions: KFPs with long-menu exams seem to bring about a positive educational effect without psychometric drawbacks.
AB - Background: It remains unclear which item format would best suit the assessment of clinical reasoning: context-rich single best answer questions (crSBAs) or key-feature problems (KFPs). This study compared KFPs and crSBAs with respect to students’ acceptance, their educational impact, and psychometric characteristics when used in a summative end-of-clinical-clerkship pediatric exam. Methods: Fifth-year medical students (n = 377) took a computer-based exam that included 6–9 KFPs and 9–20 crSBAs which assessed their clinical reasoning skills, in addition to an objective structured clinical exam (OSCE) that assessed their clinical skills. Each KFP consisted of a case vignette and three key features using a “long-menu” question format. We explored students’ perceptions of the KFPs and crSBAs in eight focus groups and analyzed statistical data of 11 exams. Results: Compared to crSBAs, KFPs were perceived as more realistic and difficult, providing a greater stimulus for the intense study of clinical reasoning, and were generally well accepted. The statistical analysis revealed no difference in difficulty, but KFPs resulted more reliable and efficient than crSBAs. The correlation between the two formats was high, while KFPs correlated more closely with the OSCE score. Conclusions: KFPs with long-menu exams seem to bring about a positive educational effect without psychometric drawbacks.
UR - http://www.scopus.com/inward/record.url?scp=85014765397&partnerID=8YFLogxK
U2 - 10.1080/0142159X.2017.1297525
DO - 10.1080/0142159X.2017.1297525
M3 - Article
VL - 39
SP - 476
EP - 485
JO - Medical Teacher
JF - Medical Teacher
SN - 0142-159X
IS - 5
ER -