Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations

P.G. Diogo*, V.H. Pereira, F. Papa, C. van der Vleuten, S.J. Durning, N. Sousa

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

1 Downloads (Pure)

Abstract

Objectives: The organization of medical knowledge is reflected in language and can be studied from the viewpoints of semantics and prototype theory. The purpose of this study is to analyze student verbalizations during an Objective Structured Clinical Examination (OSCE) and correlate them with test scores and final medical degree (MD) scores. We hypothesize that students whose verbalizations are semantically richer and closer to the disease prototype will show better academic performance.Methods: We conducted a single-center study during a year 6 (Y6) high-stakes OSCE where one probing intervention was included at the end of the exam to capture students' reasoning about one of the clinical cases. Verbalizations were transcribed and coded. An assessment panel categorized verbalizations regarding their semantic value (Weak, Good, Strong). Semantic categories and prototypical elements were compared with OSCE, case-based exam and global MD scores.Results: Students with Semantic 'Strong' verbalizations displayed higher OSCE, case-based exam and MD scores, while the use of prototypical elements was associated with higher OSCE and MD scores.Conclusions: Semantic competence and verbalizations matching the disease prototype may identify students with better organization of medical knowledge. This work provides empirical groundwork for future research on language analysis to support assessment decisions.
Original languageEnglish
Pages (from-to)249-256
Number of pages8
JournalDiagnosis (Berlin, Germany)
Volume10
Issue number3
Early online date1 Mar 2023
DOIs
Publication statusPublished - 14 Aug 2023

Keywords

  • assessment
  • clinical reasoning
  • dual process theory
  • knowledge structures
  • OSCE
  • prototype theory
  • semantics
  • PERSPECTIVE
  • EXPERTISE
  • RELIABILITY
  • EDUCATION
  • VALIDITY

Cite this