Analysis of Longitudinal Assessment: Role of Radiology Online Longitudinal Assessment-Type Questions

Abstract

Objective: The purpose of this investigation was to assess gaps in radiologists' medical knowledge using abdominal subspecialty online longitudinal assessment (OLA)-type questions. Secondarily, we evaluated what question-centric factors influenced radiologists to pursue self-directed additional reading on topics presented.

Methods: A prospective OLA-type test was distributed nationally to radiologists over a 4-month period. Questions were divided into multiple groupings, including arising from three different time periods of literature (≤5 years, 6-15 years, and >20 years), relating to common versus uncommon modalities, and guideline-based versus knowledge-based characterization. After each question, participants rated their confidence in diagnosis and perceived question relevance. Answers were provided, and links to answer explanations and references were provided and tracked. A series of regression models were used to test potential predictors of correct response, participant confidence, and perceived question relevance.

Results: In all, 119 participants initiated the survey, with 100 answering at least one of the questions. Participants had significantly lower perceived relevance (mean: 51.3, 59.2, and 62.1 for topics ≤5 years old, 6-15 years old, and >20 years old, respectively; P < .001) and confidence (mean: 48.4, 57.8, and 63.4, respectively; P < .001) with questions on newer literature compared with older literature. Participants were significantly more likely to read question explanations for questions on common modalities compared with uncommon (46% versus 40%; P = .005) and on guideline-based questions compared with knowledge-based questions (49% versus 43%; P = .01).

Discussion: OLA-type questions function by identifying areas in which radiologists lack knowledge or confidence and highlight areas in which participants have interest in further education.

Keywords: Continuing certification; longitudinal assessment; physician education.