Viva voce using Objective, Integrated, Clustered Examination Software (VOICES) app: study for formative assessment of medical undergraduate students in physiology

Adv Physiol Educ. 2024 Dec 1;48(4):915-922. doi: 10.1152/advan.00078.2024.

Abstract

The significance of assessment in driving learning is undeniable, particularly in oral assessments like viva voce where students express themselves verbally. However, traditional viva voce examinations' challenges include reliability, objectivity, content validity, time constraints, varying question difficulty levels, inconsistency in questioning among students, the influence of the "halo" effect, and issues with the test environment. Thus the study aimed to evaluate the effectiveness of Objective, Integrated, Clustered Examination Software (VOICES) compared to traditional viva voce methods. Using a mixed-method design with 103 students, questions were framed using VOICES software created by the National Informatics Center (NIC), Chhattisgarh State Center, Government of India, and students responded through voice messages. Faculty graded students based on personalized videos created by the app. Then, feedback was given, and a focused group discussion was conducted for the students. Traditional viva voce examinations were conducted as part of internal assessments, and the marks obtained from these assessments were compared to evaluate their effectiveness in comparison to the VOICES app. There was no significant difference in the marks obtained using both methods indicating that viva voce using an oral assessment app is equally effective. Students responded positively to the VOICES method. The formative oral assessment conducted through the use of the VOICES app successfully addresses the challenges typically associated with traditional viva voce examinations.NEW & NOTEWORTHY Traditional viva voce examination encounters challenges including reliability, objectivity, content validity, time constraints, varying question difficulty levels, inconsistency in questioning among students, the influence of the "halo" effect, and issues with the test environment. Formative oral assessment conducted through the use of the Objective, Integrated, Clustered Examination Software (VOICES) app developed by the National Informatics Center (NIC) successfully addresses the challenges typically associated with traditional viva voce examinations.

Keywords: feedback; formative assessment; objective; reliability; viva voce.

MeSH terms

  • Education, Medical, Undergraduate* / methods
  • Educational Measurement* / methods
  • Female
  • Humans
  • India
  • Male
  • Mobile Applications*
  • Physiology* / education
  • Software
  • Students, Medical*