Evaluation of effectiveness of practical assessment by objective structured practical examination and its comparison with traditional pharmacology practical examination among II MBBS students: a cross-sectional study
DOI:
https://doi.org/10.18203/2319-2003.ijbcp20254153Keywords:
CBME, OSPE, Student perception, Traditional practical examinationAbstract
Background: The undergraduate medical curriculum in India has adopted a competency-based medical education (CBME) model emphasizing cognitive, affective, and psychomotor domains to produce competent Indian medical graduates. Traditional pharmacology practical assessments, based on written exercises and viva voce, often lack objectivity and clinical relevance. The objective structured practical examination (OSPE) offers a structured, reliable, and competency-based alternative aligning with CBME principles.
Methods: This prospective cross-sectional educational study was conducted from March - July 2025 among 150 II MBBS students at Government Medical College in India. Students were randomly divided into two groups (n=75 each) and assessed through OSPE and traditional practical examination (TPE), respectively. OSPE included 11 structured stations evaluating cognitive, psychomotor, and affective domains using validated checklists, while TPE followed conventional methods. Quantitative data were analyzed using the unpaired Student’s t-test, and student perceptions were collected through a structured feedback questionnaire.
Results: Students assessed by OSPE scored significantly higher (mean±SD = 40.45±4.74) than those assessed through TPE (36.80±5.63; p<0.001). Over 90% of students found OSPE well-structured, fair, and relevant; 67.1% perceived it as less stressful, though 21.1% reported anxiety and 32.9% desired more faculty support. Reliability of feedback tools was high (Cronbach’s α=0.96 and 0.80).
Conclusions: OSPE is a valid, objective, and student-preferred assessment tool that enhances the evaluation of pharmacological competencies. Its wider implementation, supported by faculty training and student orientation, can significantly strengthen CBME-based pharmacology education.
Metrics
References
Jacob KS. DSM-5: A blessing or a curse? Indian J Psychol Med. 2019;41(3):203-9. DOI: https://doi.org/10.4103/IJPSYM.IJPSYM_166_19
Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, et al. Criteria for: Consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33(3):206-14. DOI: https://doi.org/10.3109/0142159X.2011.551559
Badyal DK, Singh T. Teaching of clinical pharmacology in India: a need for change. Indian J Pharmacol. 2009;41(4):151-2.
Barman A. Critiques on the OSCE. Ann Acad Med Singap. 2005;34(8):478-82. DOI: https://doi.org/10.47102/annals-acadmedsg.V34N8p478
Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using an (OSCE). Med Educ. 1975;9(2):91-6.
Khan KZ, Ramachandran S, Gaunt K, Pushkar P. (OSCE): AMEE Guide No. 81. Med Teach. 2013;35(9):e1437-44. DOI: https://doi.org/10.3109/0142159X.2013.818634
Miller GE. The assessment of clinical skills. Acad Med. 1990;65(9 Suppl):S63-7. DOI: https://doi.org/10.1097/00001888-199009000-00045
National Medical Commission. CBME for the Indian Medical Graduate. New Delhi: NMC; 2023.
Bhatnagar KR, Saoji VA, Banerjee AA. (OSPE) in pharmacology: a student feedback. Indian J Pharmacol. 2011;43(6):684-5.
Al-Kadri HM, Al-Moamary MS, van der Vleuten C. Students’ and examiners’ perceptions of OSCE. Med Teach. 2009;31(6):e254-63. DOI: https://doi.org/10.1186/1756-0500-2-263
Selvam RP, Faizan M. Student perception of OSPE as assessment method in pharmacology. Int J Basic Clin Pharmacol. 2014;3(3):443-7.
Pierre RB, Wierenga A, Barton M, Branday JM, Christie CD. Student evaluation of an OSCE in paediatrics at Jamaica. BMC Med Educ. 2004;4:22. DOI: https://doi.org/10.1186/1472-6920-4-22
Hodges B. OSCE! Variations on a theme by Harden. Med Educ. 2003;37(12):1134-40. DOI: https://doi.org/10.1111/j.1365-2923.2003.01717.x
Jindal M, Gupta P, Singh T. OSPE in undergraduates pharmacology. Indian J Pharmacol. 2009;41(6):267-70.
Mitra NK, Barua A, Singh T. OSPE for formative assessment in undergraduates. Med Teach. 2015;37(9):835-42.
Vyas R, Jacob M, Faith M, Isaac B, Rabi S, Sathishkumar S, et al. OSCE-based formative assessment in pharmacology. Indian J Pharmacol. 2011;43(3):306-9.
Patil SN, Kshirsagar YB, Kumar KHK. Students’ perception of OSPE - pharmacology. Int J Basic Clin Pharmacol. 2022;11(1):49-53.
Deori R, Bhatia P, Juneja A, Kumar R, Yadav P. OSPE in 2nd MBBS pharmacology: Perception of students and faculty. J Med Sci Clin Res. 2020;8(2):500-6.
Sai SKG, Mukkadan JK, Thomas K, Kulangara AC. OSPE in physiology. Natl J Physiol Pharm Pharmacol. 2020;10(7):1259-61.
Bhat D, Pai KM, Nandihal NW, Shenoy A, Fernandes V. OSPE in physiology. Indian J Clin Anat Physiol. 2020;7(1):81-6. DOI: https://doi.org/10.18231/j.ijcap.2020.018
Carolin A, Devi PTV. Student perception of OSPE in microbiology. Int J Community Med Public Health. 2019;6(10):4285-90. DOI: https://doi.org/10.18203/2394-6040.ijcmph20194481
Rajani M, Ghewade B. OSPE in pharmacology. J Adv Med Educ Prof. 2020;8(3):121-6.
Shetty KJ, Ghosh S, Palappallil DS. OSPE in pharmacology. Int J Pharmacol Clin Sci. 2021;10(2):54-9.