Post-valuation quality check of multiple-choice questions

Authors

  • Kavita M. Jaiswal Department of Pharmacology, Government Medical College, Gondia, Maharashtra, India
  • Sujata Dudhgaonkar Department of Pharmacology, Government Medical College, Gondia, Maharashtra, India
  • Piyush Gharade Department of Pharmacology, Government Medical College, Gondia, Maharashtra, India
  • Nikita Sharma Department of Pharmacology, Government Medical College, Gondia, Maharashtra, India

DOI:

https://doi.org/10.18203/2319-2003.ijbcp20223353

Keywords:

Difficulty index, Discrimination index, distracter effectiveness, Item

Abstract

Background: Multiple choice questions find important place in assessment in medical curriculum. Each MCQ is called item. Item analysis is quality check of MCQs after valuation of response sheets. This serves to recognize flaws in MCQs so that the given questions can be preserved in question bank, modified or deleted.

Methods: 140 medical students of second MBBS were assessed pharmacology through 20 single best response type MCQ. Post exam validation of MCQs was done by item analysis. Each item was analyzed for level of difficulty, ability of the question to discriminate between poor and good performing students and distracter effectiveness.

Results: Score ‘1’ was given for correct and ‘0’ for incorrect or no response. The mean score of the test was found to be 10.58±2.48, with a range 5-18. The whole test had an acceptable difficulty level with 43.25±17.81 mean difficulty index. The discrimination index of the whole test was found to be 0.123±0.184 mean PBI correlation coefficient, which is not satisfactory. Out of 60 distractors, 51 were found to be functional, hence distractor efficiency of the given test was 85%±19.96% which is acceptable.

Conclusions: 60% questions were found to be ideal and 25% were acceptable with revision of stem or options. One question was easy with poor discrimination which needs major modification in construct or subject to be placed in question bank while another one question was difficult but had negative biserial index which needs to be deleted from the question bank.

Author Biography

Kavita M. Jaiswal, Department of Pharmacology, Government Medical College, Gondia, Maharashtra, India

Associate Professor Department of Pharmacology GMC Gondia Maharashtra India

References

Frank JR, Mungroo R, Ahmad Y, M Wang. Toward competency based medical education in medicine: a systemic review of published definations. Med Teacher J. 2010;32:6.

Stringer K, Santen SA, Lee E, Rawls M, Bailey J, Richards A, et al. Examining Bloom’s taxonomy in multiple choice questions: students’ approach to questions. Med Sci Edu. 2021;31:1311-7.

Baig M, Ali SK, Ali S, Huda N. Evaluation of multiple choice and short essay question items in basic medical sciences. Med Educ. 2007;41(8):754-62.

Peck C. Principles of sound assessment practice in health profes¬sions education. EC Psychol Psychiat. 2017;5(5):150-7.

Oyebola DO, Adewoye OE, Iyaniwura JO, Alada RA, Fasanmade AA, Raji YA. Comparative study of students’performance in preclinical physiology assessed by multiple choice and short essay questions. Afr J Med Med Sci. 2000;29(3-4):201

Kemp JE, Morrison GR, Ross SM. Developing evaluation instru¬ments. New York: MacMillan College Publishing Company; 1994:180-213.

Kelley TL. The selection of upper and lower groups for validation of test items. J Educ Psychol. 1939;30:17-24.

Mitra NK, Nagaraja HS, Ponnudurai G, Judson JP. The of level of difficulty and discrimination indices in type A multiple choice questions of nPre. Clin Sem Multidisclip J. 2009;3(1):2-7.

Considine J, Botti M, Thomas S. Design, format validity and reliability of multiple choice questions for use in nursing research and education. Collegian. 2005;12(1):19-24.

Patel KA, Mahajan NR. Itemized analysis of questions of mul¬tiple choice question exam. Int J Sci Res. 2013;2(2):279-80.

Patil VC, Patil HV. Item analysis of medicine multiple choice questions (MCQs) for under graduate (3rd year MBBS) students. Res J Pharm Biol Chem Sci. 2015;6(3):1242-51.

Mehta G, Mokhasi V. Item analysis of multiple choice questions-An assessment of the assessment tool. Int J Health Sci Res. 2014;4(7):197-202.

Benish M, Sehar S, Muhammad A, Asma S, Nauman BK, Zainab N. Quality analysis of multiple choice questions. Pak Oral Dent J. 2020;4(40):235-9.

Singh JP, Kariwal P, Gupta SB, Shrotriya VP. Improving mul¬tiple choice questions through item analysis: an assessment of the assessment tool. Int J Basic Sci Appl Res. 2014;1(2):53-7.

Hingorjo MR, Jaleel F. Analysis of one-best MCQs: the diffi¬culty index, discrimination index and distractor efficiency. J Pak Med Assoc. 2012;62(2):142-7.

Gajjar S, Sharma R, Kumar P, Rana M. Item and test analysis to identify quality multiple choice questions (mcqs) from an assessment of medical students of Ahmedabad, Gujarat. Indian J Commun Med. 2014;39(1):17-20.

Downloads

Published

2022-12-26

How to Cite

Jaiswal, K. M., Dudhgaonkar, S., Gharade, P., & Sharma, N. (2022). Post-valuation quality check of multiple-choice questions. International Journal of Basic & Clinical Pharmacology, 12(1), 43–48. https://doi.org/10.18203/2319-2003.ijbcp20223353

Issue

Section

Original Research Articles