Faculty development programs improve the quality of Multiple Choice Questions items' writing
- PMID: 25828516
- PMCID: PMC4381327
- DOI: 10.1038/srep09556
Faculty development programs improve the quality of Multiple Choice Questions items' writing
Abstract
The aim of this study was to assess the utility of long term faculty development programs (FDPs) in order to improve the quality of multiple choice questions (MCQs) items' writing. This was a quasi-experimental study, conducted with newly joined faculty members. The MCQ items were analyzed for difficulty index, discriminating index, reliability, Bloom's cognitive levels, item writing flaws (IWFs) and MCQs' nonfunctioning distractors (NFDs) based test courses of respiratory, cardiovascular and renal blocks. Significant improvement was found in the difficulty index values of pre- to post-training (p = 0.003). MCQs with moderate difficulty and higher discrimination were found to be more in the post-training tests in all three courses. Easy questions were decreased from 36.7 to 22.5%. Significant improvement was also reported in the discriminating indices from 92.1 to 95.4% after training (p = 0.132). More number of higher cognitive level of Bloom's taxonomy was reported in the post-training test items (p<0.0001). Also, NFDs and IWFs were reported less in the post-training items (p<0.02). The MCQs written by the faculties without participating in FDPs are usually of low quality. This study suggests that newly joined faculties need active participation in FDPs as these programs are supportive in improving the quality of MCQs' items writing.
Figures
Similar articles
-
Effectiveness of longitudinal faculty development programs on MCQs items writing skills: A follow-up study.PLoS One. 2017 Oct 10;12(10):e0185895. doi: 10.1371/journal.pone.0185895. eCollection 2017. PLoS One. 2017. PMID: 29016659 Free PMC article.
-
Writing Multiple Choice Questions-Has the Student Become the Master?Teach Learn Med. 2023 Jun-Jul;35(3):356-367. doi: 10.1080/10401334.2022.2050240. Epub 2022 May 1. Teach Learn Med. 2023. PMID: 35491868
-
Effect of Faculty Training on Quality of Multiple-Choice Questions.Int J Appl Basic Med Res. 2020 Jul-Sep;10(3):210-214. doi: 10.4103/ijabmr.IJABMR_30_20. Epub 2020 Jul 11. Int J Appl Basic Med Res. 2020. PMID: 33088746 Free PMC article.
-
Multiple choice questions: a literature review on the optimal number of options.Natl Med J India. 2008 May-Jun;21(3):130-3. Natl Med J India. 2008. PMID: 19004145 Review.
-
Multiple-Choice Tests: A-Z in Best Writing Practices.Psychiatr Clin North Am. 2021 Jun;44(2):249-261. doi: 10.1016/j.psc.2021.03.008. Psychiatr Clin North Am. 2021. PMID: 34049647 Review.
Cited by
-
Faculty Perception of Scenario-Based MCQs, SAQs, and MEQs in Medical Education at an Apex Institute.Med Sci Educ. 2024 May 2;34(4):865-871. doi: 10.1007/s40670-024-02052-6. eCollection 2024 Aug. Med Sci Educ. 2024. PMID: 39099861
-
The impact of repeated item development training on the prediction of medical faculty members' item difficulty index.BMC Med Educ. 2024 May 30;24(1):599. doi: 10.1186/s12909-024-05577-x. BMC Med Educ. 2024. PMID: 38816855 Free PMC article.
-
Questioning the questions: Methods used by medical schools to review internal assessment items.MedEdPublish (2016). 2021 Feb 5;10:37. doi: 10.15694/mep.2021.000037.1. eCollection 2021. MedEdPublish (2016). 2021. PMID: 38486513 Free PMC article.
-
Assessment of the Quality of Multiple-Choice Questions in the Surgery Course for an Integrated Curriculum, University of Bisha College of Medicine, Saudi Arabia.Cureus. 2023 Dec 13;15(12):e50441. doi: 10.7759/cureus.50441. eCollection 2023 Dec. Cureus. 2023. PMID: 38222171 Free PMC article.
-
Examining the impact of specific types of item-writing flaws on student performance and psychometric properties of the multiple choice question.MedEdPublish (2016). 2018 Oct 2;7:225. doi: 10.15694/mep.2018.0000225.1. eCollection 2018. MedEdPublish (2016). 2018. PMID: 38089249 Free PMC article.
References
-
- Bland C. J., Schmitz C. C., Stritter F. T., Henry R. C. & Aluise J. J. Successful faculty in academic medicine: essential skills and how to acquire them. (Springer Publishing, NY, 1990).
-
- Harden R. M. & Crosby J. AMEE Guide no 20: The good teacher is more than a lecturer-the twelve roles of the teacher. Med. Teach. 22, 334–347 (2000).
-
- Drew S. Perceptions of what helps them learn and develop in higher education. Teaching High. Educ. 6, 309–331 (2001).
-
- Tang C. Effects of modes of assessment on students' preparation strategies. Improving student learning: theory and practice (eds Gibbs G., ed. ), 151–170, (Oxford: Oxford Centre for Staff Development, 1994).
-
- Verhoeven B. H., Verwijnen G. M., Scherpbier A. J. J. A., Schuwirth L. W. T. & van derVleuten C. P. M. Quality assurance in test construction: the approach of a multidisciplinary central test committee. Educ. Health 12, 49–60 (1999).
LinkOut - more resources
Full Text Sources
Other Literature Sources