Exploring the psychometric characteristics of the questions of the medical and dental residency entrance exam in 2020 by item responses theory

Document Type : Original Article

Authors

1 Ph.D student. Department of Curriculum Planning and Educational Methods, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

2 associate professor. Department of Curriculum Planning and Educational Methods, Faculty of Psychology and Education, University of Tehran، Tehran، Iran

3 Chaiman of research, development and education, National Center for Medical Education Assessment, Tehran, Iran

10.22034/emes.2022.550571.2365

Abstract

Objective: This study aims to investigate the quality of medical and dental residency programs entrance examinations based on questions' psychometric properties and item-response theory.
Methods: The research method is descriptive-analytical. The analyzed data includes all the participants' answers in the 2021 assistantship exam, which has been analyzed based on the item-response theory.
Results: Results show that dental and medical assistant exams are not satisfying regarding psychometric properties, but designers need to be more careful in formulating questions.
Conclusion: To increase the quality of residency entrance examination and observe the taxonomy of questions, designers must consider the parameter of diagnosis and difficulty of the question and the quality of deviant options, matching questions with each other and the subject of the relevant lesson increased.

Keywords

References

  1. References

     

    Shakurnia Ah, Mozaffari Ar, Khosravi Brougeni A, (2010). Survey on Structural of MCQs of residency exam in AJUMS, Jundishapur Scientific Medical Journal, 8(4), 491. magiran.com/p695212

    Saburi M, Shayan S, Salehi A, Honarpisheh H. Review Psychometric Parameters of the 29th Residency Test (1380) According to the Classic Test Theory (CTT) . Iranian Journal of Medical Education. 2002; 2 :49-50URL: http://ijme.mui.ac.ir/article-1-551-fa.html

    Taheri M, khoshrang H, Asadi louyeh A, Hidarzadeh A. Quality of Residents’ Promotion Exams before & after Educational Intervention in 2010-2011. Iranian Journal of Medical Education. 2013; 13 (7) :551-560 URL: http://ijme.mui.ac.ir/article-1-2350-fa.html

    Minaei, a., & Falsafinejad, m. (2010). Methods for assessing unidimensionality in dichotomous irt models. Training measurement, 1(3), 71-99. Https://www.sid.ir/en/journal/viewpaper.aspx?id=255760

    1. H. Naji.(2018)Comparative study of student assessment and admission system in countries. Master's Thesis, Tehran universitey, Tehran

    Hambleton, Ronald K. & Swaminathan, Hariharan. & Rogers, H. Jane.  (1991).  Fundamentals of item response theory.  Newbury Park, Calif :  Sage Publications, Translated in persian, 2010, Alameh tabai university,  Tehran.

    Embretson, Susan & Reise, S.. (2000). Item Response Theory For Psychologists. Tranlated in persian, Roshd, Tehran, 2010

    Baker, Frank B. (1985). The Basics of Item Response Theory. the ERIC Clearinghouse on Assessment and Evaluation.

    Kaur, M., Singla, S., & Mahajan, R. (2016). Item analysis of in use multiple choice questions in pharmacology. International journal of applied & basic medical research, 6(3), 170–173. https://doi.org/10.4103/2229-516X.186965

    Khasawneh, W., Obeidat, N., Albiss, B., & El-Salem, K. (2020). Selection criteria and match results for postgraduate residency programs: A cross-sectional model from a major academic center in Jordan. Annals of medicine and surgery (2012), 59, 199–203. https://doi.org/10.1016/j.amsu.2020.10.001

    Montgomery, G. P., Crockford, D. N., & Hecker, K. (2010). The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: a preliminary psychometric assessment. Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry. 34(3), 203–207. https://doi.org/10.1176/appi.ap.34.3.203

    Shrestha, A., Bhandary, Sh., Shrestha, Sh. (2019). Situational judgement test: Psychometric analysis of a pilot study for selecting post graduate medical student in residency program. Journal of Patan Academy of Health Sciences. 6(2): 81-7.

    Smith, E.B., Lewis, P., Benefield, T., Catanzano, T.M., Khan, M.J., Eric Nyberg, Jordan, Sh. (2020). Auditing RadExam: Employing Psychometrics to Improve Exam Quality. Academic Radiology. https://doi.org/10.1016/j.acra.2020.05.037

    Thomas, T.V., Kuruvilla, T.P.,  Eldrin Bhanat, E., Parr, A.Q., Ashley Albert, A., Vijayakumar, S. (2020). An Analysis of the Residents’ Research, Education, and Wellness Resources in Radiation Oncology Residency Programs in the United States. Advances in Radiation Oncology. (2021) 6, 100548. https://doi.org/10.1016/j.adro.2020.08.005

Educational Measurement and Evaluation Studies
Volume 12, Issue 38
July 2022
Pages 55-68

Files

Share

How to cite

Statistics