Introduction and application of Dichotomous Moken Scale Analysis (MSA) in educational and psychological measurements

Document Type : Original Article

Authors

1 Associate Professor, Psychology Assessment and Measurement, Allameh Tabataba'i University, Tehran, Iran.

2 PhD Candidate in Psychology Assessment and Measurement, Allameh Tabatabai University, Tehran, Iran

3 PhD Candidate in Psychology Assessment and Measurement, Allameh Tabatabai University Tehran ,Tehran, Iran

10.22034/emes.2021.252028

Abstract

Objective: This study aims to introduce this scale for Dichotomous Responses and shows the application of it in the field of educational measurements/assessments by providing evidence of fitting Mokken in study the level of knowledge of the fifth- and sixth-year students of Kerman dental school (academic year 95-96) about blood pressure (BP)measurement technique according the guideline of the American Heart Association.
Methods: Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to Item Response Theory (IRT) that can be used to evaluate fundamental measurement properties in educational and psychological measurements with less strict assumptions than parametric IRT models.
Results: The results of secondary data analysis of the test included 14 items and all of 131 students, showed (using R software), that, the scalability coefficients of each item and the scalability coefficients of the item pairs were positive with low standard error. The overall scalability coefficient was 0.490 (medium), and omission of item 5 increased the overall scalability coefficient to 0.54 (strong/high). Therefore, the results under the monotone homogeneity Model (MH) showed no violations of monotonicity and one-dimension was obtained. Invariant item-ordering Results from IIO analyses showed the number of violations from the assumption of non-intersecting response functions, bottom-up method for selecting items confirmed the deletion of item 5. Obtaining the HT scalability coefficient of 0.45, was an evidence of fitting double monotonicity (DM) model. Four reliability coefficients calculated for the set of 13 items ranged from 0.86 to 0.91.
Conclusion: This study showed that this scale can be used to rank both individuals and items.

Keywords

References

Abdelhafez, A. M. . (2007). Postgraduate Research Students' Knowledge and Attitudes towards Good Supervisory Practice at the University of Exeter. Online Submission.
Abdelhamid, G. S., Gómez-Benito, J., Abdeltawwab, A. T., Abu Bakr, M. H., & Kazem, A. M. (2020). A Demonstration of Mokken Scale Analysis Methods Applied to Cognitive Test Validation Using the Egyptian WAIS-IV. Journal of Psychoeducational Assessment, 38(4), 493-506.
Andrich, D. (1982). An index of person separation in latent trait theory, the traditional KR. 20 index, and the Guttman scale response pattern. Education Research and Perspectives, 9(1), 95-104.
Baghaei, P. (2021). Mokken Scale Analysis in Language Assessment. Germany: Münster.
Chernyshenko, O. S., Stark, S., Chan, K. Y., Drasgow, F., & Williams, B. (2001). . (2001). Fitting item response theory models to two personality inventories: Issues and insights. Multivariate Behavioral Research, 36(4), 523-562.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. psychometrika, 16(3), 297-334.
Emons, W. H., Sijtsma, K., & Pedersen, S. S. (2012). Dimensionality of the Hospital Anxiety and Depression Scale (HADS) in cardiac patients: comparison of Mokken scale analysis and factor analysis. Assessment, 19(3), 337-353., 19(3), 337-353.
Engelhard Jr, G. (2008). Historical perspectives on invariant measurement: Guttman, Rasch, and Mokken. Measurement, 6(3), 155-189.
Guttman, L. (1947). On Festinger's evaluation of scale analysis. . Psychological Bulletin, 44(5), 451.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol. 2). Sage.
Hemker, B. T., K. Sijtsma, I. W. Molenaar, and B. W. Junker. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 331-347.
Hemker, B. T., Sijtsma, K., & Molenaar, I. W. (1995). Selection of unidimensional scales from a multidimensional item bank in the polytomous Mokken I RT model. Applied Psychological Measurement, 19(4), 337-352.
Hemker, B. T., Sijtsma, K., Molenaar, I. W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62(3), 331-347.
Junker, B. W., & Sijtsma, K. (2000). Latent and manifest monotonicity in item response models. Applied Psychological Measurement, 24(1), 65-81.
Ligtvoet, R. V. (2011). Polytomous latent scales for the investigation of the ordering of items. Psychometrika(2), 200-216.
Ligtvoet, R., Van der Ark, L. A., Te Marvelde, J. M., & Sijtsma, K. (2010). Investigating an invariant item ordering for polytomously scored items. Educational and Psychological Measurement, 70(4), 578-595.
Loevinger, J. (1948). The technic of homogeneous tests compared with some aspects of" scale analysis" and factor analysis. Psychological bulletin, 45(6), 507.
Lord, F. M. (1980). Applications of item response theory to practical testing problems.(A. Delavar، J. Younesi, Trans.). Roshd Press.
Lumsden, J. (1957). A factorial approach to unidimensionality. Australian Journal of Psychology, 9(2), 105-111.
Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: a case for nonparametric item response theory modeling. Psychological methods, 9(3), 354.
Meijer, R. R., Tendeiro, J. N., & Wanders, R. B. (2014). The use of nonparametric item response theory to explore data quality. Routledge.
Mokken, R. J. (1971). A theory and procedure of scale analysis. The Hague, The Netherlands: Mouton. MokkenA Theory and Procedure of Scale Analysis1971, 62(3), 331-347.
Mokken, R. J. (1971). A theory and procedure of scale analysis: With applications in political research (Vol. (Vol. 1)). Walter de Gruyter.
Molenaar, I. W. (1997). Nonparametric models for polytomous responses. In Handbook of modern item response theory. New York, NY: Springer.
Mooij, T. (2012). A Mokken scale to assess secondary pupils’ experience of violence in terms of severity. Journal of Psychoeducational Assessment,, 30(5), 496-508.
Oosterhuis, H. E., van der Ark, L. A., & Sijtsma, K. (2017). Standard errors and confidence intervals of norm statistics for educational and psychological Tests. psychometrika, 82(3), 559-588.
Palmgren, P. J., Brodin, U., Nilsson, G. H., Watson, R., & Stenfors, T. (2018). Investigating psychometric properties and dimensional structure of an educational environment measure (DREEM) using Mokken scale analysis–a pragmatic approach. BMC medical education, 18(1), 1-16.
Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual review of clinical psychology, 5, 27-48.
Sijtsma, K. (2009). Correcting fallacies in validity, reliability, and classification. International Journal of Testing, 9(3), 167-194.
Sijtsma, K., & Meijer, R. R. (2007). 22 Nonparametric Item Response Theory and Special Topics. Handbook of statistics, 26, 719-746.
Sijtsma, K., & Molenaar, I. W. (1987). Reliability of test scores in nonparametric item response theory. Psychometrika, 52(1), 79-97.
Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory (Vol. Vol. 5). sage.
Sijtsma, K., & van der Ark, L. A. (2017). A tutorial on how to do a Mokken scale analysis on your test and questionnaire data. British Journal of Mathematical and Statistical Psychology, 70(1), 137-158.م
Sijtsma, K., and I. W. Molenaar. (2002). Introduction to Nonparametric Item Response. Thousand Oaks, CA: Sage.
Sijtsma, K., Meijer, R. R., & van der Ark, L. A. (2011). Mokken scale analysis as time goes by: An update for scaling practitioners. Personality and Individual Differences, 50(1), 31-37.
Soltaninejad, Fatemeh. (1396). Assessing the knowledge of Kerman dental students about the correct way to measure the patient's blood pressure according to the standard of the American Heart Association in the 95-96 academic year. (Unpublished doctoral dissertation). Kerman University of Medical Sciences and Health Services, School of Dentistry.
Straat, J. H., Van der Ark, L. A., & Sijtsma, K. (2013). Comparing optimization algorithms for item selection in Mokken scale analysis. Journal of Classification, 30(1), 75-99.
Taylor, C. S. (2013). Validity and validation.(J. Younesi, Trans.). Allameh Tabatabai University Press.
Ünlü, A. (2007). Nonparametric item response theory axioms and properties under nonlinearity and their exemplification with knowledge space theory. Journal of Mathematical Psychology, 51(6), 383-400.
Van der Ark, L. A. (2012). New developments in Mokken scale analysis in R. Journal of Statistical Software, 48(5), 1-27.
Van der Ark, L. A. (2005). Stochastic ordering of the latent trait by the sum score under various polytomous IRT models. Psychometrika, 70(2), 283-304.
Van der Ark, L. A. (2010). A note on stochastic ordering of the latent trait using the sum of polytomous item scores. Psychometrika, 75(2), 272-279.
Van Der Ark, L. A., & Sijtsma, K. (2005). The effect of missing data imputation on Mokken scale analysis. New developments in categorical data analysis for the social and behavioral sciences, 147-166.
Van der Ark, L. A., van der Ark, M. L. A., & Suggests, M. A. S. S. (2018). Package ‘mokken’.
Van der Ark, L. A., van der Palm, D. W., & Sijtsma, K. (2011). A latent class approach to estimating test-score reliability. Applied Psychological Measurement, 35(5), , 380-392.
Van Ginkel, J. R., Van der Ark, L. A., & Sijtsma, K. (2007). Multiple imputation of item scores in test and questionnaire data, and influence on psychometric results. Multivariate Behavioral Research, 42(2), 387-414.
Van Schuur, W. H. (2003). Mokken scale analysis: Between the Guttman scale and parametric item response theory. Political Analysis, 11(2), 139-163.
Van Schuur, W. H. (2011). Ordinal item response theory: Mokken scale analysis. Thousand Oaks: SAGE.
Watson, R. v. (2012). Item response theory: how Mokken scaling can be used in clinical practice. Journal of clinical nursing, 21(19pt20), 2736-2746.
Wind, Stefanie A. (2017). An Instructional Module on Mokken Scale Analysis. Educational Measurement, 1–17.
Zijlstra, W. P., van der Ark, L. A., & Sijtsma, K. (2011). Outliers in questionnaire data: Can they be detected and should they be removed? Journal of Educational and Behavioral Statistics, 36(2), 186-212.
Educational Measurement and Evaluation Studies
Volume 11, Issue 36
December 2021
Pages 112-138

Files

Share

How to cite

Statistics