مطالعات اندازه گیری و ارزشیابی آموزشی

مطالعات اندازه گیری و ارزشیابی آموزشی

مدل تلفیقی فرایند تحلیل سلسله مراتبی و تحلیل پوششی داده‌ها برای اولویتبندی شاخص‌ها و ارزیابی کارایی واحدهای تصمیمگیرآموزشی (مطالعه‌ی موردی استان آذربایجان شرقی)

نوع مقاله : مقاله پژوهشی

نویسندگان
1 کارشناسی ارشد برنامه ریزی آموزشی، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران، تهران، ایران
2 استاد گروه روش‌ها و برنامه‌ریزی آموزشی و درسی، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران، تهران، ایران
3 دانشیار گروه روش‌ها و برنامه‌ریزی آموزشی و درسی، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران، تهران، ایران
10.22034/emes.2025.2012073.2506
چکیده
هدف: هدف اصلی این پژوهش، بهره‌گیری از یک مدل تلفیقی شامل فرایند تحلیل سلسله مراتبی و تحلیل پوششی داده‌ها برای اولویت‌بندی شاخص‌ها و ارزیابی کارایی واحدهای تصمیم‌گیری آموزشی می‌باشد؛ لذا، به لحاظ هدف در دسته پژوهش‌های کاربردی قرار می‌گیرد.
روش پژوهش: رویکرد تحقیق حاضر از نوع پژوهش‌های آمیخته بوده و ﺑﺮ اﺳﺎس ماهیت و روش، ﯾﮏ پژوهش توصیفی - تحلیلی اﺳﺖ. میدان پژوهش ﺣﺎﺿﺮ ﻣﻨﺎﻃﻖ 39 ﮔﺎﻧﻪ‌ی آموزش ‌و پرورش استان آذربایجان شرقی می‌باشد. به‌ منظور ﺗﻌﯿﯿﻦ با اهمیت‌ترین شاخص‌ها پیمایشی از نوع دلفی بر مبنای سندکاوی و مطالعات اسنادی صورت گرفت و شاخص‌های با اهمیت بر مبنای نظرات 13 تن از متخصصان تعلیم و تربیت انتخاب گردید. سپس با استفاده از فرایند تحلیل سلسله مراتبی وزن شاخص‌های مهم با دسته‌بندی در دو گروه درونداد و برونداد نسبت به یکدیگر تعیین گردید و این اوزان در تحلیل پوششی داده‌‌ها به کار گرفته شد. در نهایت کارایی نواحی و مناطق آموزش و پرورش استان آذربایجان شرقی به عنوان مورد مطالعه با استفاده از مدل جمعی موزون ارزیابی گردید و با استفاده از مدل ابرکارایی رتبه‌ی هر منطقه مشخص شد.
یافته‌ها: تعداد پنج شاخص به عنوان درونداد و پنج شاخص به عنوان برونداد انتخاب گردید. از بین شاخص‌های درونداد، شاخص "نسبت دانش‌آموز به کلاس دایر" و در شاخص‌های برونداد، "نرخ ترک تحصیل" نسبت به دیگر شاخص‌ها وزن بیشتری داشتند. یافته‌های حاصل از تحلیل پوششی داده‌ها نشان داد که نزدیک به 57 درصد از مناطق آموزش و پرورش استان آذربایجان شرقی، ناکارا هستند و در رتبه‌بندی انجام شده، منطقه‌ خداآفرین به عنوان کارا ترین منطقه شناخته شد.
نتیجه‌گیری: مناطق ناکارا بایستی با راهبرد کاهش مقادیر مازاد دروندادها و جبران کمبود در بروندادها در جهت بهبود کارایی خود قدم بردارند. همچنین شاخص‌هایی احصاء شده‌اند که اهمیت بالایی در تحقیقات حوزه کارایی آموزش و پرورش دارند.
کلیدواژه‌ها

عنوان مقاله English

An Integrated Model of AHP and DEA for Prioritizing Indicators and Evaluating the Efficiency of the Education DMUs (the Case of the East Azerbaijan Province)

نویسندگان English

Amir Soleimani 1
Rezvan Hakimzadeh 2
Ali Moghadamzadeh 3
1 M.A. in Educational Planning, Faculty of Psychology and Education, University of Tehran, Tehran, Iran
2 Professor, Department of Curriculum Development & Instruction Methods, Faculty of Psychology and Education, University of Tehran, Tehran, Iran
3 Associate Professor, Department of Curriculum Development & Instruction Methods, Faculty of Psychology and Education, University of Tehran, Tehran, Iran
چکیده English

Objective: The primary objective of this study was to prioritize the indicators and to evaluate the efficiency of education DMUs through the integration of two analytical techniques: Analytic Hierarchy Process (AHP) and Data Envelopment Analysis (DEA).
Methods: This research is grounded on a mixed-method approach and employs a descriptive-analytical research methodology to achieve its goals. The study focuses on all  39 education departments in the East Azerbaijan province. A Delphi survey grounded on the official enactments was conducted to ascertain the most pivotal input and output indicators according to 13 education experts. Subsequently, employing the AHP, the relative weights of inputs and outputs were determined. The calculated weights were then integrated into the DEA model. The efficiency of the education departments was assessed using the DEA additive model, and the super efficiency model was applied to rank them.
Results: A set of five indicators was identified as inputs, while another five were designated as outputs. Among the input indicators, the "class/pupil ratio" held particular prominence, while among the outputs, the "Dropout rate" assumed greater significance. The findings from DEA illuminated that approximately 57% of the educational departments were operating below optimal efficiency levels.
Conclusion: The inefficient DMUs have the opportunity to enhance their efficiency by emulating the practices of the reference groups introduced in this research by reduction of excess inputs or the augmentation of output levels to attain higher efficiency standards.

کلیدواژه‌ها English

Keywords: Education Efficiency
Evaluation indicators
Efficiency Evaluation
Analytic Hierarchy Process
Data Envelopment Analysis

References

Islamic Parliament Research Center (IPRC). (2023). Evaluation Indicators of Education System and Their Computational Challenges, https://rc.majlis.ir/fa/news/show/1783007
Abbaspour, A., Rahimian, H., Mehrgan, M. R., Ahmadnia, H. (2015). Data envelopment analysis as a tool for measuring organizational performance, planning and benchmarking in education. Educational Measurement Quarterly, 6(23), 99-116.
Agasisti, T. (2014). The efficiency of public spending on education: An empirical comparison of EU countries. European Journal of Education49(4), 543-557.
Al-Enezi, M., Burney, N., Johnes, J., & Al-Musallam, M. (2010). An assessment of efficiency of public schools in Kuwait using data envelopment approach (DEA) and tobit regression. Journal of Development and Economic Policies, 12(2), 7-33.
AlamTabriz, A., Saidi, H., Dilami, S. (2011). Using the combined approach of data envelopment analysis and hierarchical analysis process to evaluate the efficiency of Shahid Beheshti University faculties, Journal of Management Research, 23(89), 25-36.
Altamirano-Corro, A., & Peniche Vera, R. (2014). Measuring the institutional efficiency using dea and ahp: The case of a mexican university. Journal of applied research and technology, 12(1), 63-71.
Alvarez, P. A., Ishizaka, A., & Martinez, L. (2021). Multiple-criteria decision-making sorting methods: A survey. Expert Systems with Applications183, 115368.
Andersen, P., & Petersen, N. C. (1993). A procedure for ranking efficient units in data envelopment analysis. Management science39(10), 1261-1264.
Azimi, M. (2020). Investigation and Development of Performance Evaluation Indicators of Education System in Implementation of Fundamental Transformation Document. Journal of survey in teaching humanities, 6(19), 37-60.
Badri, M., Borzouian, S., Mohammadian, Z. (2021). Evaluating the efficiency of education with an emphasis on resource allocation: the super efficiency approach (case study of North Khorasan). Quarterly Journal of Educational Innovation, 20(4), 187-208.
Balci, M. A., Akgüller, Ö., Rzhevska, N., Dobroskok, I., & Mikityuck, I. (2022). Key Performance Indicator for Evaluating Tools in Distance Education. JOURNAL OF EDUCATION & PEDAGOGY14(2), 1.
Blatchford, P., Russell, A., Bassett, P., Brown, P., & Martin, C. (2007). The effect of class size on the teaching of pupils aged 7–11 years. School effectiveness and school improvement18(2), 147-172.
Becker, G. S. (2009). Human capital: A theoretical and empirical analysis, with special reference to education. University of Chicago press.
Bogetoft, P., Otto, L., Bogetoft, P., & Otto, L. (2011). Additional Topics in SFA. Benchmarking with DEA, SFA, and R, 233-262.
Dabla-Norris, M. E., Kochhar, M. K., Suphaphiphat, M. N., Ricka, M. F., & Tsounta, M. E. (2015). Causes and consequences of income inequality: A global perspective. International Monetary Fund.
Djalilova, Z. (2023). Pedagogical Educational Technology: Essence, Characteristics And Efficiency. Академические исследования в современной науке2(23), 29-38.
Drucker, P. F. (Ed.). (2018). The effective executive. Routledge.
Esongo, N. M. (2017). Correlation between the Availability of Resources and Efficiency of the School System within the Framework of the Implementation of Competency-Based Teaching Approaches in Cameroon. Journal of Education and Practice8(2), 82-92.
Elford, G. (Ed.). (2023). Equality of opportunity.
Eskandarpour, F. (2013). Evaluation of the relative efficiency of the units of Payam Noor University in Tehran province using the technique of data overlay analysis and hierarchical analysis (Master’s thesis). Islamic Azad University Central Tehran Branch, faculty of management.
Habibi, A., Afridi, S. (Eds.). (2022). Multi-criteria decision-making, Tehran: Naron Publications.
Halik, A., Suredah, S., & Ahdar, A. (2018, July). The Influence of Emotional and Spiritual Intelligence of Educator towards Learning Quality Improvement.
Hasnah, Y. (2017). Teachers as Role Models in Nurturing Students’ Character. Kumpulan Jurnal Dosen Universitas Muhammadiyah Sumatera Utara,(3).
Hakimzadeh, R. (2020, February). Interview with Mehrnews Agency. https://yun.ir/mehrnews2647
Hoshaw, J. P., Ben-Avie, M., Daughtery, K. K., Santilli, N. R., Schramm-Possinger, M., Di Genova, L., ... & Isaacson, E. M. (2021). Integrated Planning: The" Difference That Makes a Difference" in Institutional Effectiveness over Time. Intersection: A Journal at the Intersection of Assessment and Learning2(3), n3.
Ji, Y. B., & Lee, C. (2010). Data envelopment analysis. The Stata Journal10(2), 267-280.
Johnes, J. (2006). Data envelopment analysis and its application to the measurement of efficiency in higher education. Economics of education review, 25(3), 273-288.
Johnes, J., Portela, M., & Thanassoulis, E. (2017). Efficiency in education. Journal of the Operational Research Society, 68(4), 331-338.
Kabiri, M. (2013). Evaluation of the third elementary school mathematics book (unpublished research project). Tehran: Organization for Educational Research and Planning, Research Institute of Education.
Kabiri, M. (2018). Comparison of policies of primary school teachers’ recruitment and education based on the students' learning. Quarterly Journal of Educational Innovations, 17(4), 37-60.
Karsak, E. E., & Ahiska, S. S. (2007). A common-weight MCDM framework for decision problems with multiple inputs and outputs. In Computational Science and Its Applications–ICCSA 2007: International Conference, Kuala Lumpur, Malaysia, August 26-29, 2007. Proceedings, Part I 7 (pp. 779-790). Springer Berlin Heidelberg.
Khasanova, G. K., Nikadambaeva, K. B., & Kenjaboev, S. K. (2021). The role of education system in human capital development. Wschodnioeuropejskie Czasopismo Naukowe, (2-1), 48-51.
Khorrami, S. (2016). Evaluating school performance using data envelopment analysis and fuzzy hierarchical analysis (Master's Thesis). Azad University. Faculty of Engineering.
Kuchler, A. (2013). The efficiency of Danish banks before and during the crisis: A comparison of DEA and SFA (No. 87). Danmarks Nationalbank Working Papers.
Kuosmanen, T., & Kortelainen, M. (2012). Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints. Journal of productivity analysis38, 11-28.
Lee, S. W. (2018). Pulling back the curtain: Revealing the cumulative importance of high-performing, highly qualified teachers on students’ educational outcome. Educational Evaluation and Policy Analysis40(3), 359-381.
López, Y. P., Pazmiño, M. A., & Pacheco, D. (2020). La planificación académica, herramienta valiosa para la calidad del proceso de enseñanza y aprendizaje en la Unidad Educativa Bilingüe Torremar (UEBT). 593 Digital Publisher CEIT5(5), 29-35.
Mehrgan, M. (2019). Data envelopment analysis, quantitative models in evaluating the performance of organization(, 4th edition, Tehran: Academic Book Publishing.
Mohammadi, R., & Soleimani, A. (2023). A systematic review of educational equity in Iran: Conceptualization, Challenges, and Indicators. Journal of Educational Planning Studies12(23), 145-170.
Morris, T. H. (2019). Adaptivity through self-directed learning to meet the challenges of our ever-changing world. Adult Learning30(2), 56-66.
Mozooni, A. (2017). Performance evaluation and ranking of high schools using Fuzzy AHP and Fuzzy TOPSIS methods (Study case: Second Secondary High Schools of Tonkaben city) (Master's Thesis). Institute of Higher Education of the Future of Tonkabon. Department of Industrial Science Engineering.
Nguyen, H. T. (2020). A closer look at stochastic frontier analysis in economics. Asian Journal of Economics and Banking4(3), 3-28.
Ocay, J., Agaton, S. I., & Villote, A. (2021). Inclusion in education: ensuring educational equity in relation to gender, class, race and ethnicity. SABTON: Multidisciplinary Research Journal3(1), 49-59.
Pakzad, A. (2016). Efficiency Evaluation of High schools Based on A Novel Analytic Hierarchy Process-Assurance Region-Multiple Layer Data Envelopment Analysis (AHP-AR-MLDEA) Model.
Popović, M., Savić, G., Kuzmanović, M., & Martić, M. (2020). Using data envelopment analysis and multi-criteria decision-making methods to evaluate teacher performance in higher education. Symmetry12(4), 563.
Podviezko, A., & Podvezko, V. (2014). Absolute and relative evaluation of socio-economic objects based on multiple criteria decision making methods. Engineering Economics25(5), 522-529.
Rahbari, M., Hajnaghizadeh, F., Damari, B., & Adhami, B. (2014). Dropouts and social determinants of health; policy for the prevention of school dropout, qualitative study of the causes and interventions. International Journal of Preventive Medicine5(11), 1396.
Raisi Hassanlangi, M., Afrooz, G. A., & Akbari Zardkhaneh, S. (2021). Psychological and Social Roots of Academic Exhaustion of High School Students in Hormozgan Province: Developing a Model of The Education Sustainability. Iranian Evolutionary Educational Psychology Journal3(4), 457-470.
Thanassoulis, E., Dey, P. K., Petridis, K., Goniadis, I., & Georgiou, A. C. (2017). Evaluating higher education teaching performance using combined analytic hierarchy process and data envelopment analysis. Journal of the Operational Research Society68(4), 431-445.
Wellington, A. (2021). Retaining teachers in high attrition urban schools: An interpretative phenomenological analysis (Doctoral dissertation, Northeastern University).
Wright, M. C., Bergom, I., & Bartholomew, T. (2019). Decreased class size, increased active learning? Intended and enacted teaching strategies in smaller classes. Active learning in higher education20(1), 51-62.
Ziari, M., Falah-Jolodar, M. (2014). Evaluating the efficiency and ranking of schools in Firuzkoh city using data envelopment analysis model (case study of primary schools in Firozkoh city), Journal of Industrial Strategic Management, 12(37), 57-72.