Design and Psychometrics of Effective School Questionnaire with Cultural Standards of Iranian Community

Document Type : Research Paper

Authors

• hura soodi ¹
• sadegh maleki avarsin ²
• behnam talebi ³

¹ Ph.D. student of Islamic Azad University, Tabriz

² Islamic Azad University Tabriz Branch

³ Assistant Professor in Department of Educational Sciences, Azad University of Tabriz

Abstract

The study aimed to design and determine the questionnaire psychometric properties appropriate to the cultural standards of the Iranian community, the fundamental reform document and the national curriculum for effective schools. This was a methodological research ,That is statistical population included the professors of Department of Educational Sciences of four provinces in Northwest of Iran: West Azarbaijan, East Azarbaijan, Ardebil and Zanjan. In the first stage, the dimensions and components of effective schools were extracted using theoretical foundations and researches done inside and outside the country, and in the second stage, the questionnaire items were developed considering the extracted components. In the third stage, the psychometric properties of the questionnaire were evaluated using face validity, content validity, internal consistency and stability. Based on the results of the first and second stages, the initial questionnaire was provided to panel group members and the face and content validity were evaluated qualitatively and quantitatively. CVR and CVI values were obtained 0.65 and 0.84, respectively. After adjusting, these values increased up to 0.75 and 0.91. The internal consistency of the questions (Cronbach's alpha 0.982) and the test stability were obtained 0.931 by using the inter-class correlation coefficient with the test-retest method, through the response of 60 people from the target group to the questionnaire. The results showed that the designed questionnaire had the required validity and reliability and could be an appropriate tool for assessing the effectiveness of schools or developing models for effective schools.

Keywords

• Questionnaire psychometrics
• effective schools
• fundamental reform document
• national curriculum

20.1001.1.20086369.1398.10.40.3.3

---

References

-Ali,N.(2017). Teachers’ Perceptions of the Relationship between Principals’ Instructional Leadership, School Culture, and School Effectiveness in Pakistan. Education and Science ,Vol 42,No 192 ,pp 407-425

- Archer,J.A. (2004). Characteristics of an Effective Teacher of Reading in an Elementary School Setting. Dissertation unpublished docterd. Northwestern State University.

- Bland, J.M., Altman, D.G.(1997). Statistic Notes: Cronbachs Alpha. BMJ (Clinical research ed.), Vol 314, No 7080, p 572.

-Burns, N. ,Grove, S.K.(2003). Understanding nursing research. 2nd ed. Philadelphia : W.B. Saunders.

-Creswell, R. (2014). Research design: qualitative, quantitative, and mixed methods approaches. USA: Sage Publications ,p 201

- Crocker, L., Algina, J. (1986). Introduction to Classical and Modern Test Theory, Harcourt Brace Jovanovich College Publishers: Philadelphia

- Davati, S. (2013). The study and comparison of the status quo of public secondary schools in the 7th district of Tehran education based on the characteristics of effective schools in the academic year 2011-12, Master's thesis, Faculty of Humanities and Social Sciences, Islamic Azad University of Tabriz. (in Persian)

- David ,A. ,Cook, M.D., MHPE, Thomas, J. Beckman, M.D, FACP.(2006). Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application , The American Journal of Medicine, Vol 119, No 2, pp166.e7-166.e16

- de Boer, M.R., Moll ,A.C.,  de Vet, H.C., Terwee, C.B., Volker-Dieben, H.J., van Rens, G.H.(2004). Psychometric properties of vision-related quality of life questionnaires: a systematic review. Ophthalmic and Physiological Optic,vol 24, No4, PP 257-273

-De Maeyer, S., Rymenans, R., Daems, Fr., Van Petegem, P., & Van den Bergh, H. (2003).Effectiviteit van tso- en bso-scholen in Vlaanderen. Een onderzoek naar de effecten van schoolkenmerken op de prestaties en het welbevinden op school van tso- en bso-leerlingen . [Effectiveness of technical and vocational secondary education in Flanders. A research on the effects of school characteristics on the performance and well-being of pupils in technical and vocational secondary education.] Leuven/Leusden: Acco

- De Maeyera, S. , Van den Bergh, H., Rymenansa, R., Van Petegema, P., Rijlaarsdamc , G .(2010). Effectiveness criteria in school effectiveness studies: Further research on the choice for a multivariate model, Educational Research Review, Vol 5, No 1, PP 81-96

- Downing, S.M.(2004). Reliability: on the reproducibility of assessment data. Medical Education , Vol 38, No 9 , PP1006-1012.

-Drost, E.A.(2011). Validity and Reliability in Social Science Research. Education Research & Perspectives, Vol 38 ,No 1, pp105-123

- Fox, D.J.(1982). Fundamentals of Nursing Research. 4th Edition. USA: Appleton-Century-Crofts.

- Ghani,M.F.A., Siraj,S., Radzi ,N.M., Elham,F.(2011). School effectiveness and improvement practices in excellent schools in Malaysia and Brunei, Procedia Social and Behavioral Sciences, Vol 15 ,pp 1705–1712

-Gregory, R.J. (1992). Psychological Testing: History, Principles and Applications, Allyn and Bacon: Boston ,p.117

- Golafshani, N.(2003). Understanding reliability and validity in qualitative research. The qualitative report ,Vol 8, No 4,pp 597-607, Retrieved from http: //nsuworks . nova . edu / tqr /vol8 /iss4/6

- Habibi , H., Pardakhtchi,M.H., Abolghasemi,M., Ghahramani,M.,(2014).Study Environment “Learning center” of the school and its relevance to the effectiveness of the school. Traning & Learning Researches, Vol 2, No 3,pp101-118

- Hosseini,Z., Ghorbani, Z. Ebn Ahmady,A.(2015). Face and Content Validity and Reliability Assessment of Change Cycle Questionnaire in Smokers. Journal of Mashhad Dental School, No 2,pp 147-154 . (in Persian)

- Hyrkas, K., Schmidlechner, K.A., Oksa, L.(2003). Validating on Instrument for Clinical Supervision using an Expert Panel. International journal of nursing studies ,Vol 40, No 6,pp619-625 .

-Joppe, M. (2000). The Research Process. Retrieved February 25, 1998, from http:// www.ryerson.ca/~mjoppe/rp.htm

-Lawshe, C.H.(1975). A quantitative approach to content validity. Personnel Psychology, Vol 28 ,pp 563-575.

-Magulod Jr,G.C. (2017), Factors of School Effectiveness and Performance of Selected Public and Private Elementary Schools: Implications on Educational Planning in the Philippine. Asia Pacific Journal of Multidisciplinary Research,

Vol 5 , No 1, pp73-83

- Mehdian, M. J. (2009). Study of the main dimensions and components of effective schools to provide a suitable model for improving the effectiveness of the country's secondary education system, PhD dissertation, Faculty of Management and Economics, Islamic Azad University, Science and Research Branch. (in Persian)

-Newman, I., Lim, J., Pineda, F.(2013). Content Validity Using a Mixed Methods Approach: Its Application and Development Through the Use of a Table of Specifications Methodology. J Mixed Methods Research .

- Polit, D.F., Beck, C.T., Owen, S.V.(2007). Is the CVI an Acceptable Indicator of Content Validity?Appraisal and Recommendations. Research in Nursing & Health ,Vol 30, No 4,pp 459–467.

- Raghebi, M. (2011). Determining the components of the effective elementary school and providing the appropriate model for the effective school, master's thesis, Faculty of Humanities and Education, Islamic Azad University, Tabriz Branch. (in Persian)

- Rosenthal, R. , Rosnow, R. L. (1991). Essentials of Behavioral Research: Methods and Data Analysis. Second Edition. McGraw-Hill Publishing Company, pp 46-65.

-Saleem, F., Naseem,N., Ibrahim,K., Hussain,A., Azeem,M.(2012). Determinants of School Effectiveness: A study at Punjab level. International Journal of Humanities and Social Science,Vol 2,No 14, pp 242-251

- Saif, A. A. (2015). Educational Measurement, Assessment and Evaluation. Tehran: Doran Press, Sixth Edition. (in Persian)

-TavakolL, M. , Dennick, R. (2011). Making sense of Cronbach’s alpha. International journal of Medical Education,Vol 2,pp 53-55

- Thatcher, R. (2010). Validity and reliability of quantitative electroencephalography (qEEG). Journal of Neurotherapy, Vol 14, No 2,

pp 122-152.

- Twycross, A. , Shields, L. (2004). Validity and reliability - What's it all about? Part 2 Reliability in quantitative studies. Paediatric Nursing, Vol 16 , No 10, p 36

-Uline,l., Miller-Danil, M., & Tschannen-Moran. (1998). School Effectiveness:The Underlying Dimensions. Educatianal Administration Quarterly. Vol 34, No4,pp 462-483.

-Verdis, A., Kriemadis, T., Pashiardis, P. (2003). Historical, comparative and statistical perspective of school effectiveness research. The International Jornal of Education Management, Vol 17 , No 4,pp 155-169.

- Watkins, C., Carnell, E., Lodge,C.,(2007). Effective Learning in Classrooms.sage publishing Inc.2455.california 91320

- Winter, G. (2000). A comparative discussion of the notion of validity in qualitative and quantitative research. The Qualitative Report, Vol 4, No 3, Retrieved February 25, 1998, from http://www.nova.edu/ssss/

QR/QR4-3/winter.html

-Wynd, C.A., Schmidt, B., Schaefer, M.A.(2003). Two quantitative approaches for estimating content validity. West J Nurs Res ,Vol 25, No 5,pp 508-518.