Face Validity Assessment of Malaysian Teachers’ Global Competency Instrument using Face Validity Index Analysis from Potential Test-takers’ Perspective
Keywords:
face validity index; instrument development; global competency; teachers; potential test takersAbstract
In the VUCA era (Volatile, Uncertain, Complex, Ambiguous), global competency is a key proficiency that teachers must possess to produce students who can think openly, act responsibly, and interact across cultural boundaries. Developing an instrument to measure the level of global competency among teachers in Malaysia requires validity, particularly from non-expert groups such as potential test-takers. This study reported the findings of a quantitative survey design to evaluate the face validity of the global competency instrument by ten teachers who represented the target population of potential test takers. The clarity and comprehensibility of the items were assessed using a four-point Likert scale and analyzed with the face validity index (FVI) through the calculation of item-level FVI (I-FVI), scale-level FVI average (S-FVI/Ave), and scale-level FVI universal agreement (S-FVI/UA). A total of 68 items achieved an I-FVI value of ? 0.83, while the remaining eight items recorded values between 0.70 and 0.80. The overall S-FVI/Ave and S-FVI/UA values were 0.97 and 0.84, respectively, indicating a good level of clarity and comprehensibility of the items. This study emphasized the crucial role of face validity in ensuring the clarity, comprehensibility, and usability of an instrument by end-users. The systematic use of the FVI approach enhances transparency and precision in evaluating perceptions of item clarity and comprehensibility, hence supporting the recommendation of FVI as a fundamental procedure in instrument development studies, before proceeding to more complex stages of content and construct validity. It also underlines the importance of face validity evaluation from the perspective of potential test takers.
https://doi.org/10.26803/ijlter.24.10.23
References
Allen, M. S., Robson, D. A., & Iliescu, D. (2023). Face validity: A critical but ignored component of scale construction in psychological assessment [Editorial]. European Journal of Psychological Assessment 39(3), 153–156. https://doi.org/10.1027/1015-5759/a000777
Awan, W. A., Ameen, K., & Soroya, S. H. (2022.) Content validity and reliability of an instrument to investigate serendipitous retrieval of information: Information encountering and its subsequent keeping and sharing behaviour scale (IEKSBS). Journal of Information Science 51(1), 31-39. https://doi.org/10.1177/01655515221128756
Aydarova, E., & Marquardt, S. K. (2016). The global imperative for teacher education: Opportunities for comparative and international education. FIRE: Forum for International Research in Education, 3(1).
Baco, S., & Ishak, M. Z. (2021). Kesahan dan kebolehpercayaan instrumen penilaian kendiri pembelajaran ungkapan algebra tingkatan dua. Malaysian Journal of Social Sciences and Humanities (MJSSH) 6(11), 127–137. https://doi.org/10.47405/mjssh.v6i11.1136
Baharuddin. I. H., Ismail, N., Naing, N. N., Ibrahim, K., Yasin, S. M., & Patterson, M. S. (2024). Content and face validity of Workplace COVID-19 Knowledge & Stigma Scale (WoCKSS). BMC Public Health 24, 83. https://doi.org/10.1186/s12889-023-17614-3
Dalawi, I., Isa, M. R., Xin, W.C., Azhar, Z. I., & Aimran, N. (2023). Development of the Malay Language of understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19): Content validity & face validity analysis. BMC Public Health 23, 1636. https://doi.org/10.1186/s12889-023-16044-5
DeVellis, R. F. (2017). Scale development: Theory and applications (4th ed.). SAGE Publications, Inc.
Guler, N. (2024). Global competency for teacher educators: Exploring the needs of teacher education faculty in a professional development project. Teacher Development, 29(2), 324–342. https://doi.org/10.1080/13664530.2024.2399075
Hussain, N. A. S., Mohd Matore, M. E. E., & Hamzah, M. I. M. (2025). Performance evaluation for educators in higher education from bibliometric analysis views. International Journal of Learning, Teaching and Educational Research, 24(5), 283–303. https://doi.org/ 10.26803/ijlter.24.5.15
Ibrahim, S. N. A., & Mohd Matore, M. E. E. (2025). The validity of the Malaysian teachers’ global competency level instrument using Cohen kappa, content validity ratio and content validity index analyses. Journal of Applied Science, Engineering, Technology, and Education, 7(1), 82-93. https://doi.org/10.35877/454RI.asci3848
Ibrahim, S. N. A., & Mohd Matore, M. E. E. (2024). How does global competency look like in Malaysian teachers? Issues and suggestions. International Journal of Academic Research in Progressive Education and Development 13(2), 837-844. https://doi.org/10.6007/ijarped/v13-i2/21375
Jiaxin, G., Huijuan, Z., & Hasan, M. H. (2024). Global competence in higher education: A ten-year systematic literature review. Frontiers in Education 9, Article 1404782. https://doi.org/10.3389/feduc.2024.1404782
Kamaruddin, M., & Mohd Matore, M. E. E. (2021). Development and validation of psychometric properties of the 10 IB learner profile instrument (10IBLP-I): A combination of the Rasch and classical measurement model. International Journal of Environmental Research and Public Health, 18(12), 6455. https://doi.org/10.3390/ijerph18126455
Mansilla, V. B., & Jackson, A. (2011). Educating for global competence: Preparing our youth to engage the world. Asia Society.
Masdoki, M., Din, R., & Mohd Matore, M. E. E. (2021). Teaching 4.0 competency in higher learning institutions: A systematic mapping review. International Journal of Learning, Teaching and Educational Research. 20, 217-231. https://doi.org/10.26803/ijlter.20.10.12
Mohamad Marzuki, M. F., Yaacob, N. A., & Yaacob, N. M., (2018). Translation, cross-cultural adaptation and validation of system usability scale (Malay Version) questionnaire for the assessment of mobile application. JMIR Human Factors 5(2), Article e10308. https://doi.org/10.2196/10308
Mohd Matore, M. E. E., Khairani, A. Z., Maat, S. M., Ahmad, N. A., & Mohd Matore, E. R. (2018). The influence of intellectual quotient (IQ), emotional quotient (EQ) and spiritual quotient (SQ) against adversity quotient (AQ) on polytechnic students in Malaysia. Journal of Engineering Science and Technology, Special Issue on ICETVESS, 13(Special Issue on ICETVESS 2017), 83–91.
Mohd Matore, M. E. E., Zainal, M. A., Mohd Noh, M. F., Khairani, A. Z., & Abd Razak, N. (2021). The development and psychometric assessment of Malaysian Youth Adversity Quotient Instrument (MY-AQi) by combining Rasch model and confirmatory factor analysis. IEEE Access. 9, 13314–13329. https://doi.org/10.1109/ACCESS.2021.3050311
Mohd Noh, M. F., & Mohd Matore, M. E. E. (2022). Rater severity differences in English language as a second language speaking assessment based on rating experience, training experience, and teaching experience through many-faceted Rasch measurement analysis. Frontiers in Psychology, 13, 941084. https://doi.org/10.3389/fpsyg.2022.941084
Nadmilail, A. I., Mohd Matore, M. E. E., & Maat, S. M. (2022). Measurement of non-academic attributes in the situational judgment test as part of school teacher selection: A systematic literature review. International Journal of Learning, Teaching and Educational Research, 21(5), 263–280. https://doi.org/ 10.26803/ijlter.21.5.14
Organisation for Economic Co-operation and Development (OECD). (2018). PISA 2018 global competence. Retrieved from https://www.oecd.org/en/topics/sub-issues/global-competence/pisa-2018-global-competence.html
Organisation for Economic Co-operation and Development (OECD). (2018). Preparing our youth for an inclusive and sustainable world: The OECD PISA Global Competence Framework. OECD Publishing.
Parmigiani, D., Jones, S. L., Kunnari, I., & Nicchia, E. (2022). Global competence and teacher education programmes: A European perspective. Cogent Education, 9(1), Article 2022996, 1–17. https://doi.org/10.1080/2331186X.2021.2022996
Parmigiani, D., Bar Nir, A., Ferguson-Patrick, K., Forkosh-Baruch, A., Heddy, E., Impedovo, M. A., et al. (2023). Assessing the development of global competence in teacher education programmes: Internal consistency and reliability of a set of rubrics. Higher Education Pedagogies, 8(1), Article 2216190, 1–30. https://doi.org/10.1080/23752696.2023.2216190
Polit, D. F., & Beck, C. T. (2006). The content validity index: are you sure you know what's being reported? Critique and recommendations. Research in nursing & health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Pressbooks. (2025, 10 September). 11.2 Strengths and weaknesses of survey research. In Scientific Inquiry in Social Work. https://pressbooks.pub/scientificinquiryinsocialwork/chapter/11-2-strengths-and-weaknesses-of-survey-research/
Putman, S. M., & Byker, E. J. (2020). Global citizenship 1-2-3: Learn, think, and act. Kappa Delta Pi Record 56(1), 16–21. https://doi.org/10.1080/00228958.2020.1696088
Sürücü, L. & Maslakç?, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal 8(3), 2694–2726.
Tichnor Wagner, A., Parkhouse, H., Glazier, J., & Cain, J. M. (2019). Becoming a globally competent teacher. ASCD
Xuanyun, Z., Noh@Seth, N. H., & Pairan, M. R. (2024). Global perspectives on teacher ICT competencies: Diversity and commonalities in eight representative frameworks. Journal of e Learning and Knowledge Society, 20(2), 42 54. https://doi.org/10.20368/1971-8829/1135977
Yaccob, N. S., Md. Yunus, M., & Hashim, H. (2022). Globally competent teachers: English as a second language teachers' perceptions on global competence in English lessons. Frontiers in Psychology, 13, 925160. http://doi.org/10.3389/fpsyg.2022.925160
Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal (11), 49–54. httpsw://doi.org/10.21315/eimj2019.11.2.6
Zhang, Z., & Garcia, L. (2023). Examining dimensionality and validity of the academic integrity survey instrument. Journal of Education and Development 7(1), 46–54. https://doi.org/10.20849/jed.v7i1.1326
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Siti Nurul Aqiedah Ibrahim, Mohd Effendi @ Ewan Mohd Matore
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).
