Validation Tool for Chemistry Teaching Innovations: Polytomous Rasch, Confirmatory Factor, and Reliability Analyses
DOI:
https://doi.org/10.70232/jrese.v2i1.9Keywords:
Chemistry, Confirmatory Factor Analysis, Rasch Analysis, Reliability, Teaching Innovations, Validation ToolAbstract
The study developed and validated the Chemistry Teaching Innovations Validation (CTIV) tool to meet the changing needs of chemistry teaching and enhance student engagement and understanding. The CTIV tool, built on the ADDIE concept, has five main components: pedagogical approach, content relevance, technology integration, assessment strategies, and teacher support and professional development. Item creation, scale formulation, and scale evaluation were all part of the validation process, including thorough testing for validity and reliability. Seven experts validated the created items, fifteen in-service teachers further improved and verified the items as included in the scale, and 264 in-service teachers participated in the pilot-testing of the revised tool. The CTIV was evaluated using various statistical analyses, including the infit and outfit values, which confirmed its reliability. The robustness of the instrument was validated by strong Cronbach’s alpha values and confirmatory factor analysis (CFA), which showed good internal consistency and precise measurement of the desired components. The CTIV tool offers teachers a systematic way to assess and use teaching innovations, guaranteeing conformity to curricular requirements and improving the quality of Chemistry education. With the help of this comprehensive validation tool, which connects theory and practice in education, Chemistry and Science classrooms can become more productive and interesting places to learn.
References
Adjei, F., Hanson, R., Sam, A., & Sedegah, S. (2022). The use of collaborative approaches on students’ performances in redox reactions. Science Education International, 33(2), 163-170. https://doi.org/10.33828/sei.v33.i2.4
Aldoobie, N. (2015). ADDIE mode. American International Journal of Contemporary Research, 5(6), 68–72. https://www.aijcrnet.com/journals/Vol_5_No_6_December_2015/10.pdf
Alhashem, F., & Alfailakawi, A. (2023). Technology-enhanced learning through virtual laboratories in chemistry education. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13739
Aris, N. M., Ibrahim, N. H., & Halim N. D. A. (2024). Innovate to educate: the development and validation of the design thinking chemistry modules. International Journal of Academic Research in Progressive Education and Development, 13(1), 2379-2389. http://dx.doi.org/10.6007/IJARPED/v13-i1/21103
Asiyah, S., Wiyono, B. B., Hidayah, N., & Supriyanto, A. (2021). The effect of professional development, innovative work, work and work commitment on quality of teacher learning in elementary schools of Indonesia. Eurasian Journal of Educational Research, 95, 227-246. https://files.eric.ed.gov/fulltext/EJ1321959.pdf
Ayittey, R. F., Azumah, D. A., Amponsah, K. D., & Commey-Mintah, P. (2023). Effectiveness of multimedia versus traditional teaching methods on chemistry practical performance among senior high school students in Ghana. Education Quarterly Review, 6(3), 125-134. http://dx.doi.org/10.31014/aior.1993.06.03.768
Boateng, G. O., Neilands, T. B., Frongillo, E. A., R., H., & Young, S. L. (2018). Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer. Frontiers in Public Health, 6, 366616. https://doi.org/10.3389/fpubh.2018.00149
Bond, T. G., & Foz, C. M. (2007). Applying the Rasch model: fundamental measurement in the human sciences. Routledge.
Brown, M. W. (2014). Confirmatory factor analysis for applied research. Guildford Press.
Cerna, E., Cortes, S. F., Padilla, K. J., Guion, J. B., Gomez, S. D., Taniola, J. V., Sumalinog, K., Dinawanao, C., Callanga, C., & Sanchez, J. M. P. (2023). Natural acid-base indicators as home-based experiments: feasibility, satisfaction, and teachers experiences in secondary blended instruction. Jurnal Pendidikan Progresif, 13(2), 597-609. http://dx.doi.org/10.23960/jpp.v13.i2.202334
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://doi.org/10.1037/1040-3590.7.3.309
Cotiangco, E. N. C., Huraño, N. J. B., Sodoso, E. R. G., Sumagang, M. G. P., Jumao-as, J. J. C., Canoy, J. H., Picardal, M. T., & Sanchez, J. M. P. (2024). Android-based audio-visual comics in enhancing conceptual understanding and motivation of chemistry concepts. Orbital: Electronic Journal of Chemistry, 16(2), 125-135. http://dx.doi.org/10.17807/orbital.v16i2.19953
Cronbach, L. J. (1951) Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. https://psycnet.apa.org/doi/10.1007/BF02310555
Demelash, M. D., Andargie, D., & Belachew, W. (2024). Enhancing secondary school students’ engagement in chemistry through 7E context-based instructional strategy supported with simulation. Pedagogical Research, 9(2). https://doi.org/10.29333/pr/14146
Dolin, J., & Evans, R. (2018). Transforming assessment: through an interplay between practice, research and policy. Springer.
Gaylan, E. G., Elladora, S. T., Taneo, J. K. B., Callanga, C. H., Piloton-Narca, M., Becbec, J., & Sanchez, J. M. P. (2024). Development and validation of a conceptual test for the human circulatory system. Jurnal Pendidikan Biologi Indonesia, 10(3), 909-919. https://doi.org/10.22219/jpbi.v10i
Guion, J. B. A., Sumalinog, K. P., Taniola, J. V. M., Gomez, S. D., Padilla, K. J., Cortes, S. F., Pepino, C. A., Cerna, E., Dinawanao, C., & Sanchez, J. M. P. (2023). Effectiveness and acceptability of laboratory experiment videos in blended chemistry learning. Kimika, 34(1), 36-46. https://doi.org/10.26534/kimika.v34i1.36-46
Ha, T. P. T. (2022). Exploring the effective ways of life-oriented chemistry teaching in senior middle schools in Viet Nam. International Journal of Advances in Engineering and Management, 4(1), 960-962. https://doi.org/10.35629/5252-0401960962
Karapinar, S., Kadioğlu, N., & Oskay, Ö. Ö. (2023). Flipped learning model based on learning styles in chemistry education. Jurnal Ilmiah Peuradeun, 11(3), 847-872. https://journal.scadindependent.org/index.php/jipeuradeun/article/view/954
Li, X., Guo, Y., Mwongela, S. M., & Kirberger, M. (2023). Incorporating Virtual Problem-Based Learning in Instrumental Chemistry during the COVID-19 Pandemic. COVID, 3(12), 1733-1745. https://doi.org/10.3390/covid3120120
Mananay, J., Sanchez, J. M., Sumalinog, G., Goles, C., & Alejandro, I. M. (2024). Factors affecting technology use in teaching functions in higher education institutions: a regression analysis. Journal of Education and Innovation, 26(3), 46-58. https://so06.tci-thaijo.org/index.php/edujournal_nu/article/view/264131
Moral, R. V., Insong, A. K. T., & Santos, J. V. (2023). Effects of ADDIE model as an instructional system design for senior high school students in natural science through alternative delivery learning. Journal of Effective Teaching Methods, 1(4), 42-48. https://doi.org/10.59652/jetm.v1i4.63
Mukama, E., & Byukusenge, P. (2023). Supporting student active engagement in chemistry learning with computer simulations. Journal of Learning for Development, 3(3), 427-439. http://dx.doi.org/10.56059/jl4d.v10i3.802
Navarette, C. T., Torrefranca, A. A., Mangolare, R. P., Celades, J. R. E., Mabuting, R. V. V., Tugao, J. E., Ybañez, J. J. C., Picardal, M. T., & Sanchez, J. M. P. (2023). Gas rules!: an electronic strategic intervention for online learning: students’ conceptual understanding and perceptions. Kimika, 34(1), 47-56. https://doi.org/10.26534/kimika.v34i1.47-56
Opateye, J. A., & Ewim, D. R. E. (2021). Assessment for learning and feedback in chemistry: a case for employing information and communication technology tools. International Journal of Research in STEM Education, 3(2), 18–27. https://doi.org/10.31098/ijrse.v3i2.660
Opona, A. J. D., Sanchez, J. M. P., & Bondoc, K. P. (2022). Use of multiple representations in online general chemistry class: promoting chemical understanding during the Covid-19 pandemic. Kimika, 33(2), 21-33. https://doi.org/10.26534/kimika.v33i2.21-33
Orosz, G., Németh, V., Kovács, L., Somogyi, Z., & Korom, E. (2023). Guided inquiry-based learning in secondary-school chemistry classes: a case study. Chemistry Education Research and Practice, 24(1). http://dx.doi.org/10.1039/D2RP00110A
Rivera, G. M., & Sanchez, J. M. P. (2020). Use of contextualized instructional materials: the case of teaching gas laws in a public uptown high school. Orbital: The Electronic Journal of Chemistry, 12(4), 276-281. http://dx.doi.org/10.17807/orbital.v12i4.1526
Sahaat, Z., Nasri, N. M., & Bakar, A. Y. A. (2019). ADDIE model in teaching module design process using modular method: applied topics in design and technology subjects. Advances in Social Science, Education and Humanities Research, 464. https://doi.org/10.2991/assehr.k.200824.161
Sanchez, J. M. P. (2017). Integrated macro-micro-symbolic approach in teaching secondary chemistry. Kimika, 28(2), 22-29. https://doi.org/10.26534/kimika.v28i2.238
Sanchez, J. M. P. (2018). Translational skills of students in chemistry. Science Education International, 29(4), 214-219. https://www.icaseonline.net/journal/index.php/sei/article/view/81
Sanchez, J. M. P. (2021). Understanding of kinetic molecular theory of gases in three modes of representation among tenth-grade students in chemistry. International Journal of Learning, Teaching and Educational Research, 20(1), 48-63. https://doi.org/10.26803/ijlter.20.1.3
Sanchez, J. M. P., Fernandez, M. J. U., Abgao, J. M. O., Sarona, H. H., Asenjo, S. B. C., Guiroy, B. V., Oponda, A. J. D., & Vale, X. M. (2021). Experimenting on natural acid-base indicators: a home-based chemistry activity during the COVID-19 pandemic as evaluated by teachers. Kimika, 32(1), 34-45. https://doi.org/10.26534/kimika.v32i1.34-45
Taborada, J. C., & Sanchez, J. M. P. (2020). Learning mole concept with PALS: an intervention for working students in a night school. Kimika, 31(1), 11-19. https://doi.org/10.26534/kimika.v31i1.11-19
Turrado-Sevilla, M. A., & Cantón-Mayo, I. (2022). Design and validation of an instrument to measure educational innovations in primary and pre-primary schools. Journal of New Approaches in Educational Research, 11(1), 79-96. https://doi.org/10.7821/naer.2022.1.727
Üce, M., & Ceyhan, I. (2019). Misconceptions in chemistry education and practices to eliminate them: literature analysis. Journal of Education and Training Studies, 7(3), 202-208. http://dx.doi.org/10.11114/jets.v7i3.3990
Uyulgan, M. A., & Akkuzu Güven, N. (2022). Web 2.0 tools in chemistry teaching: an analysis of pre-service chemistry teachers’ competencies and views. Instructional Technology and Lifelong Learning, 3(1), 88-114. https://doi.org/10.52911/itall.1127618
Wopereis, I. (2023). Validation and Evaluation of a Tool for Developing an Integrated View of ICT-Based Educational Innovation. Education Sciences, 13(3), 263. https://doi.org/10.3390/educsci13030263
Yesgat, D., Melesse, S., Andargie, D., & Beyene, B. B. (2023). Effects of technology-integrated chemistry instruction on students’ academic achievement and retention capacity. Journal of Education and Learning, 17(4), 696-709. http://dx.doi.org/10.11591/edulearn.v17i4.21055
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Joje Mar P. Sanchez
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
