Improving Methodological Coherence in Thesis Proposal Design: Development and Preliminary Validation of Research Coherence Alignment Framework

Authors

  • Luijim Santos Jose

Keywords:

research design; methodological coherence; thesis writing; research alignment; preliminary validation

Abstract

Methodological coherence is a central requirement in thesis proposal design because valid inquiry depends on the logical alignment of the research questions, constructs, evidence sources, instruments, and analytical procedures. Although the research methodology literature consistently emphasizes alignment, student researchers often lack the operational tools for translating research questions into coherent empirical structures. This study developed and preliminarily validated the Research Coherence Alignment Framework (RCAF), a methodological support system designed to guide, evaluate, and diagnose coherence in thesis proposal design. The framework consists of four integrated components: the SOP–Instrument Alignment Matrix, the Methodological Coherence Evaluation Rubric, the Taxonomy of Research Alignment Errors, and the Methodological Coherence Index. A DBR-informed developmental design was employed, involving expert validation and classroom-based implementation with 60 thesis-writing students assigned to control and experimental intact groups. Expert evaluation yielded a Content Validity Index of .90, indicating strong agreement for the framework’s clarity, relevance, and usefulness. The results also show that students who used the RCAF obtained significantly higher methodological coherence scores than those who followed the usual thesis-writing condition, t (58) = 10.31, p < .001, Cohen’s d = 2.65. Given the quasi-experimental design, the findings should be interpreted as preliminary evidence of the framework’s pedagogical usefulness rather than definitive proof of causal effectiveness. Overall, the study suggests that RCAF can support thesis instruction, proposal evaluation, and research supervision by making methodological alignment more explicit, teachable, and assessable.

https://doi.org/10.26803/ijlter.25.6.25

References

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.

Bakhou, B., & Bouhania, B. (2020). A qualitative inquiry into the difficulties experienced by Algerian EFL master students in thesis writing: “Language is not the only problem.” Arab World English Journal, 11(2), 243–257. https://doi.org/10.24093/awej/vol11no2.17

Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347–364. https://doi.org/10.1007/BF00138871

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.2018.00149

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge.

Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.

DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.

Grohnert, T., Gromotka, L., Gast, I., Delnoij, L., & Beausaert, S. (2024). Effective master’s thesis supervision: A summative framework for research and practice. Educational Research Review, 42, Article 100589. https://doi.org/10.1016/j.edurev.2023.100589

Ipanaqué-Zapata, M., Figueroa-Quiñones, J., Bazalar-Palacios, J., Arhuis-Inca, W., Quiñones-Negrete, M., & Villarreal-Zegarra, D. (2023). Research skills for university students’ thesis in e-learning: Scale development and validation in Peru. Heliyon, 9(3), Article e13770. https://doi.org/10.1016/j.heliyon.2023.e13770

Jordal, M., Eriksson, H., Salzmann-Erikson, M., & Mazaheri, M. (2021). Escorting students into responsibility and autonomy: A model for supervising degree projects. Advances in Medical Education and Practice, 12, 1165–1173. https://doi.org/10.2147/AMEP.S307169

Jusslin, S., & Hilli, C. (2024). Supporting bachelor’s and master’s students’ thesis writing: A rhizoanalysis of academic writing workshops in hybrid learning spaces. Studies in Higher Education, 49(4), 712–729. https://doi.org/10.1080/03075079.2023.2250809

Kickert, R., Meeuwisse, M., Stegers-Jager, K. M., Prinzie, P., & Arends, L. R. (2022). Curricular fit perspective on motivation in higher education. Higher Education, 83(4), 729–745. https://doi.org/10.1007/s10734-021-00699-3

Koo, T. K., & Li, M. Y. (2016). A guideline for selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

Maxwell, J. A. (2013). Qualitative research design: An interactive approach (3rd ed.). SAGE Publications.

Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what is being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147

Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the content validity index an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199

Praestegaard Larsen, B. (2025). Research process model for bachelor’s thesis. Journal of Learning Development in Higher Education, (34). https://doi.org/10.47408/jldhe.vi34.1379

Quinto, J. B. (2022). Seize the day or seize theses? The challenges in undergraduate thesis writing. Issues in Educational Research, 32(4), 1567–1583. https://www.iier.org.au/iier32/quinto.pdf

Reeves, T. C. (2006). Design research from a technology perspective. In J. van den Akker, K. Gravemeijer, S. McKenney, & N. Nieveen (Eds.), Educational design research (pp. 52–66). Routledge.

Roberts, L. D., & Seaman, K. (2018). Good undergraduate dissertation supervision: Perspectives of supervisors and dissertation coordinators. International Journal for Academic Development, 23(1), 28–40. https://doi.org/10.1080/1360144X.2017.1412971

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.

Sireci, S. G., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107. https://doi.org/10.7334/psicothema2013.256

Strebel, F., Gürtler, S., Hulliger, B., & Lindeque, J. (2021). Laissez-faire or guidance? Effective supervision of bachelor theses. Studies in Higher Education, 46(4), 866–884. https://doi.org/10.1080/03075079.2019.1659762

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. https://doi.org/10.3102/0013189X032001005

Vígh, T. (2024). Development of research skills through research-focused microteaching lesson study in preservice teacher education. Teaching and Teacher Education, 145, Article 104618. https://doi.org/10.1016/j.tate.2024.104618

Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5–23. https://doi.org/10.1007/BF02504682

Wisker, G. (2018). Frameworks and freedoms: Supervising research learning and the undergraduate dissertation. Journal of University Teaching and Learning Practice, 15(4), Article 2. https://doi.org/10.53761/1.15.4.2

Zhao, L., Zhao, B., & Li, C. (2023). Alignment analysis of teaching–learning-assessment within the classroom: How teachers implement project-based learning under the curriculum standards. Disciplinary and Interdisciplinary Science Education Research, 5, Article 13. https://doi.org/10.1186/s43031-023-00078-1

Downloads

Published

2026-06-30

How to Cite

Jose, L. S. . (2026). Improving Methodological Coherence in Thesis Proposal Design: Development and Preliminary Validation of Research Coherence Alignment Framework. International Journal of Learning, Teaching and Educational Research, 25(6), 588–615. Retrieved from https://www.ijlter.net/index.php/ijlter/article/view/2912

Issue

Section

Articles