Establishing pre-intervention baseline equivalence for AI-supported gamified project-based learning in entrepreneurship education

Authors

DOI:

https://doi.org/10.17977/um031v13i22026p102

Keywords:

Baseline equivalence, Project-Based Learning, Gamification, Artificial Intelligence in education, Entrepreneurship education

Abstract

Establishing pre-intervention baseline equivalence is essential for strengthening the internal validity of quasi-experimental studies. However, baseline comparability is often underreported in educational technology research, particularly in evaluations of emerging AI-supported instructional innovations. This study addresses this methodological gap by examining baseline comparability before implementing a newly developed AI-supported gamified Project-Based Learning (PjBL) model in entrepreneurship education. The novelty of the study lies in explicitly positioning baseline assessment as a methodological foundation for strengthening the interpretation of intervention effects in AI-enhanced learning research. A quasi-experimental design was employed involving an experimental group (n = 30) and a control group (n = 26). Pre-test data were analysed using descriptive statistics and the Mann-Whitney U test because the data were not normally distributed. The experimental and control groups recorded comparable mean pre-test scores of 85.33 and 85.19, respectively. No statistically significant baseline difference was found between the groups (U = 303.00, Z = −1.467, p = .142, r = .20). These findings support the baseline comparability of the two groups and provide a stronger methodological basis for interpreting subsequent differences in learning outcomes as being associated with the intervention rather than substantial pre-existing group differences.

Author Biographies

Silvia Anita Prastica, Universitas Negeri Malang

Master’s Program in Educational Technology, Faculty of Education, Universitas Negeri Malang

Agus Wedi, Universitas Negeri Malang

Department of Educational Technology, Faculty of Education, Universitas Negeri Malang

Fikri Aulia, Universitas Negeri Malang

Department of Educational Technology, Faculty of Education, Universitas Negeri Malang

Made Duananda Kartika Degeng, Universitas Negeri Malang

Department of Educational Technology, Faculty of Education, Universitas Negeri Malang

Isma Addi Jumbri, Universiti Teknikal Malaysia Melaka

Faculty of Technology Management and Technopreneurship, Universiti Teknikal Malaysia

References

Bell, R., & Bell, H. (2023). Entrepreneurship education in the era of generative artificial intelligence. Entrepreneurship Education, 6(3), 229–244. https://doi.org/10.1007/s41959-023-00099-x

Bengochea, A., & Sembiante, S. F. (2024). Effective vocabulary interventions for young emergent bilinguals: A best-evidence synthesis. Review of Education, 12(1), 1-39. https://doi.org/10.1002/rev3.3458

Chen, L., & Wang, P. (2022). Gamification and artificial intelligence: A systematic mapping study. In Proceedings of the International Conference on Learning and Collaboration Technologies (pp. 102–115). Springer. https://doi.org/10.1007/978-3-031-05581-2_8

Cheng, V. W. S., Davenport, T., Johnson, D., Vella, K., & Hickie, I. B. (2021). Psychological interventions of virtual gamification within academic intrinsic motivation: A systematic review. Journal of Affective Disorders, 293, 444–465. https://doi.org/10.1016/j.jad.2021.06.070

Cohen, L., Manion, L., & Morrison, K. (2018). Research methods in education (8th ed.). Routledge. https://doi.org/10.4324/9781315456539

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). Sage Publications. ISBN: 978-1-4522-2610-1

Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(1), 1-22. https://doi.org/10.1186/s41239-023-00392-8

Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International Journal of Educational Research, 102, 1-13. https://doi.org/10.1016/j.ijer.2020.101586

Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? A literature review of empirical studies. In Proceedings of the 47th Hawaii International Conference on System Sciences (pp. 3025–3034). IEEE. https://doi.org/10.1109/HICSS.2014.377

Huang, S. J., & Wu, C. H. (2021). Gamified project-based learning in higher education: Impacts on student engagement. Computers & Education, 172, 104256. https://doi.org/10.1016/j.compedu.2021.104256

Hussein, B. (2021). Addressing collaboration challenges in project-based learning: The student’s perspective. Education Sciences, 11(8), 1-20. https://doi.org/10.3390/educsci11080434

Koedinger, K. R., McLaughlin, S., & Stamper, E. A. (2022). Automated feedback in AI-based learning systems. International Journal of Artificial Intelligence in Education, 32(3), 589–610. https://doi.org/10.1007/s40593-021-00270-5

Kokotsaki, M., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools, 19(3), 267–277. https://doi.org/10.1177/1365480216659733

Lavoue, E., Ju, Q., Hallifax, S., & Serna, A. (2021). Analyzing the relationships between learners’ motivation and observable engaged behaviors in a gamified learning environment. International Journal of Human-Computer Studies, 154, 1-40. https://doi.org/10.1016/j.ijhcs.2021.102670

Maier, U., & Klotz, C. (2022). Personalized feedback in digital learning environments: Classification framework and literature review. Computers and Education: Artificial Intelligence, 3, 1-13. https://doi.org/10.1016/j.caeai.2022.100080

Maphosa, V., & Maphosa, M. (2023). Artificial intelligence in higher education: A bibliometric analysis and topic modeling approach. Applied Artificial Intelligence, 37(1), 1-23. https://doi.org/10.1080/08839514.2023.2261730

Makkonen, T., Tirri, K., & Lavonen, J. (2021). Engagement in learning physics through project-based learning: A case study of gifted Finnish upper-secondary-level students. Journal for the Education of the Gifted, 44(4), 247–274. https://doi.org/10.1177/1932202X211018644

Mishra, P., Pandey, C. M., Singh, U., Gupta, A., Sahu, C., & Keshri, A. (2019). Descriptive statistics and normality tests for statistical data. Annals of Cardiac Anaesthesia, 22(1), 67–72. https://doi.org/10.4103/aca.ACA_157_18

Park, J.-H., Kim, S.-J., & Lee, S.-T. (2025). AI and creativity in entrepreneurship education: A systematic review of LLM applications. AI, 6(5), 1-22. https://doi.org/10.3390/ai6050100

Pratama, R. P., & Mulyana, A. S. (2021). Implementasi model project-based learning pada pembelajaran kewirausahaan di perguruan tinggi. Jurnal Pendidikan Bisnis dan Manajemen, 7(1), 12–25. https://doi.org/10.17977/um003v7i12021p012

Rafique, G. M., Mahmood, K., Warraich, N. F., & Rehman, S. U. (2021). Readiness for online learning during COVID-19 pandemic: A survey of Pakistani LIS students. The Journal of Academic Librarianship, 47(3), 1-10. https://doi.org/10.1016/j.acalib.2021.102346

Rivera, E. S., & Garden, C. L. P. (2021). Gamification for student engagement: A framework. Journal of Further and Higher Education, 45(7), 999–1012. https://doi.org/10.1080/0309877X.2021.1875201

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.

Wang, J., Li, X., & Liang, H. (2022). A new exact p-value approach for testing variance homogeneity. Statistical Theory and Related Fields, 6(1), 81–86. https://doi.org/10.1080/24754269.2021.1907519

What Works Clearinghouse. (2022). What Works Clearinghouse procedures and standards handbook, version 5.0. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.

Winkler, C., Hammoda, B., Noyes, E., & Van Gelderen, M. (2023). Entrepreneurship education at the dawn of generative artificial intelligence. Entrepreneurship Education and Pedagogy, 6(4), 1-11. https://doi.org/10.1177/25151274231198799

Yang, D. (2022). The impact of adaptive learning in entrepreneurial behavior for college students. Frontiers in Psychology, 12, 1-13. https://doi.org/10.3389/fpsyg.2021.797459

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1-27. https://doi.org/10.1186/s41239-019-0171-0

Zen, Z., Reflianto, Syamsuar, & Ariani, F. (2022). Academic achievement: The effect of project-based online learning method and student engagement. Heliyon, 8(11), 1-13. https://doi.org/10.1016/j.heliyon.2022.e11509

Downloads

Published

2026-08-13

How to Cite

Prastica, S. A., Wedi, A., Aulia, F., Degeng, M. D. K., & Jumbri, I. A. (2026). Establishing pre-intervention baseline equivalence for AI-supported gamified project-based learning in entrepreneurship education. Jurnal Inovasi Dan Teknologi Pembelajaran, 13(2), 102–112. https://doi.org/10.17977/um031v13i22026p102

Issue

Section

Articles

Most read articles by the same author(s)