AI-based smart web ecosystem for differentiated instruction and integrated assessment of fishery ecology observation report texts

Authors

DOI:

https://doi.org/10.17977/um031v13i22026p139%20

Keywords:

Differentiated instruction, pedagogical agent, automated writing evaluation, observation report text, ecological literacy, vocational education

Abstract

Differentiated instruction is widely endorsed, but its implementation is limited by the preparation time required to map learner profiles and by the interval between the submission of a draft and the return of comments. This study examined the validity, practicality and effectiveness of WETEL–GAIS, a web ecosystem whose closed-domain agent, Eko-Bot, conducts Bayesian diagnostic profiling, routes students to multimodal content, provides Sentence-BERT formative scaffolding, and sets a transmediation task for summative assessment of observation report (LHO) writing on fishery ecology. An explanatory sequential mixed-methods design was employed, its quantitative strand a nonequivalent pretest–posttest control group quasi-experiment involving 66 Year 10 vocational students at SMKN 1 Sidayu Gresik, allocated by cluster random sampling to experimental (n = 33) and control (n = 33) classes. Data were analysed using Kolmogorov–Smirnov and Levene tests, independent-samples t-tests, Hake's normalised gain and Cohen's d, and triangulated with interview, observation and telemetry data. The ecosystem proved highly valid (92.43%) and highly practical (teachers 91.25%; students 88.71%), and its profiling agreed with a standard questionnaire in 87.88% of cases. Normalised gain in writing reached 0.61 against 0.34, t(64) = 9.216, p < 0.001, d = 2.27, and in ecological literacy 0.49 against 0.26.

Author Biographies

Alfian Arif Bintara, Universitas Islam Malang

Pendidikan Bahasa Indonesia

Sri Wahyuni, Universitas Islam Malang

Pendidikan Bahasa Indonesia

Hasan Argadinata, Universitas Negeri Malang

Education Management

References

Alfarwan, A. (2025). Generative AI use in K-12 education: A systematic review. Frontiers in Education, 10, 1647573. https://doi.org/10.3389/feduc.2025.1647573

Asriadi, M. A., Hadi, S., Istiyono, E., & Retnawati, H. (2023). Does differentiated instruction affect learning outcome? Systematic review and meta-analysis. Journal of Pedagogical Research, 7(5), 18–33. https://doi.org/10.33902/JPR.202322021

Astawa, I. N. (2025). Exploring ecolinguistics: A new paradigm for tourism language learning. Englisia: Journal of Language, Education, and Humanities, 12(2). https://doi.org/10.22373/ej.v12i2.27648

Branch, R. M. (2009). Instructional design: The ADDIE approach. Springer. https://doi.org/10.1007/978-0-387-09506-6

Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354

Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications.

Digna, D., Minsih, M., & Widyasari, C. (2024). Teachers' perceptions of differentiated learning in the independent curriculum. Indonesian Journal of Elementary Education, 7(2). https://doi.org/10.23887/ijee.v7i2.54770

Fadhilah, M. N. (2025). Pemanfaatan gamifikasi dalam ekopedagogi untuk meningkatkan literasi anak. Ghancaran: Jurnal Pendidikan Bahasa dan Sastra Indonesia. https://doi.org/10.19105/ghancaran.vi.17198

Fahriani, D. K., & Karkono, K. (2024). Dampak strategi pembelajaran berdiferensiasi terhadap hasil belajar menulis surat. Journal of Language Literature and Arts, 4(11), 1110–1116. https://doi.org/10.17977/um064v4i112024p1110-1116

Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023). Automated feedback and writing: A multi-level meta-analysis of effects on students' performance. Frontiers in Artificial Intelligence, 6, 1162454. https://doi.org/10.3389/frai.2023.1162454

Hake, R. R. (1998). Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64–74. https://doi.org/10.1119/1.18809

Haq, E. D., Masdul, M. R., & Larasati, O. (2025). Ecopedagogy based curriculum innovation to foster environmental sustainability awareness among Indonesian Generation Z. Khazanah: Journal of Islamic Education and Science, 1(1), 17–31. https://doi.org/10.61815/khazanah.v1i1.863

Hasanah, E., Suyatno, S., Maryani, I., Al Badar, M. I., Fitria, Y., & Patmasari, L. (2022). Conceptual model of differentiated-instruction (DI) based on teachers' experiences in Indonesia. Education Sciences, 12(10), 650. https://doi.org/10.3390/educsci12100650

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487

Iskandar, A. A., Megasari, R., Nazir, S., & Riza, L. S. (2025). Development of a drill-and-practice chatbot for enhancing English pronunciation through interactive dialogue exercises. Jurnal Paedagogy, 12(4), 1185–1197. https://doi.org/10.33394/jp.v12i4.17760

Jančařík, A., & Novotná, J. (2023). Using AI chatbot for tutoring and differentiated learning scaffolding. Journal of Education Culture and Society, 14(2), 285–296. https://doi.org/10.15503/jecs2023.2.285.296

Khalifeh, F., Santiago, R., & Palau, R. (2026). Redefining personalized learning in the artificial intelligence era: An updated systematic review from 2019 to 2025. Smart Learning Environments, 13, 19. https://doi.org/10.1186/s40561-026-00440-6

Kim, M., Kim, S., & Lee, S. (2024). Designing prompt analytics dashboards to analyze student–ChatGPT interactions in EFL writing. arXiv. https://doi.org/10.48550/arXiv.2405.19691

Kirschner, P. A. (2017). Stop propagating the learning styles myth. Computers & Education, 106, 166–171. https://doi.org/10.1016/j.compedu.2016.12.006

Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon Press. https://www.sdkrashen.com/content/books/principles_and_practice.pdf

Kriswanto, M., & Fauzi, N. B. (2023). Inovasi diferensiasi produk dengan metode alih wahana pada materi teks laporan hasil observasi. Diglosia: Jurnal Kajian Bahasa, Sastra, dan Pengajarannya. https://diglosiaunmul.com/index.php/diglosia/article/view/535

Laja, Y. P. W., Delvion, E. B. S., & Siahaan, M. M. L. (2025). Chatbot artificial intelligence (AI) to supporting differentiated mathematics learning. Jurnal Pendidikan MIPA, 26(1), 118–130. https://doi.org/10.23960/jpmipa.v26i1.pp118-130

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

Lee, Y., Hwang, G., & Chen, P. (2022). Impacts of an AI-based chatbot on college students' after-class review, academic performance, self-efficacy, learning attitude, and motivation. Educational Technology Research and Development, 70, 1843–1865. https://doi.org/10.1007/s11423-022-10142-8

Li, B., Tan, Y. L., Wang, C., & Lowell, V. (2025). Two years of innovation: A systematic review of empirical generative AI research in language learning and teaching. Computers and Education: Artificial Intelligence, 9, 100445. https://doi.org/10.1016/j.caeai.2025.100445

Mayer, R. E. (2017). Using multimedia for e-learning. Journal of Computer Assisted Learning, 33(5), 403–423. https://doi.org/10.1111/jcal.12197

Miles, M. B., Huberman, A. M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook (3rd ed.). SAGE Publications.

Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054. https://doi.org/10.1111/j.1467-9620.2006.00684.x

Nabila, A. S., Prastikawati, E. F., & Lestari, M. Y. W. (2026). Leveraging Edbot.AI as a diagnostic assessment tool to enhance the students' English achievement. Linguistic, English Education and Art (LEEA) Journal, 9(2), 261–281. https://journal.ipm2kpe.or.id/index.php/LEEA/article/view/19088

Pashler, H., McDaniel, M., Rohrer, D., & Bjork, R. (2008). Learning styles: Concepts and evidence. Psychological Science in the Public Interest, 9(3), 105–119. https://doi.org/10.1111/j.1539-6053.2009.01038.x

Rachmadhani, S. A. D., & Kamalia, P. U. (2023). The effect of differentiated learning strategies on student learning outcomes. Asatiza: Jurnal Pendidikan, 4(3). https://doi.org/10.46963/asatiza.v4i3.1231

Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (pp. 3982–3992). Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1410

Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68

Sari, S. P. (2024). Penerapan strategi pembelajaran berdiferensiasi dalam pembelajaran teks biografi di SMA. Pembahsi: Jurnal Pendidikan Bahasa dan Sastra Indonesia, 14(2). https://doi.org/10.31851/pembahsi.v14i2.16304

Sholihah, F., Herlambang, Y. T., & Yuniarti, Y. (2026). Ecopedagogy for equitable green skills development in school: A systematic review. Journal of Inclusive Education and Social Welfare, 3(2). https://doi.org/10.70211/wesw.v3i2.637

Smale-Jacobse, A. E., Meijer, A., Helms-Lorenz, M., & Maulana, R. (2019). Differentiated instruction in secondary education: A systematic review of research evidence. Frontiers in Psychology, 10, 2366. https://doi.org/10.3389/fpsyg.2019.02366

Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students’ writing. Learning and Instruction, 91, 101894. https://doi.org/10.1016/j.learninstruc.2024.101894

Sutrisna, I. P. G., Bhandesa, A. M., Wulansari, N. T., & Susanta, I. P. A. E. (2025). Ecopedagogic-based education to foster ecological awareness in Indonesian language learning. Utamax: Journal of Ultimate Research and Trends in Education, 7(2), 124–135. https://doi.org/10.31849/8jrnyn11

Tomlinson, C. A. (2017). How to differentiate instruction in academically diverse classrooms (3rd ed.). ASCD.

Wicaksono, A. (2024). Differentiated approach in speaking skills learning through ChatGPT. Tarling: Journal of Language Education, 10(1). https://doi.org/10.24090/tarling.v10i1.16181

Wu, R., & Yu, Z. (2024). Do AI chatbots improve students' learning outcomes? Evidence from a meta-analysis. British Journal of Educational Technology, 55(1), 10–33. https://doi.org/10.1111/bjet.13334

Yang, C., Wang, D., & Chen, G. (2025). Chat-LAD: Enhancing teacher understanding of learning analytics dashboard with AI-empowered explanations. In Proceedings of the Twelfth ACM Conference on Learning @ Scale (pp. 197–201). Association for Computing Machinery. https://doi.org/10.1145/3698205.3733922

Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2

Downloads

Published

2026-10-13

How to Cite

Bintara, A. A., Wahyuni, S., & Argadinata, H. (2026). AI-based smart web ecosystem for differentiated instruction and integrated assessment of fishery ecology observation report texts. Jurnal Inovasi Dan Teknologi Pembelajaran, 13(2), 139–157. https://doi.org/10.17977/um031v13i22026p139

Issue

Section

Articles