Developing a scaffolding chatbot to enhance mathematical problem-solving skills in three-variable linear equation systems

Hardiana Tri Wulandari; Santi Irawati; Susiswo

doi:10.58524/jasme.v6i3.1459

Authors

Hardiana Tri Wulandari Universitas Negeri Malang, Indonesia
Santi Irawati Universitas Negeri Malang, Indonesia https://orcid.org/0000-0003-0516-6723
Susiswo Universitas Negeri Malang, Indonesia

DOI:

https://doi.org/10.58524/jasme.v6i3.1459

Keywords:

Chatbot Scaffolding, Problem-Solving Skills, Systems Of Linear Equations, With Three Variables

Abstract

Background: Although chatbots are increasingly used in mathematics education, many primarily deliver direct answers or explanations, offering limited scaffolding to guide students systematically through mathematical problem solving.

Aims: This study aimed to develop and evaluate a scaffolding chatbot designed to enhance students’ mathematical problem-solving skills in Three-Variable Linear Equation Systems.

Method: A research and development approach employing the ADDIE model was conducted with 23 eleventh-grade students. Data were collected through expert validation, teacher and student practicality questionnaires, and pretest–posttest mathematical problem-solving assessments. Data analysis included descriptive statistics, normalized gain (N-gain), the Wilcoxon Signed-Rank Test, and effect size.

Results: The chatbot achieved 80.28% validity, while teacher and student practicality scores reached 82.50% and 86.16%, respectively. Students demonstrated moderate improvement (N-gain = 0.45), with a significant difference between pretest and posttest scores (Z = 3.939, p < .05) and a large effect size (r = 0.82).

Conclusion: The developed scaffolding chatbot demonstrated strong validity and practicality and provided promising evidence for supporting mathematical problem-solving development through gradual guidance, prompts, and feedback rather than direct solutions.

References

Adebanjo, S. A., Mohammed, A. O., & Ariyibi, O. O. (2025). Developing Problem-Solving skills in students through instructional scaffolding. Asian Journal of Assessment in Teaching and Learning, 15(1), 36–48. https://doi.org/10.37134/ajatel.vol15.1.3.2025

Ahsan, A., McDonald, H., Saha, R., & Davison, C. (2026). When AI speaks the curriculum: From generic chatbots to Context-Aware learning systems. Systems, 14(7). https://doi.org/10.3390/systems14070791

Alanazi, A. A., Osman, K., & Halim, L. (2025). Development of Technology-Enhanced higher order thinking learning module based on scaffolding and guided discovery approaches. In M. E. Auer & D. May (Eds.), 2024 yearbook emerging technologies in learning (pp. 485–509). Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-80388-8_26

Ariski, B., & Arni, Y. (2023). Analysis of learners' errors to solve problems on Three-Variable linear equation system material based on Newman stages. Journal of Research on Mathematics Instruction (JRMI), 4(2), 38–48. https://doi.org/10.33578/jrmi.v4i2.90

Awang, L. A., Yusop, F. D., & Danaee, M. (2025). Current practices and future direction of artificial intelligence in mathematics education: A systematic review. International Electronic Journal of Mathematics Education, 20(2), em0823. https://doi.org/10.29333/iejme/16006

Azevedo, R., Bouchet, F., Duffy, M., Harley, J., Taub, M., Trevors, G., Cloude, E., Dever, D., Wiedbusch, M., Wortha, F., & Cerezo, R. (2022). Lessons learned and future directions of MetaTutor: Leveraging multichannel data to scaffold Self-Regulated learning with an intelligent tutoring system. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.813632

Bai, S., Lo, C. K., & Yang, C. (2025). Enhancing instructional design learning: A comparative study of scaffolding by a 5E instructional model-informed artificial intelligence chatbot and a human teacher. Interactive Learning Environments, 33(3), 2738–2757. https://doi.org/10.1080/10494820.2024.2420184

Bayaga, A. (2024). Enhancing mathematics problem-solving skills in AI-driven environment: Integrated SEM-neural network approach. Computers in Human Behavior Reports, 16, 100491. https://doi.org/10.1016/j.chbr.2024.100491

Çakmak Gürel, Z. (2025). Indication of scaffolding in mathematical modeling. International Journal of Science and Mathematics Education, 23(7), 2597–2628. https://doi.org/10.1007/s10763-025-10576-5

Chaiprasurt, C., Amornchewin, R., & Kunpitak, P. (2022). Using motivation to improve learning achievement with a chatbot in blended learning. World Journal on Educational Technology: Current Issues, 14(4), 1133–1151. https://doi.org/10.18844/wjet.v14i4.6592

Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports Self-Regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(17). https://doi.org/10.3390/su151712921

Chau, D. B., Luong, V. T., Long, T. T., & Linh, N. T. T. (2025). Personalized mathematics teaching with the support of AI chatbots to improve mathematical Problem-Solving competence for high school students in Vietnam. European Journal of Educational Research, 14(1), 323–333. https://doi.org/10.12973/eu-jer.14.1.323

Chen, Q., Gong, Y., Wang, M., Lin, J., Gu, H., Peng, H., & Chi, H. (2026). Generative scaffolding in Pre-Trip games: Effects of a GenAI-Chatbot on Inquiry-Based learning. Journal of Educational Computing Research, 07356331261474369. https://doi.org/10.1177/07356331261474369

Cheng, L., Croteau, E., Baral, S., Heffernan, C., & Heffernan, N. (2024). Facilitating student learning with a chatbot in an online math learning platform. Journal of Educational Computing Research, 62(4), 687–717. https://doi.org/10.1177/07356331241226592

Ding, J., Liu, H., & Slotta, J. D. (2026). Integrating AI-enhanced 4C/ID scaffolding into rural STEM education: Supporting complex problem solving and learning outcomes. Interactive Learning Environments, 0(0), 1–16. https://doi.org/10.1080/10494820.2026.2616415

Faber, T. J. E., Dankbaar, M. E. W., van den Broek, W. W., Bruinink, L. J., Hogeveen, M., & van Merriënboer, J. J. G. (2024). Effects of adaptive scaffolding on performance, cognitive load and engagement in game-based learning: A randomized controlled trial. BMC Medical Education, 24(1), 943. https://doi.org/10.1186/s12909-024-05698-3

Guler, N. K., Dertli, Z. G., Boran, E., & Yildiz, B. (2024). An artificial intelligence application in mathematics education: Evaluating ChatGPT's academic achievement in a mathematics exam. Pedagogical Research, 9(2). https://doi.org/10.29333/pr/14145

Guo, K., Wang, J., & Chu, S. K. W. (2022). Using chatbots to scaffold EFL students' argumentative writing. Assessing Writing, 54, 100666. https://doi.org/10.1016/j.asw2022.100666

Han, S., & Kim, H. M. (2020). Components of mathematical problem solving competence and mediation effects of instructional strategies for mathematical modeling. Education and Science, 45(202), 93–111. https://doi.org/10.15390/EB.2020.7386

Hidayanto, E., & Lisrahmat, M. N. (2023). Analisis kesalahan siswa dalam menyelesaikan soal cerita sistem persamaan linier tiga variabel (SPLTV) berdasarkan prosedur Newman. JIPM (Jurnal Ilmiah Pendidikan Matematika), 12(1), 153–165. https://doi.org/10.25273/jipm.v12i1.13106

Huda, N., Anwar, K., Novferma, & W. K. (2025). ChatGPT scaffolding in supporting metacognition for limit concepts in guided inquiry mathematics learning. Journal of Information Technology Education: Research, 24, 038.

Jančařík, A., Michal, J., & Novotná, J. (2023). Using AI chatbot for math tutoring. Journal of Education Culture and Society, 14(2), 285–296. https://doi.org/10.15503/jecs2023.2.285.296

Kaplar, M., Kaplar, S., Vučić, M., Ivanović, L., Stevanović, A., Milenković, A., & Vučićević, N. (2026). SPARK_AI: A Prompt-Orchestrated architecture for stateful, Process-Oriented reasoning with large language models. Informatics, 13(4). https://doi.org/10.3390/informatics13040063

Lamowa, R. A., Irawati, S., & Subanji, S. (2022). Proses metakognitif siswa dalam menyelesaikan masalah matematika berdasarkan gaya belajar VAK (visual, auditori, dan kinestetik). Jurnal Kajian Pembelajaran Matematika, 6(1), 38–47. https://doi.org/10.17977/um076v6i12022p38-47

Leavy, A., & Hourigan, M. (2020). Posing mathematically worthwhile problems: Developing the problem-posing skills of prospective teachers. Journal of Mathematics Teacher Education, 23(4), 341–361. https://doi.org/10.1007/s10857-018-09425-w

Lee, D., Son, T., & Yeo, S. (2025). Impacts of interacting with an AI chatbot on preservice teachers' responsive teaching skills in math education. Journal of Computer Assisted Learning, 41(1), e13091. https://doi.org/10.1111/jcal.13091

Lee, D., & Yeo, S. (2022). Developing an AI-based chatbot for practicing responsive teaching in mathematics. Computers & Education, 191, 104646. https://doi.org/10.1016/j.compedu.2022.104646

Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023). Effects of real-time analytics-based personalized scaffolds on students' self-regulated learning. Computers in Human Behavior, 139, 107547. https://doi.org/10.1016/j.chb.2022.107547

Liu, J., Keane, T., Sun, D., Yang, Y., & Yang, Y. (2025). Design and evaluation of ChatGPT-MWPS: An AI-enhanced learning system for improving primary students' mathematical word problem solving. Smart Learning Environments, 12(1), 68. https://doi.org/10.1186/s40561-025-00419-9

Looi, C.-K., Liu, Z., & Sun, D. (2026). Taming the black box: Design principles for rule-integrated LLM tutoring systems in primary school mathematical problem solving. Computers and Education: Artificial Intelligence, 10, 100586. https://doi.org/10.1016/j.caeai.2026.100586

Munshi, A., Biswas, G., Baker, R., Ocumpaugh, J., Hutt, S., & Paquette, L. (2023). Analysing adaptive scaffolds that help students develop self-regulated learning behaviours. Journal of Computer Assisted Learning, 39(2), 351–368. https://doi.org/10.1111/jcal.12761

Puntambekar, S. (2022). Distributed scaffolding: Scaffolding students in classroom environments. Educational Psychology Review, 34(1), 451–472. https://doi.org/10.1007/s10648-021-09636-3

Santika, L., Wahidin, & Supriadi, E. (2025). Revolusi belajar matematika: Eksplorasi pengaruh media digital interaktif terhadap hasil belajar siswa di sekolah menengah pertama. International Journal of Progressive Mathematics Education, 5(1), 193–205. https://doi.org/10.22236/ijopme.v5i1.19136

Sarmiento-Campos, N.-V., Lázaro-Guillermo, J. C., Silvera-Alarcón, E.-N., Cuellar-Quispe, S., Huamán-Romaní, Y.-L., Apaza, O. A., & Sorkheh, A. (2022). A look at Vygotsky's sociocultural theory (SCT): The effectiveness of scaffolding method on EFL learners' speaking achievement. Education Research International, 2022(1), 3514892. https://doi.org/10.1155/2022/3514892

Setiani, Y., Ruhiat, Y., & Hendrayana, A. (2025). Needs analysis for designing hybrid learning with Problem-Based scaffolding to enhance mathematical Problem-Solving skills. Journal of Mathematics Instruction, Social Research and Opinion, 4(2), 443–454. https://doi.org/10.58421/misro.v4i2.459

Shahbari, J. A. (2026). ChatGPT Bot-Mediated modeling: Tracing prospective teachers' modeling processes through an instrumental genesis lens. International Journal of Science and Mathematics Education, 24(5), 43. https://doi.org/10.1007/s10763-026-10668-w

Sofnidar, S., Anwar, K., & Anum, P. (2023). Pengembangan media chatbot scaffolding untuk mendukung pembelajaran project based learning secara daring. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 12(2), 2586–2598. https://doi.org/10.24127/ajpm.v12i2.7017

Soyoof, A., Reynolds, B. L., Rassaei, E., Kao, C.-W., & Van Ha, X. (2026). From teachers to chatbots: Scaffolded corrective feedback and student trust in online L2 english classrooms. Computers and Education: Artificial Intelligence, 10, 100530. https://doi.org/10.1016/j.caeai.2025.100530

Straková, N., & Válek, J. (2024). Chatbots as a learning tool: Artificial intelligence in education. R&E-SOURCE, 245-265. https://doi.org/10.53349/resource.2024.is1.a1259

Swanepoel, N. (2026). Scaffolding word problem-solving instruction: Leveraging critical thinking and mathematics vocabulary. African Journal of Teacher Education and Development, 5(1), Article 1. https://doi.org/10.4102/ajoted.v5i1.155

Szabo, Z. K., Körtesi, P., Guncaga, J., Szabo, D., & Neag, R. (2020). Examples of Problem-Solving strategies in mathematics education supporting the sustainability of 21st-century skills. Sustainability, 12(23). https://doi.org/10.3390/su122310113

Torres-Peña, R. C., Peña-González, D., Lara-Orozco, J. L., Ariza, E. A., & Vergara, D. (2025). Enhancing numerical thinking through problem solving: A teaching experience for Third-Grade mathematics. Education Sciences, 15(6). https://doi.org/10.3390/educsci15060667

Vo, K., Sarkar, M., White, P. J., & Yuriev, E. (2025). Exploring Problem-Solving scaffolds in general chemistry: A systematic review of scaffolding goals and instructional approaches. Journal of Chemical Education, 102(3), 1004–1018. https://doi.org/10.1021/acs.jchemed.4c01327

Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes. Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4

Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89–100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x

Zhang, C., Cai, D., Liao, P., Su, J.-W., Deng, H., Vardhanabhuti, B., Ulery, B. D., Chen, S.-Y., & Lin, J. (2021). 4D printing of shape-memory polymeric scaffolds for adaptive biomedical implantation. Acta Biomaterialia, 122, 101–110. https://doi.org/10.1016/j.actbio.2020.12.042

Zhou, R., He, X., Fan, Q., Li, Y., Li, Y., Xiao, X., & Fang, J. (2025). Exploring ChatGPT-Facilitated scaffolding in undergraduates' mathematical problem solving. Journal of Computer Assisted Learning, 41(4), e70077. https://doi.org/10.1111/jcal.70077