Students attitudes on STACK content: A pilot study at the university of Trieste, Italy
DOI:
https://doi.org/10.58524/jasme.v4i1.357Keywords:
Higher Education, Online Assessment, Online Exams, STACKAbstract
Background: Online examinations are increasingly prevalent in educational settings, offering innovative assessment methods. Understanding student perceptions and experiences with such systems is essential for enhancing their effectiveness and acceptance in educational practice.
Aims: This pilot study aimed to examine the impact of STACK-based online exams on various facets such as student comfort, perceived value for learning and exam preparation, preferences between pen-and-paper versus STACK formats, confidence in online math tests, readiness to adopt online assessment platforms, and overall perspectives on online evaluations.
Method: An experimental within-subjects design and convenience sampling were used to involve 117 first-year biology students enrolled in a Probability and Statistics course, who were already familiar with the STACK system. Data were collected using pre- and post-exam online surveys featuring five-point Likert scale questions and an open-ended query.
Results: The findings indicate that students felt more comfortable using the STACK system after the study and preferred it over traditional exams. Nevertheless, some students expressed uncertainty about using STACK content for final exams due to concerns about its effectiveness in evaluating critical thinking and potential technical difficulties. However, concerns regarding technical challenges decreased significantly post-exam, with no technical issues reported during the exam. Positive feedback highlighted STACK's benefits for formative assessment, easier learning, immediate feedback, and its practicality and innovation. Some students even suggested incorporating STACK into final exams for convenience and advocated for further investment in the STACK system, possibly with improved content.
Conclusion: In summary, students preferred using STACK for exams, though concerns about technical glitches and the need to refine content for assessing critical thinking persist. Future efforts should focus on enhancing content quality, starting this summer.
References
Acosta-Gonzaga, E., & Walet, N. R. (2018). The role of attitudinal factors in mathematical on-line assessments: A study of undergraduate STEM students. Assessment & Evaluation in Higher Education, 43(5), 710–726. https://doi.org/10.1080/02602938.2017.1401976
Almaiah, M. A., Hajjej, F., Lutfi, A., Al-Khasawneh, A., Shehab, R., Al-Otaibi, S., & Alrawad, M. (2022). Explaining the factors affecting students’ attitudes to using online learning (Madrasati Platform) during COVID-19. Electronics, 11(7), 973. https://doi.org/10.3390/electronics11070973
Baleni, Z. G. (2015). Online formative assessment in higher education: Its pros and cons. Electronic Journal of E-Learning, 13(4), pp228-236.
Beliauskene, E., & Yanuschik, O. (2021). STACK Assessment in Mathematics Classroom: Advantages and Disadvantages. Educating Engineers for Future Industrial Revolutions: Proceedings of the 23rd International Conference on Interactive Collaborative Learning (ICL2020), Volume 1, 1, 174. https://doi.org/10.1007/978-3-030-68198-2_15
Bertram, D. (2007). Likert scales. Retrieved November, 2(10).
Bishop, J. P., Hardison, H. L., & Przybyla-Kuchek, J. (2022). Responsiveness to students’ mathematical thinking in middle-grades classrooms. Journal for Research in Mathematics Education, 53(1), 10–40. https://doi.org/10.5951/jresematheduc-2020-0188
Butler-Henderson, K., & Crawford, J. (2020). A systematic review of online examinations: A pedagogical innovation for scalable authentication and integrity. Computers & Education, 159, 104024. https://doi.org/10.1016/j.compedu.2020.104024
Cézar, R. F., Pinto, N. S., & Garrido, D. (2021). Can Mathematics Achievement Be Predicted? The Role of Cognitive–Behavioral–Emotional Variables. Mathematics, 9(14). https://doi.org/10.3390/math9141591
Chandra, Y., & Shang, L. (2019). Qualitative research using R: A systematic approach. https://doi.org/10.1007/978-981-13-3170-1
Charness, G., Gneezy, U., & Kuhn, M. A. (2012). Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior & Organization, 81(1), 1–8. https://doi.org/10.1016/j.jebo.2011.08.009
Chen, B., Bastedo, K., & Howard, W. (2018). Exploring best practices for online STEM courses: active learning, interaction & assessment design. Online Learning, 22(2), 59. https://doi.org/10.24059/olj.v22i2.1369
Csapó, B., & Molnár, G. (2019). Online Diagnostic Assessment in Support of Personalized Teaching and Learning: The eDia System. Frontiers in Psychology, 10, 1522. https://doi.org/10.3389/fpsyg.2019.01522
Erskine, G., & Mestel, B. (2018). Developing STACK practice questions for the Mathematics Masters Programme at the Open University. MSOR Connections, 17(1). https://doi.org/10.21100/msor.v17i1.896
Facer, K. (2011). Learning futures: Education, technology and social change. Routledge. https://doi.org/10.4324/9780203817308
Gagne, R. (1985). The conditions of learning and theory of instruction Robert Gagné. New York, NY: Holt, Rinehart Ja Winston. https://www.ilkogretim-online.org/fulltext/218-1596909338.pdf
García-Peñalvo, F. J., Corell, A., Abella-García, V., & Grande-de-Prado, M. (2021). Recommendations for Mandatory Online Assessment in Higher Education During the COVID-19 Pandemic. In D. Burgos, A. Tlili, & A. Tabacco (Eds.), Radical Solutions for Education in a Crisis Context: COVID-19 as an Opportunity for Global Learning (pp. 85–98). Springer. https://doi.org/10.1007/978-981-15-7869-4_6
Hachey, A. C., Conway, K. M., Wladis, C., & Karim, S. (2022). Post-secondary online learning in the U.S.: An integrative review of the literature on undergraduate student characteristics. Journal of Computing in Higher Education, 34(3), 708–768. https://doi.org/10.1007/s12528-022-09319-0
Han, S., & Liou-Mark, J. (2023). Self-efficacy and attitudes towards mathematics of undergraduates: A US and Taiwan comparison. Journal of Mathematics Education, 1–15.
Hsu, C.-Y., & Wu, T.-T. (2023). Applications of Business Simulation Games in Flipped Classrooms to Facilitate Student Engagement and Higher-Order Thinking Skills for Sustainable Learning Practices. https://doi.org/10.20944/preprints202311.0082.v1
Idrizi, A., Gordon, A. M., Lam, A., Conway, C., & Saleh, A. (2023). The effect of the coronavirus disease 2019 (COVID-19) pandemic on elective cervical spine surgery utilization and complications in the United States: a nationwide temporal trends analysis. World Neurosurgery, 170, e1-e8. https://doi.org/10.1016/j.wneu.2022.07.095
Jamil, M. (2012). Perceptions of University Students regarding Computer Assisted Assessment. Turkish Online Journal of Educational Technology - TOJET, 11(3), 267–277.
Juma, Z. O. (2023). Analysis of the impact of the stack system on learner engagement, performance, and perception on its use in mathematics at Maseno University, Kenya [Thesis, Maseno University]. https://repository.maseno.ac.ke/handle/123456789/5944
Krohne, H. W. (2002). Stress and coping theories. Int Encyclopedia of the Social Behavioral Sceinces [cited 2021]. https://doi.org/10.1016/B0-08-043076-7/03817-1
King, D. (2023). Assessing the benefits of online formative assessments on student performance. Journal of Learning Development in Higher Education. https://doi.org/10.47408/jldhe.vi27.883
Li, Y., & Schoenfeld, A. H. (2019). Problematizing teaching and learning mathematics as “given” in STEM education. International Journal of STEM Education, 6(1). https://doi.org/10.1186/s40594-019-0197-9
Mahlangu, G., & Makwasha, L. (2023). Factors affecting the adoption and use of online assessment for learning at Polytechnics in Zimbabwe. Cogent Education, 10(1), 2177475. https://doi.org/10.1080/2331186X.2023.2177475
Mäkelä, A.-M., Ali-Löytty, S., Humaloja, J.-P., Joutsenlahti, J., Kauhanen, J., & Kaarakka, T. (2016). STACK assignments in university mathematics education. Annual Conference Of The European Society For Engineering Education.
Meng, C. C., Idris, N., & Eu, L. K. (2014). Secondary students' perceptions of assessments in science, technology, engineering, and mathematics (STEM). Eurasia Journal of Mathematics, Science and Technology Education, 10(3), 219-227. https://doi.org/10.12973/eurasia.2014.1070a
Moodle plugins directory: STACK. (2024, January 30). https://moodle.org/plugins/qtype_stack
Nakamura, Y., Fukazawa, K., & Nakahara, T. (2013). Development of Portable STACK: Packaged Math e-Learning System. E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, 2468–2473. https://www.learntechlib.org/p/115256/
Nakamura, Y., Ohmata, Y., & Nakahara, T. (2012). Development of a question-authoring tool for math e-learning system stack. IADIS International Conference E-Learning, 435–440.
Nakamura, Y., Taniguchi, T., & Nakahara, T. (2014). Item Bank System for the Mathematics e-Learning System STACK. Electronic Journal of Mathematics & Technology, 8(5).
Olasina, G. (2023). Using new assessment tools during and post-COVID-19. Library Philosophy & Practice (e-Journal). https://digitalcommons.unl.edu/libphilprac/7902.
Oyengo, M. O., Parsons, D., Stern, D., & Sangwin, C. (2021). Providing student feedback through electronic assessment for linear algebra at Maseno University, Kenya. International Meeting of the STACK Community 2021. Zenodo. https://doi.org/10.5281/zenodo.5035969
Raman, R., B, S., G, V., Vachharajani, H., & Nedungadi, P. (2021). Adoption of online proctored examinations by university students during COVID-19: Innovation diffusion study. Education and Information Technologies, 26(6), 7339–7358. https://doi.org/10.1007/s10639-021-10581-5
Sangwin, C. (2015). Computer aided assessment of mathematics using STACK. Selected Regular Lectures from the 12th International Congress on Mathematical Education, 695–713. https://doi.org/10.1007/978-3-319-17187-6_39
Sangwin, C. J., & Hermans, D. F. M. (2013). A Report on the Use of STACK in Mathematics at Birmingham 2012–2013. The CULMS Newsletter, 16.
Serutla, L., Mwanza, A., Celik, T., Serutla, L., Mwanza, A., & Celik, T. (2024). Online Assessments in a Changing Education Landscape. In Reimagining Education—The Role of E-Learning, Creativity, and Technology in the Post-Pandemic Era. IntechOpen. https://doi.org/10.5772/intechopen.1002176
Singh, M. N. (2021). Inroad of digital technology in education: Age of digital classroom. Higher Education for the Future, 8(1), 20–30. https://doi.org/10.1177/2347631117740452
Tai, R. H., Taylor, J. A., Reddy, V., & Banilower, E. R. (2022). The Contribution of Large Educational Surveys to Science Teacher Education Research. Handbook of Research on Science Teacher Education, 16–27. https://doi.org/10.4324/9781003098478-3
Thomas Bickerton, R., & J Sangwin, C. (2022). Practical online assessment of mathematical proof. International Journal of Mathematical Education in Science and Technology, 53(10), 2637–2660. https://doi.org/10.1080/0020739X.2021.1896813
Tursyngozhayev, K., Kavak, N., & Akhmetov, N. K. (2024). Enhancing Chemistry Education for Students through a Novel Card Game: Compound Chain. Journal of Chemical Education, 101(3). https://doi.org/10.1021/acs.jchemed.3c00983
Vallerand, R. J. (2000). Deci and Ryan's self-determination theory: A view from the hierarchical model of intrinsic and extrinsic motivation. Psychological inquiry, 11(4), 312-318.
Wladis, C., Conway, K. M., & Hachey, A. C. (2015). The online STEM classroom—Who succeeds? An exploration of the impact of ethnicity, gender, and non-traditional student characteristics in the community college context. Community College Review, 43(2), 142-164. Zerva, K. (2020). STACK: An assessment system for mathematics in Moodle quiz. https://doi.org/10.1177/0091552115571729
Wood, M. J., Wilson, H. M., & Parry, S. L. (2021). Exploring the development and maintenance of therapeutic relationships through e-Health support: A narrative analysis of therapist experiences. Medicine Access@ Point of Care, 5, 23992026211018087. https://doi.org/10.1177/23992026211018087
Zhao, Y., & Watterston, J. (2021). The changes we need: Education post COVID-19. Journal of Educational Change, 22(1), 3–12. https://doi.org/10.1007/s10833-021-09417-3
Downloads
Published
Issue
Section
License
Authors who publish with Journal of Advanced Sciences and Mathematics Education agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
Journal of Advanced Sciences and Mathematics Education is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
