Abstract
Virtual reality (VR) technology has revolutionized science, technology, engineering, arts, and mathematics (STEAM) education by simulating real-world environments, offering innovative learning methods. This study focuses on designing an educational system within VR for Arduino UNO microcontroller development. Students engage in graphical programming and hardware integration of the Arduino UNO within VR environments, implementing intelligent control of farms and traffic. This approach helps students grasp practical applications of the Arduino UNO in real production contexts, further cultivating their programming skills and fostering innovative thinking. We conducted Arduino courses tailored for programming beginners, assessing the usability of EduCodeVR and its impact on students through learning outcome tests and VR system usability assessments. The results demonstrate that EduCodeVR, which uses STEAM education methodologies, effectively enhances users’ comprehensive literacy and computational thinking, highlighting the significant potential of integrating VR programming courses into STEAM education. Through this innovative teaching approach, students not only acquire knowledge, but also enjoy the pleasures of immersive learning.















Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The student data used in this study can be accessed via Figshare at https://doi.org/https://doi.org/10.6084/m9.figshare.26148589.v2 The EduCodeVR Code accessed via Figshare at https://doi.org/https://doi.org/10.6084/m9.figshare.26176930.
References
Groening, C., Binnewies, C.: “Achievement unlocked!” - The impact of digital achievements as a gamification element on motivation and performance. Comput. Hum. Behav. 97, 151–166 (2019). https://doi.org/10.1016/j.chb.2019.02.026
Ioannou, A., Gravel, B.E.: Trends, tensions, and futures of maker education research: a 2025 vision for STEM+ disciplinary and transdisciplinary spaces for learning through making. Educ. Technol. Res. Dev. 72, 1–14 (2024). https://doi.org/10.1007/s11423-023-10334-w
Yaru G. Building a resilient education system in the post-pandemic era. China Education News (2020). http://www.jyb.cn/rmtzgjyb/202010/t20201023_367557.html. Accessed 15 Mar 2024
Ministry of Industry and Information Technology.: Interpretation of the Action Plan for the Integrated Development of Virtual Reality and Industry Applications (2022-2026). Chinese government website (2022). https://www.gov.cn/zhengce/2022-11/01/content_5723274.htm
Tito Cruz, J., Coluci, V.R., Moraes, R.: ORUN-VR2: a VR serious game on the projectile kinematics: design, evaluation, and learning outcomes. Virtual Reality 27, 2583–2604 (2023). https://doi.org/10.1007/s10055-023-00824-w
Dalinger, T., Thomas, K.B., Stansberry, S., Xiu, Y.: A mixed reality simulation offers strategic practice for pre-service teachers. Comput. Educ. 144, 103696 (2020). https://doi.org/10.1016/j.compedu.2019.103696
Moutsinas, G.A., Esponda-Pérez, J.A., Senapati, B., Sanyal, S., Patra, I., Karnaukhov, A.: Application of Virtual Reality in Education. In: Silhavy, R., Silhavy, P. (eds.) Software Engineering Research in System Science, pp. 319–326. Springer International Publishing, Cham (2023)
Ali, S.G., Wang, X., Li, P., Jung, Y., Bi, L., Kim, J., et al.: A systematic review: Virtual-reality-based techniques for human exercises and health improvement. Front. Public Health 11, 1143947 (2023). https://doi.org/10.3389/fpubh.2023.1143947
Ali, S.G., Wang, X., Li, P., Jung, Y., Bi, L., Kim, J., et al.: A systematic review: Virtual-reality-based techniques for human exercises and health improvement. Front. Public Health. (2023). https://doi.org/10.3389/fpubh.2023.1143947
Karambakhsh, A., Kamel, A., Sheng, B., Li, P., Yang, P., Feng, D.D.: Deep gesture interaction for augmented anatomy learning. Int. J. Inf. Manage. 45, 328–336 (2019). https://doi.org/10.1016/j.ijinfomgt.2018.03.004
Cheng, K.-H.: Development of an immersive virtual reality system for learning about plants in primary education: evaluation of teachers’ perceptions and learners’ flow experiences and learning attitudes. Educ. Technol. Res. Dev. 72, 845–67 (2024). https://doi.org/10.1007/s11423-023-10300-6
Zhao, Z., Wu, W.: The Effect of Virtual Reality Technology in Cross-Cultural Teaching and Training of Drones, pp. 137–147. Springer International Publishing, Cham (2022)
Bertrand, M.G., Namukasa, I.K.: A pedagogical model for STEAM education. J. Res. Innov. Teach. Learn. 16, 169–191 (2023). https://doi.org/10.1108/JRIT-12-2021-0081
Qin Dezeng, Q.J.: Research on the Interdisciplinary Integration Model of STEAM from the Perspective of Core Literacy. Theory and Practice of Educ. 38, 52–56 (2018)
Wing, J.M.: Computational thinking. Commun. ACM 49, 33–35 (2006). https://doi.org/10.1145/1118178.1118215
Arfé, B., Vardanega, T., Ronconi, L.: The effects of coding on children’s planning and inhibition skills. Comput. Educ. 148, 103807 (2020). https://doi.org/10.1016/j.compedu.2020.103807
Vaca-Cárdenas LA, Bertacchini F, Tavernise A, Gabriele L, Valenti A, Olmedo DE, et al. Coding with Scratch: The design of an educational setting for Elementary pre-service teachers. In: 2015 International Conference on Interactive Collaborative Learning (ICL) (2015). pp. 1171–7.
Beaubouef, T., Mason, J.: Why the high attrition rate for computer science students: some thoughts and observations. SIGCSE Bull. 37, 103–106 (2005). https://doi.org/10.1145/1083431.1083474
Rizvi, M., Humphries, T., Major, D., Jones, M., Lauzun, H.: A CS0 course using Scratch. J. Comput. Sci. Coll. 26, 19–27 (2011)
Papatheocharous, E., Bibi, S., Stamelos, I., Andreou, A.S.: An investigation of effort distribution among development phases: A four-stage progressive software cost estimation model. J. Software: Evolution and Process. 29, e1881 (2017). https://doi.org/10.1002/smr.1881
Jung, Y., Kong, J., Sheng, B., Kim, J.: A Transfer Function Design for Medical Volume Data Using a Knowledge Database Based on Deep Image and Primitive Intensity Profile Features Retrieval. J. Comput. Sci. Technol. 39, 320–335 (2024). https://doi.org/10.1007/s11390-024-3419-7
Zeghoud, S., Ali, S.G., Ertugrul, E., Kamel, A., Sheng, B., Li, P., et al.: Real-time spatial normalization for dynamic gesture classification. Vis. Comput. 38, 1345–1357 (2022). https://doi.org/10.1007/s00371-021-02229-9
Kamel, A., Liu, B., Li, P., Sheng, B.: An Investigation of 3D Human Pose Estimation for Learning Tai Chi: A Human Factor Perspective. Int. J. Human-Comput. Interact. 35, 427–439 (2019). https://doi.org/10.1080/10447318.2018.1543081
Chen, Z., Qiu, G., Li, P., Zhu, L., Yang, X., Sheng, B.: MNGNAS: Distilling Adaptive Combination of Multiple Searched Networks for One-Shot Neural Architecture Search. IEEE Trans. Pattern Anal. Mach. Intell. 45, 13489–13508 (2023). https://doi.org/10.1109/TPAMI.2023.3293885
Lin, X., Sun, S., Huang, W., Sheng, B., Li, P., Feng, D.D.: EAPT: Efficient Attention Pyramid Transformer for Image Processing. IEEE Trans. Multimedia 25, 50–61 (2023). https://doi.org/10.1109/TMM.2021.3120873
Xie, Z., Zhang, W., Sheng, B., Li, P., Chen, C.L.P.: BaGFN: Broad Attentive Graph Fusion Network for High-Order Feature Interactions. IEEE Trans. Neural Netw. Learn. Syst. 34, 4499–4513 (2023). https://doi.org/10.1109/TNNLS.2021.3116209
Sheng, B., Li, P., Zhang, Y., Mao, L., Chen, C.L.P.: GreenSea: Visual Soccer Analysis Using Broad Learning System. IEEE Trans. Cybern. 51, 1463–1477 (2021). https://doi.org/10.1109/TCYB.2020.2988792
Chen, Z., Gao, T., Sheng, B., Li, P., Chen, C.L.P.: Outdoor Shadow Estimating Using Multiclass Geometric Decomposition Based on BLS. IEEE Trans. Cybern. 50, 2152–2165 (2020). https://doi.org/10.1109/TCYB.2018.2875983
Liu, C.-C., Cheng, Y.-B., Huang, C.-W.: The effect of simulation games on the learning of computational problem solving. Comput. Educ. 57, 1907–1918 (2011). https://doi.org/10.1016/j.compedu.2011.04.002
Liang, H., Dong, X.: Enhancing cognitive ability through a VR serious game training model mixing Piaget’s epistemological methodology and Lumosity concept. Vis. Comput. 38, 3487–3498 (2022). https://doi.org/10.1007/s00371-022-02552-9
Zhang, L., Nouri, J.: A systematic review of learning computational thinking through Scratch in K-9. Comput. Educ. 141, 103607 (2019). https://doi.org/10.1016/j.compedu.2019.103607
Ou Yang, F.-C., Lai, H.-M., Wang, Y.-W.: Effect of augmented reality-based virtual educational robotics on programming students’ enjoyment of learning, computational thinking skills, and academic achievement. Comput. Educ. 195, 104721 (2023). https://doi.org/10.1016/j.compedu.2022.104721
Topalli, D., Cagiltay, N.E.: Improving programming skills in engineering education through problem-based game projects with Scratch. Comput. Educ. 120, 64–74 (2018). https://doi.org/10.1016/j.compedu.2018.01.011
Reber, A.S.: Implicit learning and tacit knowledge. J. Exp. Psychol. Gen. 118, 219–235 (1989). https://doi.org/10.1037/0096-3445.118.3.219
Ciavarro, C., Dobson, M., Goodman, D.: Implicit learning as a design strategy for learning games: Alert Hockey. Comput. Hum. Behav. 24, 2862–2872 (2008). https://doi.org/10.1016/j.chb.2008.04.011
Nielsen J.: Usability Engineering. Morgan Kaufmann, San Francisco (1994)
Nielsen J.: 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. https://www.nngroup.com/articles/ten-usability-heuristics/ (2024). Accessed 26 May 2024
Sutcliffe, A., Gault, B.: Heuristic evaluation of virtual reality applications. Interact. Comput. 16, 831–849 (2004). https://doi.org/10.1016/j.intcom.2004.05.001
Ricci, F.S., Boldini, A., Beheshti, M., Rizzo, J.-R., Porfiri, M.: A virtual reality platform to simulate orientation and mobility training for the visually impaired. Virtual Real. 27, 797–814 (2022). https://doi.org/10.1007/s10055-022-00691-x
Liou WK, Chang CY. Virtual reality classroom applied to science education. In: 2018 23rd International Scientific-Professional Conference on Information Technology (IT) (2018). pp. 1–4.
Radu I, Schneider B. What Can We Learn from Augmented Reality (AR)? Benefits and Drawbacks of AR for Inquiry-based Learning of Physics. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Glasgow, Scotland Uk: Association for Computing Machinery; (2019). pp. Paper 544.
Aguilar Reyes, C.I., Wozniak, D., Ham, A., Zahabi, M.: Design and evaluation of an adaptive virtual reality training system. Virtual Reality 27, 2509–2528 (2023). https://doi.org/10.1007/s10055-023-00827-7
Southgate, E.: Teachers Facilitating Student Virtual Reality Content Creation: Conceptual, Curriculum, and Pedagogical Insights. In: MacDowell, P., Lock, J. (eds.) Immersive Education: Designing for Learning, pp. 189–204. Springer International Publishing, Cham (2022)
Makransky, G., Terkildsen, T.S., Mayer, R.E.: Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn. Instr. 60, 225–236 (2019). https://doi.org/10.1016/j.learninstruc.2017.12.007
Pirker J, Holly M, Gütl C. Room Scale Virtual Reality Physics Education: Use Cases for the Classroom. In: 2020 6th International Conference of the Immersive Learning Research Network (iLRN) (2020). pp. 242–6.
Kalina E, Johnson-Glenberg MC. Presence and Platform: Effects of Embodiment Comparing a 2D Computer and 3D VR Game. In: 2020 6th International Conference of the Immersive Learning Research Network (iLRN) (2020). pp. 31–7.
Johnson-Glenberg, M.C.: The Necessary Nine: Design Principles for Embodied VR and Active Stem Education. In: Díaz, P., Ioannou, A., Bhagat, K.K., Spector, J.M. (eds.) Learning in a Digital World: Perspective on Interactive Technologies for Formal and Informal Education, pp. 83–112. Springer Singapore, Singapore (2019)
Kolb D.A.: Experiential learning: experience as the source of learning and development. Prentice Hall. Englewood Cliffs (1984)
Kolb, A.Y., Kolb D.A.: Learning styles and learning spaces: A review of the multidisciplinary application of experiential learning theory in higher education. In: Sims R.R., Sims S.J. (eds) Learning Styles and Learning, pp. 45–91. Nova Science Publishers. New York (2025)
Lave, J., Etienne, W.: Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge (1991)
Jin, Z.: EduCodeVR Code Share, https://figshare.com/articles/software/EduCodeVR_Code_Share/26176930/1, (2024). https://doi.org/10.6084/m9.figshare.26176930.v1
Likert, R.: New patterns of management. McGraw-Hill, New York. (1961).
Jin, Z.: EduCodeVR Teaching Data.xlsx, https://figshare.com/articles/dataset/EduCodeVR_xlsx/26148589/3, (2024). https://doi.org/10.6084/m9.figshare.26148589.v3
Southgate E. Using Screen Capture Video to Understand Learning in Virtual Reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (2020). pp. 418–21.
Hestenes, D., Wells, M.: A mechanics baseline test. The Physics Teacher. 30, 159–166 (1992). https://doi.org/10.1119/1.2343498
Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., Pidruzny, J.N.: The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45, 624–634 (2009). https://doi.org/10.1016/j.jesp.2009.02.016
Witmer, B.G., Singer, M.J.: Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence Teleoperators and Virtual Environments. 7, 225–40 (1998). https://doi.org/10.1162/105474698565686
Slater, M.: Implicit Learning Through Embodiment in Immersive Virtual Reality. In: Liu, D., Dede, C., Huang, R., Richards, J. (eds.) Virtual, Augmented, and Mixed Realities in Education, pp. 19–33. Springer Singapore, Singapore (2017)
Zhao J, LaFemina P, Carr J, Sajjadi P, Wallgrün JO, Klippel A. Learning in the Field: Comparison of Desktop, Immersive Virtual Reality, and Actual Field Trips for Place-Based STEM Education. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (2020). pp. 893–902.
Acknowledgements
This research was partially supported by the 2024 Gansu Provincial Special Research Project on Curriculum and Textbooks for Primary, Secondary, and Higher Education under project numbers GSJC-Z2024155.
Author information
Authors and Affiliations
Contributions
J and W were responsible for the construction of the VR system, B provided educational advice, and Q and X handled course instruction. Everyone participated in the design of the teaching curriculum. Finally, J completed the successful summary and manuscript revision.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jin, Z., Bai, Y., Song, W. et al. EduCodeVR: VR for programming teaching through simulated farm and traffic. Vis Comput (2024). https://doi.org/10.1007/s00371-024-03699-3
Accepted:
Published:
DOI: https://doi.org/10.1007/s00371-024-03699-3