Skip to main content
Log in

EduCodeVR: VR for programming teaching through simulated farm and traffic

  • Research
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Virtual reality (VR) technology has revolutionized science, technology, engineering, arts, and mathematics (STEAM) education by simulating real-world environments, offering innovative learning methods. This study focuses on designing an educational system within VR for Arduino UNO microcontroller development. Students engage in graphical programming and hardware integration of the Arduino UNO within VR environments, implementing intelligent control of farms and traffic. This approach helps students grasp practical applications of the Arduino UNO in real production contexts, further cultivating their programming skills and fostering innovative thinking. We conducted Arduino courses tailored for programming beginners, assessing the usability of EduCodeVR and its impact on students through learning outcome tests and VR system usability assessments. The results demonstrate that EduCodeVR, which uses STEAM education methodologies, effectively enhances users’ comprehensive literacy and computational thinking, highlighting the significant potential of integrating VR programming courses into STEAM education. Through this innovative teaching approach, students not only acquire knowledge, but also enjoy the pleasures of immersive learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The student data used in this study can be accessed via Figshare at https://doi.org/https://doi.org/10.6084/m9.figshare.26148589.v2 The EduCodeVR Code accessed via Figshare at https://doi.org/https://doi.org/10.6084/m9.figshare.26176930.

References

  1. Groening, C., Binnewies, C.: “Achievement unlocked!” - The impact of digital achievements as a gamification element on motivation and performance. Comput. Hum. Behav. 97, 151–166 (2019). https://doi.org/10.1016/j.chb.2019.02.026

    Article  Google Scholar 

  2. Ioannou, A., Gravel, B.E.: Trends, tensions, and futures of maker education research: a 2025 vision for STEM+ disciplinary and transdisciplinary spaces for learning through making. Educ. Technol. Res. Dev. 72, 1–14 (2024). https://doi.org/10.1007/s11423-023-10334-w

    Article  Google Scholar 

  3. Yaru G. Building a resilient education system in the post-pandemic era. China Education News (2020). http://www.jyb.cn/rmtzgjyb/202010/t20201023_367557.html. Accessed 15 Mar 2024

  4. Ministry of Industry and Information Technology.: Interpretation of the Action Plan for the Integrated Development of Virtual Reality and Industry Applications (2022-2026). Chinese government website (2022). https://www.gov.cn/zhengce/2022-11/01/content_5723274.htm

  5. Tito Cruz, J., Coluci, V.R., Moraes, R.: ORUN-VR2: a VR serious game on the projectile kinematics: design, evaluation, and learning outcomes. Virtual Reality 27, 2583–2604 (2023). https://doi.org/10.1007/s10055-023-00824-w

    Article  Google Scholar 

  6. Dalinger, T., Thomas, K.B., Stansberry, S., Xiu, Y.: A mixed reality simulation offers strategic practice for pre-service teachers. Comput. Educ. 144, 103696 (2020). https://doi.org/10.1016/j.compedu.2019.103696

    Article  Google Scholar 

  7. Moutsinas, G.A., Esponda-Pérez, J.A., Senapati, B., Sanyal, S., Patra, I., Karnaukhov, A.: Application of Virtual Reality in Education. In: Silhavy, R., Silhavy, P. (eds.) Software Engineering Research in System Science, pp. 319–326. Springer International Publishing, Cham (2023)

    Chapter  Google Scholar 

  8. Ali, S.G., Wang, X., Li, P., Jung, Y., Bi, L., Kim, J., et al.: A systematic review: Virtual-reality-based techniques for human exercises and health improvement. Front. Public Health 11, 1143947 (2023). https://doi.org/10.3389/fpubh.2023.1143947

    Article  Google Scholar 

  9. Ali, S.G., Wang, X., Li, P., Jung, Y., Bi, L., Kim, J., et al.: A systematic review: Virtual-reality-based techniques for human exercises and health improvement. Front. Public Health. (2023). https://doi.org/10.3389/fpubh.2023.1143947

    Article  Google Scholar 

  10. Karambakhsh, A., Kamel, A., Sheng, B., Li, P., Yang, P., Feng, D.D.: Deep gesture interaction for augmented anatomy learning. Int. J. Inf. Manage. 45, 328–336 (2019). https://doi.org/10.1016/j.ijinfomgt.2018.03.004

    Article  Google Scholar 

  11. Cheng, K.-H.: Development of an immersive virtual reality system for learning about plants in primary education: evaluation of teachers’ perceptions and learners’ flow experiences and learning attitudes. Educ. Technol. Res. Dev. 72, 845–67 (2024). https://doi.org/10.1007/s11423-023-10300-6

    Article  Google Scholar 

  12. Zhao, Z., Wu, W.: The Effect of Virtual Reality Technology in Cross-Cultural Teaching and Training of Drones, pp. 137–147. Springer International Publishing, Cham (2022)

    Google Scholar 

  13. Bertrand, M.G., Namukasa, I.K.: A pedagogical model for STEAM education. J. Res. Innov. Teach. Learn. 16, 169–191 (2023). https://doi.org/10.1108/JRIT-12-2021-0081

    Article  Google Scholar 

  14. Qin Dezeng, Q.J.: Research on the Interdisciplinary Integration Model of STEAM from the Perspective of Core Literacy. Theory and Practice of Educ. 38, 52–56 (2018)

    Google Scholar 

  15. Wing, J.M.: Computational thinking. Commun. ACM 49, 33–35 (2006). https://doi.org/10.1145/1118178.1118215

    Article  Google Scholar 

  16. Arfé, B., Vardanega, T., Ronconi, L.: The effects of coding on children’s planning and inhibition skills. Comput. Educ. 148, 103807 (2020). https://doi.org/10.1016/j.compedu.2020.103807

    Article  Google Scholar 

  17. Vaca-Cárdenas LA, Bertacchini F, Tavernise A, Gabriele L, Valenti A, Olmedo DE, et al. Coding with Scratch: The design of an educational setting for Elementary pre-service teachers. In: 2015 International Conference on Interactive Collaborative Learning (ICL) (2015). pp. 1171–7.

  18. Beaubouef, T., Mason, J.: Why the high attrition rate for computer science students: some thoughts and observations. SIGCSE Bull. 37, 103–106 (2005). https://doi.org/10.1145/1083431.1083474

    Article  Google Scholar 

  19. Rizvi, M., Humphries, T., Major, D., Jones, M., Lauzun, H.: A CS0 course using Scratch. J. Comput. Sci. Coll. 26, 19–27 (2011)

    Google Scholar 

  20. Papatheocharous, E., Bibi, S., Stamelos, I., Andreou, A.S.: An investigation of effort distribution among development phases: A four-stage progressive software cost estimation model. J. Software: Evolution and Process. 29, e1881 (2017). https://doi.org/10.1002/smr.1881

    Article  Google Scholar 

  21. Jung, Y., Kong, J., Sheng, B., Kim, J.: A Transfer Function Design for Medical Volume Data Using a Knowledge Database Based on Deep Image and Primitive Intensity Profile Features Retrieval. J. Comput. Sci. Technol. 39, 320–335 (2024). https://doi.org/10.1007/s11390-024-3419-7

    Article  Google Scholar 

  22. Zeghoud, S., Ali, S.G., Ertugrul, E., Kamel, A., Sheng, B., Li, P., et al.: Real-time spatial normalization for dynamic gesture classification. Vis. Comput. 38, 1345–1357 (2022). https://doi.org/10.1007/s00371-021-02229-9

    Article  Google Scholar 

  23. Kamel, A., Liu, B., Li, P., Sheng, B.: An Investigation of 3D Human Pose Estimation for Learning Tai Chi: A Human Factor Perspective. Int. J. Human-Comput. Interact. 35, 427–439 (2019). https://doi.org/10.1080/10447318.2018.1543081

    Article  Google Scholar 

  24. Chen, Z., Qiu, G., Li, P., Zhu, L., Yang, X., Sheng, B.: MNGNAS: Distilling Adaptive Combination of Multiple Searched Networks for One-Shot Neural Architecture Search. IEEE Trans. Pattern Anal. Mach. Intell. 45, 13489–13508 (2023). https://doi.org/10.1109/TPAMI.2023.3293885

    Article  Google Scholar 

  25. Lin, X., Sun, S., Huang, W., Sheng, B., Li, P., Feng, D.D.: EAPT: Efficient Attention Pyramid Transformer for Image Processing. IEEE Trans. Multimedia 25, 50–61 (2023). https://doi.org/10.1109/TMM.2021.3120873

    Article  Google Scholar 

  26. Xie, Z., Zhang, W., Sheng, B., Li, P., Chen, C.L.P.: BaGFN: Broad Attentive Graph Fusion Network for High-Order Feature Interactions. IEEE Trans. Neural Netw. Learn. Syst. 34, 4499–4513 (2023). https://doi.org/10.1109/TNNLS.2021.3116209

    Article  Google Scholar 

  27. Sheng, B., Li, P., Zhang, Y., Mao, L., Chen, C.L.P.: GreenSea: Visual Soccer Analysis Using Broad Learning System. IEEE Trans. Cybern. 51, 1463–1477 (2021). https://doi.org/10.1109/TCYB.2020.2988792

    Article  Google Scholar 

  28. Chen, Z., Gao, T., Sheng, B., Li, P., Chen, C.L.P.: Outdoor Shadow Estimating Using Multiclass Geometric Decomposition Based on BLS. IEEE Trans. Cybern. 50, 2152–2165 (2020). https://doi.org/10.1109/TCYB.2018.2875983

    Article  Google Scholar 

  29. Liu, C.-C., Cheng, Y.-B., Huang, C.-W.: The effect of simulation games on the learning of computational problem solving. Comput. Educ. 57, 1907–1918 (2011). https://doi.org/10.1016/j.compedu.2011.04.002

    Article  Google Scholar 

  30. Liang, H., Dong, X.: Enhancing cognitive ability through a VR serious game training model mixing Piaget’s epistemological methodology and Lumosity concept. Vis. Comput. 38, 3487–3498 (2022). https://doi.org/10.1007/s00371-022-02552-9

    Article  Google Scholar 

  31. Zhang, L., Nouri, J.: A systematic review of learning computational thinking through Scratch in K-9. Comput. Educ. 141, 103607 (2019). https://doi.org/10.1016/j.compedu.2019.103607

    Article  Google Scholar 

  32. Ou Yang, F.-C., Lai, H.-M., Wang, Y.-W.: Effect of augmented reality-based virtual educational robotics on programming students’ enjoyment of learning, computational thinking skills, and academic achievement. Comput. Educ. 195, 104721 (2023). https://doi.org/10.1016/j.compedu.2022.104721

    Article  Google Scholar 

  33. Topalli, D., Cagiltay, N.E.: Improving programming skills in engineering education through problem-based game projects with Scratch. Comput. Educ. 120, 64–74 (2018). https://doi.org/10.1016/j.compedu.2018.01.011

    Article  Google Scholar 

  34. Reber, A.S.: Implicit learning and tacit knowledge. J. Exp. Psychol. Gen. 118, 219–235 (1989). https://doi.org/10.1037/0096-3445.118.3.219

    Article  Google Scholar 

  35. Ciavarro, C., Dobson, M., Goodman, D.: Implicit learning as a design strategy for learning games: Alert Hockey. Comput. Hum. Behav. 24, 2862–2872 (2008). https://doi.org/10.1016/j.chb.2008.04.011

    Article  Google Scholar 

  36. Nielsen J.: Usability Engineering. Morgan Kaufmann, San Francisco (1994)

  37. Nielsen J.: 10 Usability Heuristics for User Interface Design. Nielsen Norman Group. https://www.nngroup.com/articles/ten-usability-heuristics/ (2024). Accessed 26 May 2024

  38. Sutcliffe, A., Gault, B.: Heuristic evaluation of virtual reality applications. Interact. Comput. 16, 831–849 (2004). https://doi.org/10.1016/j.intcom.2004.05.001

    Article  Google Scholar 

  39. Ricci, F.S., Boldini, A., Beheshti, M., Rizzo, J.-R., Porfiri, M.: A virtual reality platform to simulate orientation and mobility training for the visually impaired. Virtual Real. 27, 797–814 (2022). https://doi.org/10.1007/s10055-022-00691-x

    Article  Google Scholar 

  40. Liou WK, Chang CY. Virtual reality classroom applied to science education. In: 2018 23rd International Scientific-Professional Conference on Information Technology (IT) (2018). pp. 1–4.

  41. Radu I, Schneider B. What Can We Learn from Augmented Reality (AR)? Benefits and Drawbacks of AR for Inquiry-based Learning of Physics. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Glasgow, Scotland Uk: Association for Computing Machinery; (2019). pp. Paper 544.

  42. Aguilar Reyes, C.I., Wozniak, D., Ham, A., Zahabi, M.: Design and evaluation of an adaptive virtual reality training system. Virtual Reality 27, 2509–2528 (2023). https://doi.org/10.1007/s10055-023-00827-7

    Article  Google Scholar 

  43. Southgate, E.: Teachers Facilitating Student Virtual Reality Content Creation: Conceptual, Curriculum, and Pedagogical Insights. In: MacDowell, P., Lock, J. (eds.) Immersive Education: Designing for Learning, pp. 189–204. Springer International Publishing, Cham (2022)

    Chapter  Google Scholar 

  44. Makransky, G., Terkildsen, T.S., Mayer, R.E.: Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn. Instr. 60, 225–236 (2019). https://doi.org/10.1016/j.learninstruc.2017.12.007

    Article  Google Scholar 

  45. Pirker J, Holly M, Gütl C. Room Scale Virtual Reality Physics Education: Use Cases for the Classroom. In: 2020 6th International Conference of the Immersive Learning Research Network (iLRN) (2020). pp. 242–6.

  46. Kalina E, Johnson-Glenberg MC. Presence and Platform: Effects of Embodiment Comparing a 2D Computer and 3D VR Game. In: 2020 6th International Conference of the Immersive Learning Research Network (iLRN) (2020). pp. 31–7.

  47. Johnson-Glenberg, M.C.: The Necessary Nine: Design Principles for Embodied VR and Active Stem Education. In: Díaz, P., Ioannou, A., Bhagat, K.K., Spector, J.M. (eds.) Learning in a Digital World: Perspective on Interactive Technologies for Formal and Informal Education, pp. 83–112. Springer Singapore, Singapore (2019)

    Chapter  Google Scholar 

  48. Kolb D.A.: Experiential learning: experience as the source of learning and development. Prentice Hall. Englewood Cliffs (1984)

  49. Kolb, A.Y., Kolb D.A.: Learning styles and learning spaces: A review of the multidisciplinary application of experiential learning theory in higher education. In: Sims R.R., Sims S.J. (eds) Learning Styles and Learning, pp. 45–91. Nova Science Publishers. New York (2025)

  50. Lave, J., Etienne, W.: Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge (1991)

  51. Jin, Z.: EduCodeVR Code Share, https://figshare.com/articles/software/EduCodeVR_Code_Share/26176930/1, (2024). https://doi.org/10.6084/m9.figshare.26176930.v1

  52. Likert, R.: New patterns of management. McGraw-Hill, New York. (1961).

  53. Jin, Z.: EduCodeVR Teaching Data.xlsx, https://figshare.com/articles/dataset/EduCodeVR_xlsx/26148589/3, (2024). https://doi.org/10.6084/m9.figshare.26148589.v3

  54. Southgate E. Using Screen Capture Video to Understand Learning in Virtual Reality. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (2020). pp. 418–21.

  55. Hestenes, D., Wells, M.: A mechanics baseline test. The Physics Teacher. 30, 159–166 (1992). https://doi.org/10.1119/1.2343498

    Article  Google Scholar 

  56. Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., Pidruzny, J.N.: The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. J. Exp. Soc. Psychol. 45, 624–634 (2009). https://doi.org/10.1016/j.jesp.2009.02.016

    Article  Google Scholar 

  57. Witmer, B.G., Singer, M.J.: Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence Teleoperators and Virtual Environments. 7, 225–40 (1998). https://doi.org/10.1162/105474698565686

    Article  Google Scholar 

  58. Slater, M.: Implicit Learning Through Embodiment in Immersive Virtual Reality. In: Liu, D., Dede, C., Huang, R., Richards, J. (eds.) Virtual, Augmented, and Mixed Realities in Education, pp. 19–33. Springer Singapore, Singapore (2017)

    Chapter  Google Scholar 

  59. Zhao J, LaFemina P, Carr J, Sajjadi P, Wallgrün JO, Klippel A. Learning in the Field: Comparison of Desktop, Immersive Virtual Reality, and Actual Field Trips for Place-Based STEM Education. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (2020). pp. 893–902.

Download references

Acknowledgements

This research was partially supported by the 2024 Gansu Provincial Special Research Project on Curriculum and Textbooks for Primary, Secondary, and Higher Education under project numbers GSJC-Z2024155.

Author information

Authors and Affiliations

Authors

Contributions

J and W were responsible for the construction of the VR system, B provided educational advice, and Q and X handled course instruction. Everyone participated in the design of the teaching curriculum. Finally, J completed the successful summary and manuscript revision.

Corresponding author

Correspondence to Yulong Bai.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, Z., Bai, Y., Song, W. et al. EduCodeVR: VR for programming teaching through simulated farm and traffic. Vis Comput (2024). https://doi.org/10.1007/s00371-024-03699-3

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00371-024-03699-3

Keywords