Abstract
This paper explores the current research status, issues, and future research trends of gamification of educational content related to spatial ability training in virtual environments for cognitive characteristics of people with visual impairment (PVI). Based on the Web of Science core collection, 29 related papers, including 20 gamification design cases, were selected and analyzed using the document content analysis method. The education content, techniques, and design in these previous work showed that: the current training tasks in gamification design mainly focus on navigation, orientation, and mobility training; sensory augmentation and sensory substitution with spatial audio and tactile interface are popular in interaction design for PVI, and it is controversial whether the information of different modalities complement each other or interfere with each other. Future research trends may include strategies of multimodal information for PVI, personalized dynamic adjustment of content and tasks, and standardized effectiveness evaluation methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
World Health Organization: World report on vision. https://www.who.int/publications/i/item/9789241516570. Accessed 19 Dec 2021
Mohler, J.L.: A review of spatial ability research. Eng. Des. Graph. J. 72, 19–30 (2008)
World Health Organization: Vision impairment and blindness. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment. Accessed 19 Dec 2021
Maidenbaum, S.: Sensory substitution training for users who are blind with dynamic stimuli, games and virtual environments. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 355–356. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2700648.2811324
Sánchez, J., Darin, T., Andrade, R.: Multimodal videogames for the cognition of people who are blind: trends and issues. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9177, pp. 535–546. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20684-4_52
Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining “gamification.” In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 9–15. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/2181037.2181040
Ivascu, S., Moldoveanu, A., Moldoveanu, F., Morar, A., Balan, O.: Virtual interaction for visually impaired and sighted people. In: Roceanu, I., Belgian, D., Stefan, I.A., Moldoveanu, A., Matu, S.T. (eds.) New Technologies and Redesigning Learning Spaces, vol. I, pp. 209–214. Carol I Natl Defence Univ Publishing House, Bucharest (2019). https://doi.org/10.12753/2066-026X-19-028
Wedoff, R., Ball, L., Wang, A., Khoo, Y.X., Lieberman, L., Rector, K.: Virtual showdown: an accessible virtual reality game with scaffolds for youth with visual impairments. In: CHI 2019: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Assoc Computing Machinery, New York (2019). https://doi.org/10.1145/3290605.3300371
Schneider, O., et al.: DualPanto: a haptic device that enables blind users to continuously interact with virtual worlds. In: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, pp. 877–887. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3242587.3242604
Piaget, J.: The Construction of Reality in the Child. Routledge, Abingdon (1954)
Piaget, J.: The Child s Conception of the World. Routledge & Kegan Paul, Abingdon (1951)
Piaget, J.: Play, Dreams and Imitation in Childhood. W W Norton & Co., New York (1952)
Baas, B., et al.: Loud and clear: the VR game without visuals. In: Liapis, A., Yannakakis, G.N., Gentile, M., Ninaus, M. (eds.) GALA 2019. LNCS, vol. 11899, pp. 180–190. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-34350-7_18
Zeng, J., Parks, S., Shang, J.: To learn scientifically, effectively, and enjoyably: a review of educational games. Hum. Behav. Emerg. Technol. 2, 186–195 (2020). https://doi.org/10.1002/hbe2.188
Montello, D.R.: Scale and multiple psychologies of space. In: Frank, A.U., Campari, I. (eds.) COSIT 1993. LNCS, vol. 716, pp. 312–321. Springer, Heidelberg (1993). https://doi.org/10.1007/3-540-57207-4_21
Hegarty, M., Waller, D.: A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence 32, 175–191 (2004). https://doi.org/10.1016/j.intell.2003.12.001
Sanchez, J., Saenz, M., Ripoll, M.: Usability of a multimodal videogame to improve navigation skills for blind children. In: Assets 2009: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 35–42. Assoc Computing Machinery, New York (2009)
Kreimeier, J., Götzelmann, T.: Two decades of touchable and walkable virtual reality for blind and visually impaired people: a high-level taxonomy. Multimod. Technol. Interact. 4, 79 (2020). https://doi.org/10.3390/mti4040079
Merabet, L.B., Sánchez, J.: Development of an audio-haptic virtual interface for navigation of large-scale environments for people who are blind. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2016. LNCS, vol. 9739, pp. 595–606. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40238-3_57
Connors, E.C., Chrastil, E.R., Sanchez, J., Merabet, L.B.: Virtual environments for the transfer of navigation skills in the blind: a comparison of directed instruction vs. video game based learning approaches. Front. Hum. Neurosci. 8, 223 (2014). https://doi.org/10.3389/fnhum.2014.00223
Andrade, R., Waycott, J., Baker, S., Vetere, F.: Echolocation as a means for people with visual impairment (PVI) to acquire spatial knowledge of virtual space. ACM Trans. Access. Comput. 14, 4 (2021). https://doi.org/10.1145/3448273
Bogdanova, G., Sabev, N., Noev, N.: Accessibility and some educational barriers for visually impaired users. In: Chova, L.G., Martinez, A.L., Torres, I.C. (eds.) 13th International Technology, Education and Development Conference (INTED2019), pp. 9416–9421. IATED-Int Assoc Technology Education & Development, Valenica (2019). https://doi.org/10.21125/inted.2019.2333
Connors, E.C., Chrastil, E.R., Sanchez, J., Merabet, L.B.: Action video game play and transfer of navigation and spatial cognition skills in adolescents who are blind. Front. Hum. Neurosci. 8, 133 (2014). https://doi.org/10.3389/fnhum.2014.00133
Olickel, H., Bhatnagar, P., Ong, A.C.S., Perrault, S.T.: GooseBumps: towards sensory substitution using servo motors. In: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ACM ISS 2017), pp. 425–428. Assoc Computing Machinery, New York (2017). https://doi.org/10.1145/3132272.3132293
Balan, O., Moldoveanu, A., Moldoveanu, F., Nagy, H., Wersenyi, G., Unnporsson, R.: Improving the audio game-playing performances of people with visual impairments through multimodal training. J. Vis. Impair. Blind. 111, 148–164 (2017)
Moeller, K., et al.: Enhanced perception for visually impaired people. In: 2009 3rd International Conference on Bioinformatics and Biomedical Engineering, vols. 1–11, pp. 1365+. IEEE, New York (2009)
Moldoveanu, A.D.B., et al.: Virtual environments for training visually impaired for a sensory substitution device. In: 2017 Zooming Innovation in Consumer Electronics International Conference (ZINC), pp. 26–29. IEEE, New York (2017)
Velazquez, R., Bazan, O.: Foot-based interfaces for navigational assistance of the visually impaired. In: 2013 Pan American Health Care Exchanges (PAHCE). IEEE, New York (2013)
Siu, A.F., Sinclair, M., Kovacs, R., Ofek, E., Holz, C., Cutrell, E.: Virtual reality without vision: a haptic and auditory white cane to navigate complex virtual worlds. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 2020). Assoc Computing Machinery, New York (2020). https://doi.org/10.1145/3313831.3376353
Petridou, M., Blanchfield, P., Alabadi, R., Brailsford, T.: User centred design and development of an educational force-feedback haptic game for blind students. In: Gouscos, D., Meimaris, M. (eds.) Proceedings of the 5th European Conference on Games Based Learning, pp. 465–475. ACAD Conferences Ltd., Reading (2011)
Moustakas, K., Tzovaras, D., Dybkjær, L., Bernsen, N.O.: A modality replacement framework for the communication between blind and hearing impaired people. In: Stephanidis, C. (ed.) UAHCI 2009. LNCS, vol. 5616, pp. 226–235. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02713-0_24
Sánchez, J., Sáenz, M.: 3D sound interactive environments for blind children problem solving skills. Behav. Inf. Technol. 25, 367–378 (2006). https://doi.org/10.1080/01449290600636660
Balan, O., Moldoveanu, A., Moldoveanu, F., Dascalu, M.-I.: Navigational 3D audio-based game- training towards rich auditory spatial representation of the environment. In: 2014 18th International Conference System Theory, Control and Computing (ICSTCC), pp. 682–687. IEEE, New York (2014)
Sanchez, J., Tadres, A., Pascual-Leone, A., Merabet, L.: Blind children navigation through gaming and associated brain plasticity. In: 2009 Virtual Rehabilitation International Conference, pp. 29+. IEEE, New York (2009). https://doi.org/10.1109/ICVR.2009.5174201
Acknowledgement
This work was supported by the Key Education Research Project in 2020 Sponsored by Yuyue Educational Development Foundation in Center for Research on Pre-K12 Education of Peking University (No: JCJYYJ201902).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tan, S., Huang, W., Shang, J. (2022). Research Status and Trends of the Gamification Design for Visually Impaired People in Virtual Reality. In: Fang, X. (eds) HCI in Games. HCII 2022. Lecture Notes in Computer Science, vol 13334. Springer, Cham. https://doi.org/10.1007/978-3-031-05637-6_41
Download citation
DOI: https://doi.org/10.1007/978-3-031-05637-6_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05636-9
Online ISBN: 978-3-031-05637-6
eBook Packages: Computer ScienceComputer Science (R0)