Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall

by Garrett, R. | Gast, J. | Henry, S. | Mellili, K. | Seung, H. J. | Santoso, M. | Barmpoutis, A.

In Proceedings of HCI International Conference 2024, June 29- July 4, Washington, DC, USA, Springer, 2024,

Category:

Description

The use of passive haptics in virtual reality environments has been shown to improve procedural learning across various application domains such as first responders training, kayaking, and others (Calandra at al. 2023, Barmpoutis et al. 2020). In this paper we want to go one step further and quantify the effect of passive haptics on knowledge acquisition and recall. We developed a specialized virtual reality application for learning various chemical compounds and their components. Participants engaged in activities that involved precise mixing and proportioning of chemical components to form targeted compounds (see Figure 1). Employing an A-B test framework, participants were randomly assigned to two identical virtual reality environments, differing only in the substitution of the VR controller with a physical jar.

Post-study surveys were administered to gauge user perceptions regarding interaction accuracy and realism, as well as their ability to recall acquired knowledge (specifically, the list of ingredients) from their virtual experience. This pilot study, conducted at the University of Florida Reality Lab, involved 12 subjects. Rigorous statistical analyses, including chi-square tests, were performed on the collected data, with detailed results outlined in this paper.

Two key findings emerged from the study: (a) the presence of the physical jar significantly heightened perceived interaction accuracy, particularly in precise liquid pouring tasks, and (b) users exhibited a remarkable 33% improvement in knowledge recall when utilizing the physical jar as opposed to a conventional VR controller. These results establish a compelling, statistically significant correlation between the integration of passive haptic objects in VR and knowledge acquisition and recall. Furthermore, this study lays the groundwork for a larger-scale study in the future.

Additional information

Author

Garrett, R., Gast, J., Henry, S., Mellili, K., Seung, H. J., Santoso, M., Barmpoutis, A.

Journal

In Proceedings of HCI International Conference 2024, June 29- July 4, Washington, DC, USA, Springer

Year

2024

PDF

barmpoutis_hcii2024b.pdf

Citation

Citation

Garrett, R., Gast, J., Henry, S., Mellili, K., Seung, H., Santoso, M. and Barmpoutis, A., 2024. Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall. In Proceedings of HCI International Conference 2024, June 29- July 4, Washington, DC, USA, Springer,

BibTex

@article{digitalWorlds:308,
author = {Garrett, R. and Gast, J. and Henry, S. and Mellili, K. and Seung, H. J. and Santoso, M. and Barmpoutis, A.},
title = {Investigating how interaction with physical objects within virtual environments affects knowledge acquisition and recall},
journal = {In Proceedings of HCI International Conference 2024, June 29- July 4, Washington, DC, USA, Springer},
year = {2024},
}

Related…