Holokeys: Interactive Piano Education Using Augmented Reality and IoT
FacebookTwitterEmailLinkedin
Category:

Description

ABSTRACT

The rise of online learning poses unique challenges in music education, where live demonstration and musical synchronization are critical for student success. We present HoloKeys, a music education interface which allows instructors to play remotely located pianos using an augmented reality headset and wifi-enabled microcontrollers. This approach allows students to receive distance education which is more direct, immersive, and comprehensive than conventional video conferencing allows for. HoloKeys enables remote students to observe live instructional demonstration on a physical keyboard in their immediate environment just as they would in traditional settings. HoloKeys consists of two separate components: an augmented reality user interface and a piano playing apparatus. Our system aims to extend online music education beyond desktop platforms into the physical world, thereby addressing crucial obstacles encountered by educators and students transitioning into online education.

Additional information

Author

Stanbury, Said, Kang
Journal

Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST)
Year

2021
DOI

https://doi.org/10.1145/3489849.3489921

Citation

Citation

Stanbury , , Said , and Kang, , 2021. Holokeys: Interactive Piano Education Using Augmented Reality and IoT. Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST), https://doi.org/10.1145/3489849.3489921

BibTex

@article{digitalWorlds:574,
doi = {https://doi.org/10.1145/3489849.3489921},
author = {Stanbury  and  Said  and  Kang},
title = {Holokeys: Interactive Piano Education  Using Augmented Reality and IoT},
journal = {Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology (VRST)},
year = {2021},
}

See also…