Journal of Practical Engineering Education (실천공학교육논문지)

Korean Institute for Pratical Engineering Education (한국실천공학교육학회)
권호 표지
DOI QR코드

DOI QR Code

The Effects of Augmented Position and Keyboard Layout on Korean Text Entry in XR

  • Su Young Kim (BioComputing Lab, Department of Computer Science and Engineering, Korea University of Technology and Education (KOREATECH)) ;
  • Yoon Sang Kim (BioComputing Lab, Institute for Bioengineering Application Technology, Department of Computer Science and Engineering, KOREATECH)
  • Received : 2024.06.07
  • Accepted : 2024.07.15
  • Published : 2024.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Optimizing text entry in extended reality (XR) is important. However, most studies have focused on inputting alphabetic characters, so there is still insufficient research on inputting Korean characters. As a follow-up to our previous research, this paper deals with the effects of keyboard layout and augmented position on Korean text entry in the XR environment. For this purpose, we developed a virtual keyboard environment using the representative Korean keyboard layout "Du-Beol-Sik" across three augmented positions: mid-air, physical planar surface, and palmar surface. After conducting an experiment, we analyzed the effects of keyboard layout and augmented position on text entry by comparing the results of our previous research (the effect of augmented position on text entry based on the international standard Korean keyboard layout 'Chon-Ji-In'). The analysis results confirmed that the virtual keyboard performed the best overall when augmented in mid-air regardless of the keyboard layout. It was also confirmed that the keyboard layout had little effect on text entry. Based on detailed analyses, we suggest directions for providing a virtual keyboard for Korean text entries in the future.

Keywords

Acknowledgement

This result was supported by "Regional Innovation Strategy (RIS)" through the National Research Foundation of Korea(NRF) funded by the Ministry of Education(MOE) (2021RIS-004). Also, this work was partially supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. 2023R1A2C2002838).

References

  1. P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented reality: A class of displays on the reality-virtuality continuum," Telemanipulator and Telespresence Technologies, vol. 2351, pp. 282-292, 1995, DOI: 10.1117/12.197321 
  2. P. Milgram and H. Colquhoun, "A taxonomy of real and virtual world display integration," Mixed Reality: Merging Real and Virtual Worlds, pp. 1-26, 1999, DOI: 10.1007/978-3-642-87512-0_1 
  3. S. K. Card (Ed.), The psychology of human-computer interaction. CRC Press, 2018 (first published 1983). 
  4. W. Xu, H. N. Liang, A. He, and Z. Wang, "Pointing and selection methods for text entry in augmented reality head mounted displays," 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 279-288, 2019, DOI: 10.1109/ISMAR.2019.00026 
  5. J. J. Dudley, H. Benko, D. Wigdor, and P. O. Kristensson, "Performance envelopes of virtual keyboard text input strategies in virtual reality," 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 289-300, 2019, DOI: 10.1109/ISMAR.2019.00027 
  6. T. H. Lee and H. J. Lee, "A new virtual keyboard with finger gesture recognition for AR/VR devices," Human-Computer Interaction. Interaction Technologies: 20th International Conference, pp. 56-67, 2018, DOI: 10.1007/978-3-319-91250-9_5 
  7. E. Brasier, O. Chapuis, N. Ferey, J. Vezien, and C. Appert, "ARPads: Mid-air indirect input for augmented reality," 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 332-343, 2020, DOI: 10.1109/ISMAR50242.2020.00060 
  8. F. Kern, F. Niebling, and M. E. Latoschik, "Text input for non-stationary XR workspaces: Investigating tap and word-gesture keyboards in virtual and augmented reality," IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 5, pp. 2658-2669, 2023, DOI: 10.1109/TVCG.2023.3247098 
  9. Z. Song, J. J. Dudley, and P. O. Kristensson, "Efficient special character entry on a virtual keyboard by hand gesture-based mode switching," 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 864-871, 2022, DOI: 10.1109/ISMAR55827.2022.00105 
  10. T. Wan, Y. Wei, R. Shi, J. Shen, P. O. Kristensson, K. Atkinson, and H. N. Liang, "Design and evaluation of controller-based raycasting methods for efficient alphanumeric and special character entry in virtual reality," IEEE Transactions on Visualization and Computer Graphics, vol. 30, no. 9, pp. 6493-6506, 2024, DOI: 10.1109/TVCG.2024.3349428 
  11. S. Y. Kim, S. H. Ryu, and Y. S. Kim, "A study on text entry in XR: Case of Korean," International Journal of Intelligent Systems and Applications in Engineering, vol. 12, no. 3, pp. 1779-1785, 2024. 
  12. K. Kim, "Three modes of three sets type Korean keyboards and unified designs for north and South Koreas," Journal of Korean Society for Quality Management, vol. 37, no. 4, pp. 52-60, 2009. 
  13. I. S. MacKenzie and R. W. Soukoreff, "Phrase sets for evaluating text entry techniques," CHI'03 Extended Abstracts on Human Factors in Computing Systems, pp. 754-755, 2003, DOI: 10.1145/765891.765971 
  14. Y. Choi and Y. S. Kim, "An adaptive UI based on user-satisfaction prediction in mixed reality," Applied Sciences, vol. 12, no. 9, pp. 4559, 2022, DOI: 10.3390/app12094559 
  15. Y. Zhang, W. Kienzle, Y. Ma, S. S. Ng, H. Benko, and C. Harrison, "ActiTouch: Robust touch detection for on-skin AR/VR interfaces," in Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 1151-1159, 2019, DOI: 10.1145/3332165.3347869