Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Delivering Augmented Information in a Session Initiation Protocol-Based Video Telephony Using Real-Time AR

  • Jang, Sung-Bong (Dept. of Industry-Academy, Kumoh National Institute of Technology) ;
  • Ko, Young-Woong (Dept. of Computer Engineering, Hallym University)
  • Received : 2021.08.23
  • Accepted : 2021.12.03
  • Published : 2022.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

Online video telephony systems have been increasingly used in several industrial areas because of coronavirus disease 2019 (COVID-19) spread. The existing session initiation protocol (SIP)-based video call system is being usefully utilized, however, there is a limitation that it is very inconvenient for users to transmit additional information during conversation to the other party in real time. To overcome this problem, an enhanced scheme is presented based on augmented real-time reality (AR). In this scheme, augmented information is automatically searched from the Internet and displayed on the user's device during video telephony. The proposed approach was qualitatively evaluated by comparing it with other conferencing systems. Furthermore, to evaluate the feasibility of the approach, we implemented a simple network application that can generate SIP call requests and answer with AR object pre-fetching. Using this application, the call setup time was measured and compared between the original SIP and pre-fetching schemes. The advantage of this approach is that it can increase the convenience of a user's mobile phone by providing a way to automatically deliver the required text or images to the receiving side.

Keywords

Acknowledgement

This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education (No. NRF-2018R1D1A1B07045589, NRF-2021R1F1A106406911).

References

  1. Y. Shi, "Research of the development of distance learning under the COVID-19 circumstances based on video conferencing software and MOOCs," in Proceedings of 2021 2nd International Conference on Education, Knowledge and Information Management (ICEKIM), Xiamen, China, 2021, pp. 154-158.
  2. M. Schmidtner, C. Doering, and H. Timinger, "Agile working during COVID-19 pandemic," IEEE Engineering Management Review, vol. 49, no. 2, pp. 18-32, 2021. https://doi.org/10.1109/EMR.2021.3069940
  3. S. H. Islam, P. Vijayakumar, M. Z. A. Bhuiyan, R. Amin, and B. Balusamy, "A provably secure three-factor session initiation protocol for multimedia big data communications," IEEE Internet of Things Journal, vol. 5, no. 5, pp. 3408-3418, 2018. https://doi.org/10.1109/jiot.2017.2739921
  4. X. Y. Guo, D. Z. Sun, and Y. Yang, "An improved three-factor session initiation protocol using Chebyshev chaotic map," IEEE Access, vol. 8, pp. 111265-111277, 2020. https://doi.org/10.1109/access.2020.3002558
  5. A. Montazerolghaem, M. H. Y. Moghaddam, and A. Leon-Garcia, "OpenSIP: Toward software-defined SIP networking," IEEE Transactions on Network and Service Management, vol. 15, no. 1, pp. 184-199, 2018. https://doi.org/10.1109/tnsm.2017.2741258
  6. J. Cavaleri, R. Tolentino, B. Swales, and L. Kirschbaum, "Remote video collaboration during COVID-19," in Proceedings of 2021 32nd Annual SEMI Advanced Semiconductor Manufacturing Conference (ASMC), Milpitas, CA, 2021.
  7. R. Gupta, "Hybrid-flipped class room approach for fashion design students: mitigating impacts to learning activities due to emergence of COVID-19," in Proceedings of 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India, 2020, pp. 1-6.
  8. R. Portillo and A. Alvarado, "Plenary: real-time transformation of the freshmen mathematics engineering courses during COVID-19 outbreak," in Proceedings of 2021 IEEE World Conference on Engineering Education (EDUNINE), Guatemala City, Guatemala, 2021, pp. 1-2.
  9. S. Melenli and A. Topkaya, "Real-time maintaining of social distance in covid-19 environment using image processing and big data," in Trends in Data Engineering Methods for Intelligent Systems. Cham, Switzerland: Springer, 2020, pp. 1-5.
  10. P. Spathis and R. Dey, "Online teaching amid COVID-19: the case of zoom," in Proceedings of 2021 IEEE Global Engineering Education Conference (EDUCON), Vienna, Austria, 2021, pp. 1398-1406.
  11. V. Mamone, V. Ferrari, S. Condino, and F. Cutolo, "Projected augmented reality to drive osteotomy surgery: implementation and comparison with video see-through technology," IEEE Access, vol. 8, pp. 169024-169035, 2020. https://doi.org/10.1109/access.2020.3021940
  12. H. Si-Mohammed, J. Petit, C. Jeunet, F. Argelaguet, F. Spindler, A. Evain, N. Roussel, G. Casiez, and A. Lecuyer, "Towards BCI-based interfaces for augmented reality: feasibility, design and evaluation," IEEE Transactions on Visualization and Computer Graphics, vol. 26, no. 3, pp. 1608-1621, 2020. https://doi.org/10.1109/tvcg.2018.2873737
  13. A. Marto, M. Melo, A. Goncalves, and M. Bessa, "Multisensory augmented reality in cultural heritage: impact of different stimuli on presence, enjoyment, knowledge and value of the experience," IEEE Access, vol. 8, pp. 193744-193756, 2020. https://doi.org/10.1109/access.2020.3032379
  14. J. Cejka, M. Mangeruga, F. Bruno, D. Skarlatos, and F. Liarokapis, "Evaluating the potential of augmented reality interfaces for exploring underwater historical sites," IEEE Access, vol. 9, pp. 45017-45031, 2021. https://doi.org/10.1109/ACCESS.2021.3059978
  15. L. Zhang, Z. Wei, W. Ren, X. Zheng, K. K. R. Choo, and N. Xiong, "SIP: an efficient and secure information propagation scheme in e-health networks," IEEE Transactions on Network Science and Engineering, vol. 8, no. 2, pp. 1502-1516, 2021. https://doi.org/10.1109/TNSE.2021.3063174
  16. S. B. Jang and Y. W. Ko, "An efficient object augmentation scheme for supporting pervasiveness in a mobile augmented reality," Journal of Information Processing Systems, vol. 16, no. 5, pp. 1214-1222, 2020. https://doi.org/10.3745/JIPS.04.0192