• Journal of the Korea Society of Computer and Information
• /
• v.28 no.9
• /
• pp.9-15
• /
• 2023

Metaverse is a modern new technology that is advancing quickly. The goal of this study is to investigate this technique from the perspective of computer vision as well as general perspective. A thorough analysis of computer vision related Metaverse topics has been done in this study. Its history, method, architecture, benefits, and drawbacks are all covered. The Metaverse's future and the steps that must be taken to adapt to this technology are described. The concepts of Mixed Reality (MR), Augmented Reality (AR), Extended Reality (XR) and Virtual Reality (VR) are briefly discussed. The role of computer vision and its application, advantages and disadvantages and the future research areas are discussed.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.8
• /
• pp.1255-1258
• /
• 2022

Recently, immersive VR/AR contents have actively increased, and various services related to VR/AR allow users to experience remote places. For example, if failure situations occur frequently in factory of the remote site, mixed reality (MR) with a synthetic virtual human expert in reconstructed remote location can help immediate maintenance task with interaction between the operator and the virtual expert. In this paper, we present a technique for synthesizing the virtual human after capturing a 360-degree panorama of a remote environment, and analyze the effects to apply a method of guiding virtual human by interaction types. According to this paper, it was shown that co-presence level significantly increased when verbal, facial expression, and non-verbal animation of the virtual human was all expressed.

• Annual Conference of KIPS
• /
• 2018.10a
• /
• pp.686-689
• /
• 2018

3D 손 포즈 추정(Hand Pose Estimation, HPE)은 스마트 인간 컴퓨터 인터페이스를 위해서 중요한 기술이다. 이 연구에서는 딥러닝 방법을 기반으로 하여 단일 RGB-Depth 카메라로 촬영한 양손의 3D 손 자세를 실시간으로 인식하는 손 포즈 추정 시스템을 제시한다. 손 포즈 추정 시스템은 4단계로 구성된다. 첫째, Skin Detection 및 Depth cutting 알고리즘을 사용하여 양손을 RGB와 깊이 영상에서 감지하고 추출한다. 둘째, Convolutional Neural Network(CNN) Classifier는 오른손과 왼손을 구별하는데 사용된다. CNN Classifier 는 3개의 convolution layer와 2개의 Fully-Connected Layer로 구성되어 있으며, 추출된 깊이 영상을 입력으로 사용한다. 셋째, 학습된 CNN regressor는 추출된 왼쪽 및 오른쪽 손의 깊이 영상에서 손 관절을 추정하기 위해 다수의 Convolutional Layers, Pooling Layers, Fully Connected Layers로 구성된다. CNN classifier와 regressor는 22,000개 깊이 영상 데이터셋으로 학습된다. 마지막으로, 각 손의 3D 손 자세는 추정된 손 관절 정보로부터 재구성된다. 테스트 결과, CNN classifier는 오른쪽 손과 왼쪽 손을 96.9%의 정확도로 구별할 수 있으며, CNN regressor는 형균 8.48mm의 오차 범위로 3D 손 관절 정보를 추정할 수 있다. 본 연구에서 제안하는 손 포즈 추정 시스템은 가상 현실(virtual reality, VR), 증강 현실(Augmented Reality, AR) 및 융합 현실 (Mixed Reality, MR) 응용 프로그램을 포함한 다양한 응용 분야에서 사용할 수 있다.

• Annual Conference of KIPS
• /
• 2019.10a
• /
• pp.1137-1140
• /
• 2019

가상현실(Virtual Reality, VR), 증강현실(Augmented Reality, AR), 혼합현실(Mixed Reality, MR) 분야에 유용한 인간 컴퓨터 인터페이스 기술은 필수적이다. 특히 휴먼 손동작 인식 기술은 직관적인 상호작용을 가능하게 하여, 다양한 분야에서 편리한 컨트롤러로 사용할 수 있다. 본 연구에서는 뎁스 영상 기반의 1 인칭 시점 손동작 인식을 위하여 손동작 데이터베이스 생성 시스템을 구축하여, 손동작 인식기 학습에 필요한 1 인칭(Egocentric View Point) 데이터베이스를 촬영하여 제작한다. 그리고 모바일 Head Mounted Device(HMD) VR 을 위한 뎁스 영상 기반 1 인칭 시점 손동작 인식(Hand Pose Recognition, HPR) 딥러닝 Deep Residual Network 를 구현한다. 최종적으로, 안드로이드 모바일 디바이스에 학습된 Residual Network Regressor 를 이식하고 모바일 VR 에 실시간 손동작 인식 시스템을 구동하여, 모바일 VR 상 실시간 3D 손동작 인식을 가상 물체와의 상호작용을 통하여 확인 한다.

• Smart Media Journal
• /
• v.9 no.2
• /
• pp.86-91
• /
• 2020

The current trend of the education market is the development of the fourth industrial revolution and the development of ICT, and various technologies are developing into edu-tech technology that is integrated into the education system. In particular, the market for edu-tech systems capable of lifelike immersive learning effects in virtual space is expanding. However, education in Korean medicine is not objective because of the absence of educational simulators and systems to train and evaluate acupuncture. In this paper, we propose an acupuncture controller and a human body model to increase the effectiveness of acupuncture point training as a follow-up study of "Design of Acupuncture Contents and Dummy for Acupuncture Point Training System". Through the proposed acupuncture controller and Dummy, the accuracy of acupuncture points for the acupuncture point data matching and content motion recognition rate is presented. In addition, the results of temperature and humidity and temperature change tests for evaluating the environmental reliability of the controller are presented.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.557-560
• /
• 2020

최근, 광소자에서 공간 변조되는 wavefront profile 특성을 광소자의 표면 단차 변화 없이 단일 두께 박막 상에서 자유로이 구현할 수 있는 기하위상 홀로그램 (geometric phase hologram) 기반의 optical component에 대한 관심이 증대되고 있다. 특히 이를 이용해 제작된 기하위상 렌즈 (geometric phase lens)는 dynamic phase의 공간적 차이에 의해 구현되던 기존 bulk optics 기반의 lens 대비 초박형으로 제작이 가능한 파장 선택적 flat optics 기술로써, 다초점 및 경량화를 요구하는 차세대 디스플레이 기술 (augmented reality 또는 AR, mixed reality 또는 MR) 및 광파변조 및 제어를 요구하는 홀로그래픽 카메라 분야에 대한 응용처로 많은 주목을 받고 있다. 이에 본 논문에서는 해당 기하 위상렌즈에 대한 원리 및 이에 따른 개발이슈 및 해결법에 대해 연구 하였으며, 이에 대한 응용처로 기하위상 렌즈의 편광에 따른 이중초점특성을 이용해, 기존 단일 초점 형성이 가능한 AR기기 대비, 다초점 형성이 가능한 switchable dual-depth 3D AR device를 compact한 모듈과 함께 구현하였다. 또한, 기하위상렌즈의 광파 변조 및 분리특성을 이용한 기하위상 렌즈기반의 자가간섭 홀로그래픽 시스템(GP-self-interference incoherent digital holographic, GP-SIDH)에 편광 이미지센서 적용과 함께 맞춤형 설계/제작된 기하 위상렌즈를 적용함으로써, 기존 GP-SIDH 시스템대비 안정적으로 실시간 복소 홀로그램 획득이 가능한 실시간 공간영상정보 획득용 GP-SIDH을 동영상 프레임으로 구현하였다.

• Information Systems Review
• /
• v.25 no.4
• /
• pp.131-159
• /
• 2023

Recently, amidst the backdrop of the COVID-19 pandemic shifting towards an endemic phase, there has been a rise in discussions and debates about the future of the metaverse. Simultaneously, major metaverse platforms like Roblox have been launching services integrated with generative AI, and Apple's mixed reality hardware, Vision Pro, has been announced, creating new expectations for the metaverse. In this situation where the outlook for the metaverse is divided, it is crucial to diagnose the metaverse from an ecosystem perspective, examine its key ecological features, driving forces for development, and future possibilities for advancement. This study utilized Wang's (2021) Information Ecology Theory (IET) framework, which is representative of ecosystem research in the field of Information Systems (IS), to derive the Metaverse Industrial Ecosystem (MIE). The analysis revealed that the MIE consists of four main domains: Tech Landscape, Category Ecosystem, Metaverse Platform, and Product/Service Ecosystem. It was found that the MIE exhibits characteristics such as digital connectivity, the integration of real and virtual worlds, value creation capabilities, and value sharing (Web 3.0). Furthermore, the interactions among the domains within the MIE and the four characteristics of the ecosystem were identified as driving forces for the development of the MIE at an ecosystem level. Additionally, the development of the MIE at an ecosystem level was categorized into three distinct stages: Narrow Ecosystem, Expanded Ecosystem, and Everywhere Ecosystem. It is anticipated that future advancements in related technologies and industries, such as robotics, AI, and 6G, will promote the transition from the current Expanded Ecosystem level of the MIE to an Everywhere Ecosystem level, where the connection between the real and virtual worlds is pervasive. This study provides several implications. Firstly, it offers a foundational theory and analytical framework for ecosystem research, addressing a gap in previous metaverse studies. It also presents various research topics within the metaverse domain. Additionally, it establishes an academic foundation that integrates concept definition research and impact studies, which are key areas in metaverse research. Lastly, referring to the developmental stages and conditions proposed in this study, businesses and governments can explore future metaverse markets and related technologies. They can also consider diverse metaverse business strategies. These implications are expected to guide the exploration of the emerging metaverse market and facilitate the evaluation of various metaverse business strategies.

• Proceedings of the Korean Society of Crop Science Conference
• /
• 2023.04a
• /
• pp.7-7
• /
• 2023

Currently, the main technologies of various fourth industries are big data, the Internet of Things, artificial intelligence, blockchain, mixed reality (MR), and drones. In particular, "digital twin," which has recently become a global technological trend, is a concept of a virtual model that is expressed equally in physical objects and computers. By creating and simulating a Digital twin of software-virtualized assets instead of real physical assets, accurate information about the characteristics of real farming (current state, agricultural productivity, agricultural work scenarios, etc.) can be obtained. This study aims to streamline agricultural work through automatic water management, remote growth forecasting, drone control, and pest forecasting through the operation of an integrated control system by constructing digital twin data on the main production area of the nojinot industry and designing and building a smart farm complex. In addition, it aims to distribute digital environmental control agriculture in Korea that can reduce labor and improve crop productivity by minimizing environmental load through the use of appropriate amounts of fertilizers and pesticides through big data analysis. These open-field agricultural technologies can reduce labor through digital farming and cultivation management, optimize water use and prevent soil pollution in preparation for climate change, and quantitative growth management of open-field crops by securing digital data for the national cultivation environment. It is also a way to directly implement carbon-neutral RED++ activities by improving agricultural productivity. The analysis and prediction of growth status through the acquisition of the acquired high-precision and high-definition image-based crop growth data are very effective in digital farming work management. The Southern Crop Department of the National Institute of Food Science conducted research and development on various types of open-field agricultural smart farms such as underground point and underground drainage. In particular, from this year, commercialization is underway in earnest through the establishment of smart farm facilities and technology distribution for agricultural technology complexes across the country. In this study, we would like to describe the case of establishing the agricultural field that combines digital twin technology and open-field agricultural smart farm technology and future utilization plans.