• Journal of the Korean Chemical Society
• /
• v.66 no.4
• /
• pp.323-332
• /
• 2022

The purpose of this study is to investigate the effects of science classes using smart devices that combine augmented reality (AR) and virtual reality (VR) on the scientific attitude of middle school gifted students. In addition, it is intended to find out the perception of science classes using these smart devices. In addition to actual experiments, a science class program that allows students to experience science experiments virtually using AR and VR was applied to 15 middle school gifted students. Before and after the application of the program, the questionnaire is to investigate the interest in scientific classes, the attitude toward science exploration, and the professional interest in science, and the recognition of classes that combine AR and VR. In addition, through in-depth interviews, the perceptions of gifted students was accurately investigated. As a result of this study, the content of science classes and instructors showed high class satisfaction, but the smart devices and applications used during the science classes showed lower class satisfaction than others. As a result of comparing and analyzing the pre-post of gifted students, interest in science class, attitude toward science inquiry, and professional interest in science increased significantly among the sub-areas of the scientific attitude test. As a result of analyzing free responses and indepth interviews, gifted students responded with the advantage that classes using smart devices that combine AR and VR can be tested quickly and safely for a short time compared to actual experiments. On the other hand, they responded with low completeness of the application and dizziness when operating virtual reality. Based on this, implications for the development of applications and instructional programs using advanced technologies that can experience realistically limited scientific experiments such as experimental preparation, class time, and risk factors were obtained.

• Journal of Broadcast Engineering
• /
• v.26 no.6
• /
• pp.680-691
• /
• 2021

Due to the recent developments of attaining 3D contents by using devices such as 3D scanners, the diversity of the contents being used in AR(Augmented Reality)/VR(Virutal Reality) fields is significantly increasing. There are several ways to represent 3D data, and using point clouds is one of them. A point cloud is a cluster of points, having the advantage of being able to attain actual 3D data with high precision. However, in order to express 3D contents, much more data is required compared to that of 2D images. The size of data needed to represent dynamic 3D point cloud objects that consists of multiple frames is especially big, and that is why an efficient compression technology for this kind of data must be developed. In this paper, a motion estimation and compensation method for dynamic point cloud objects using 3D DCT is proposed. This will lead to switching the 3D video frames into I frames and P frames, which ensures higher compression ratio. Then, we confirm the compression efficiency of the proposed technology by comparing it with the anchor technology, an Intra-frame based compression method, and 2D-DCT based V-PCC.

• Journal of Korea Game Society
• /
• v.13 no.5
• /
• pp.43-54
• /
• 2013

With the consistent development of the 3D application technique, visuals are available at more realistic quality and are utilized in many applications like game. In particular, interacting with 3D objects in virtual environments, 3D graphics have led to a substantial development in the augmented reality. This study proposes a 3D user interface to control objects in 3D space through virtual two-view method using only one camera. To do so, homography matrix including transformation information between arbitrary two positions of camera is calculated and 3D coordinates are reconstructed by employing the 2D hand coordinates derived from the single camera, homography matrix and projection matrix of camera. This method will result in more accurate and quick 3D information. This approach may be advantageous with respect to the reduced amount of calculation needed for using one camera rather than two and may be effective at the same time for real-time processes while it is economically efficient.

• Journal of Convergence for Information Technology
• /
• v.12 no.1
• /
• pp.22-30
• /
• 2022

In order to prevent chemical accidents caused by human error, a chemical accident prevention and response training program using advanced technology was developed. After designing a virtual process based on the previously built pilot plant, chemical accident response contents were developed. A part of the pilot facility was remodeled for content realization and a remote control function was given. In addition, a DCS program that can control facilities in a virtual environment was developed, and chemical process operator training (OTS) that can finally respond to virtual chemical accidents was developed in conjunction with AR. Through this, trainees can build driving skills by directly operating the device, and by responding to virtual chemical accidents, they can develop emergency response capabilities. If the next-generation OTS like this study is widely distributed in the chemical industry, it is expected to greatly contribute to the prevention of chemical accidents caused by human error.

• Journal of Digital Convergence
• /
• v.15 no.8
• /
• pp.391-400
• /
• 2017

The purpose of this paper is to present the effect of image stimulation on body stability as a conceptual model and to investigate the effect of image stimulus(2D, VR) on body stability(hand stability) through experiments Recently, stereoscopic images such as virtual and augmented reality are combined with smart phones and exercise equipments, and the diffusion is becoming active. The possibility of a safety accident or human error is also increasing as it temporarily affects the balance of the body and hand stability after the image stimulus is removed. The conceptual model is presented based on the results of previous studies. Based on the experimental results, the conceptual model has been explained in combination with the human information processing process and cognitive resource models that take place in the brain. Twenty subjects were exposed to 2D and VR stimuli, and display fatigue was measured by cybersickness questionnaire and hand stability by hand steadiness tester. Experimental results show that VR images induce higher display fatigue and lower hand stability than 2D. In this study, it is meaningful that hand stability according to image type and display fatigue level which have not been tried yet is revealed through conceptual model and experiment.

• Korean Journal of Construction Engineering and Management
• /
• v.18 no.2
• /
• pp.21-29
• /
• 2017

Recently, with having a great interest of the general public for the AR (Augmented Reality) technology, there have been lots of study to improve efficiency of a construction equipment with applying the AR technology to a construction equipment. The clear extrinsic calibration is essential to applying AR technology at the construction site without any error which came from superimposition between 'Real world' and 'Virtual world'. However, on the construction site, the clear extrinsic calibration is not possible, because of lack of time and budget for the specific survey, also, the huge error of the outdoor tracking system such as gyro, GPS system and so on. In this study, we do research about seamless superposition with unclear extrinsic calibration and the image process method for making AR navigator operating in the excavator. Based on this study, we figure that we can fully develop the AR navigator for the excavator. Furthermore, thereby operating AR navigator at many construction sites, we expect that the efficiency of the excavator will be improved. In addition, we can develop AR navigator for not only a excavator but all about construction equipment.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.21 no.3
• /
• pp.636-642
• /
• 2017

In this paper, We proposed a novel hand-gesture recognition algorithm using concentric-circle expanding and tracing. The proposed algorithm determines region of interest of hand image through preprocessing the original image acquired by web-camera and extracts the feature of hand gesture such as the number of stretched fingers, finger tips and finger bases, angle between the fingers which can be used as intuitive method for of human computer interaction. The proposed algorithm also reduces computational complexity compared with raster scan method through referencing only pixels of concentric-circles. The experimental result shows that the 9 hand gestures can be recognized with an average accuracy of 90.7% and an average algorithm execution time is 78ms. The algorithm is confirmed as a feasible way to a useful input method for virtual reality, augmented reality, mixed reality and perceptual interfaces of human computer interaction.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.686-689
• /
• 2018

3D 손 포즈 추정(Hand Pose Estimation, HPE)은 스마트 인간 컴퓨터 인터페이스를 위해서 중요한 기술이다. 이 연구에서는 딥러닝 방법을 기반으로 하여 단일 RGB-Depth 카메라로 촬영한 양손의 3D 손 자세를 실시간으로 인식하는 손 포즈 추정 시스템을 제시한다. 손 포즈 추정 시스템은 4단계로 구성된다. 첫째, Skin Detection 및 Depth cutting 알고리즘을 사용하여 양손을 RGB와 깊이 영상에서 감지하고 추출한다. 둘째, Convolutional Neural Network(CNN) Classifier는 오른손과 왼손을 구별하는데 사용된다. CNN Classifier 는 3개의 convolution layer와 2개의 Fully-Connected Layer로 구성되어 있으며, 추출된 깊이 영상을 입력으로 사용한다. 셋째, 학습된 CNN regressor는 추출된 왼쪽 및 오른쪽 손의 깊이 영상에서 손 관절을 추정하기 위해 다수의 Convolutional Layers, Pooling Layers, Fully Connected Layers로 구성된다. CNN classifier와 regressor는 22,000개 깊이 영상 데이터셋으로 학습된다. 마지막으로, 각 손의 3D 손 자세는 추정된 손 관절 정보로부터 재구성된다. 테스트 결과, CNN classifier는 오른쪽 손과 왼쪽 손을 96.9%의 정확도로 구별할 수 있으며, CNN regressor는 형균 8.48mm의 오차 범위로 3D 손 관절 정보를 추정할 수 있다. 본 연구에서 제안하는 손 포즈 추정 시스템은 가상 현실(virtual reality, VR), 증강 현실(Augmented Reality, AR) 및 융합 현실 (Mixed Reality, MR) 응용 프로그램을 포함한 다양한 응용 분야에서 사용할 수 있다.

• Journal of Korea Entertainment Industry Association
• /
• v.13 no.3
• /
• pp.1-12
• /
• 2019

The 4th industrial revolution has become a topic of 'experiential games' that utilize technologies such as virtual reality, augmented reality, and complex reality, and they are promoting various experiential game contents to attract tourists in the tourism industry have. The trend of tourism is the concept of the healing which aims to enhance the quality of life of the individual in the concept of simple travel, that is, the consumer is not satisfied with the sight, There are many changes in the form of tourism. In this study, domestic and foreign cases that utilized the fun and experience of tourism in the game were examined using case study methods. In domestic case, although service was provided by using smart phone, there is a problem that simple information is provided, mission quest method is not continuously provided, and the story is limited. I tried to find out the solution through this case. Developing and applying various experience contents, utilizing active investment and various stories for continuous service, and utilizing new technology such as virtual reality, it will bring about improvement of domestic tourism industry and satisfaction.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.1137-1140
• /
• 2019

가상현실(Virtual Reality, VR), 증강현실(Augmented Reality, AR), 혼합현실(Mixed Reality, MR) 분야에 유용한 인간 컴퓨터 인터페이스 기술은 필수적이다. 특히 휴먼 손동작 인식 기술은 직관적인 상호작용을 가능하게 하여, 다양한 분야에서 편리한 컨트롤러로 사용할 수 있다. 본 연구에서는 뎁스 영상 기반의 1 인칭 시점 손동작 인식을 위하여 손동작 데이터베이스 생성 시스템을 구축하여, 손동작 인식기 학습에 필요한 1 인칭(Egocentric View Point) 데이터베이스를 촬영하여 제작한다. 그리고 모바일 Head Mounted Device(HMD) VR 을 위한 뎁스 영상 기반 1 인칭 시점 손동작 인식(Hand Pose Recognition, HPR) 딥러닝 Deep Residual Network 를 구현한다. 최종적으로, 안드로이드 모바일 디바이스에 학습된 Residual Network Regressor 를 이식하고 모바일 VR 에 실시간 손동작 인식 시스템을 구동하여, 모바일 VR 상 실시간 3D 손동작 인식을 가상 물체와의 상호작용을 통하여 확인 한다.