• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.11
• /
• pp.2125-2130
• /
• 2016

In this paper, we researched the excellency of 3D graphic nursery contents which is developed by mobile AR technology. AR technology has currently people's attention because of the potential to be core contents of future ICT industry. We applied AR nursery contents for kid's subtitle language selection in Korean, Chinese and English education. The original fairy tale consisted of 6~8 scenes for the 3D contents production, and was adapted and translated. Dubbing was dubbed by the native speaker using the standard pronunciation, and the effect sound was edited separately to fit the scene. After composing a scenario, constructing a 3D model, constructing a interaction, constructing a sound effect, and creating content metadata, the Unity 3D game engine is executed to create a project and describe it as a script. It provides a fun and informative tradition of fairy tales with abundant content that incorporates ICT technology, accepting advanced technology-based education, and having opportunities to perceive software in daily life.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.10a
• /
• pp.686-689
• /
• 2018

3D 손 포즈 추정(Hand Pose Estimation, HPE)은 스마트 인간 컴퓨터 인터페이스를 위해서 중요한 기술이다. 이 연구에서는 딥러닝 방법을 기반으로 하여 단일 RGB-Depth 카메라로 촬영한 양손의 3D 손 자세를 실시간으로 인식하는 손 포즈 추정 시스템을 제시한다. 손 포즈 추정 시스템은 4단계로 구성된다. 첫째, Skin Detection 및 Depth cutting 알고리즘을 사용하여 양손을 RGB와 깊이 영상에서 감지하고 추출한다. 둘째, Convolutional Neural Network(CNN) Classifier는 오른손과 왼손을 구별하는데 사용된다. CNN Classifier 는 3개의 convolution layer와 2개의 Fully-Connected Layer로 구성되어 있으며, 추출된 깊이 영상을 입력으로 사용한다. 셋째, 학습된 CNN regressor는 추출된 왼쪽 및 오른쪽 손의 깊이 영상에서 손 관절을 추정하기 위해 다수의 Convolutional Layers, Pooling Layers, Fully Connected Layers로 구성된다. CNN classifier와 regressor는 22,000개 깊이 영상 데이터셋으로 학습된다. 마지막으로, 각 손의 3D 손 자세는 추정된 손 관절 정보로부터 재구성된다. 테스트 결과, CNN classifier는 오른쪽 손과 왼쪽 손을 96.9%의 정확도로 구별할 수 있으며, CNN regressor는 형균 8.48mm의 오차 범위로 3D 손 관절 정보를 추정할 수 있다. 본 연구에서 제안하는 손 포즈 추정 시스템은 가상 현실(virtual reality, VR), 증강 현실(Augmented Reality, AR) 및 융합 현실 (Mixed Reality, MR) 응용 프로그램을 포함한 다양한 응용 분야에서 사용할 수 있다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.1137-1140
• /
• 2019

가상현실(Virtual Reality, VR), 증강현실(Augmented Reality, AR), 혼합현실(Mixed Reality, MR) 분야에 유용한 인간 컴퓨터 인터페이스 기술은 필수적이다. 특히 휴먼 손동작 인식 기술은 직관적인 상호작용을 가능하게 하여, 다양한 분야에서 편리한 컨트롤러로 사용할 수 있다. 본 연구에서는 뎁스 영상 기반의 1 인칭 시점 손동작 인식을 위하여 손동작 데이터베이스 생성 시스템을 구축하여, 손동작 인식기 학습에 필요한 1 인칭(Egocentric View Point) 데이터베이스를 촬영하여 제작한다. 그리고 모바일 Head Mounted Device(HMD) VR 을 위한 뎁스 영상 기반 1 인칭 시점 손동작 인식(Hand Pose Recognition, HPR) 딥러닝 Deep Residual Network 를 구현한다. 최종적으로, 안드로이드 모바일 디바이스에 학습된 Residual Network Regressor 를 이식하고 모바일 VR 에 실시간 손동작 인식 시스템을 구동하여, 모바일 VR 상 실시간 3D 손동작 인식을 가상 물체와의 상호작용을 통하여 확인 한다.

• Trans-
• /
• v.9
• /
• pp.93-122
• /
• 2020

I intended to establish Augmented Reality(AR) Museum of 3D Cyber Space where artists and graphic designers can freely create in user integrated environment. This study is aimed at building a sufficient and integrated production environment for artists and graphic designers who utilize three-dimensional simulation methods in integrated development environment(IDE). This study intends to build a 3D simulation engine and a creation module of augment reality of 3D cyber space in Android platform to help artists and graphic designers to freely perform their creation in IDE. Based on these designs, I produced exhibition rooms of National Museum of Contemporary Art in 3D virtual space in which artists and graphic designers can put the graphics they have created on display, conducted a user survey and conducted tasking to an Android smartphone.

• Physical Therapy Rehabilitation Science
• /
• v.3 no.1
• /
• pp.13-19
• /
• 2014

Objective: The purpose of this study was to determine the effects of Augmented Reality-based Postural Control (ARPC) training on balance and gait function in patients with stroke. Design: Single-blind randomized controlled trial. Methods: Twenty participants who experienced a stroke were enrolled in the study and randomly assigned to the ARPC (n=10) or control group (n=10). Subjects in both groups received conventional physical therapy for 60 min per session, 5 days per week, for 4 weeks. In addition, subjects in the ARPC group received ARPC training for 30 min per day, 3 days per week, for 4 weeks. The participants watched established normal postural control patterns on a head-mounted display and repeated the movements in ARPC training. Outcome measurements were assessed using the Berg Balance Scale (BBS) and 10-Meter Walk Test (10MWT) before and after 4 weeks of training. Results: Of the 20 randomized participants, only 18 completed the 4-week training program. The ARPC group showed significant improvement in the BBS and 10MWT after training (p<0.05). Meanwhile, the control group did not exhibit improvement in either variable. In addition, the ARPC group showed significantly greater improvement than the control group in the 10MWT (p<0.05), whereas no significant difference was observed between the groups for the BBS. Conclusions: The results of this study confirmed the benefits of ARPC training on dynamic balance and functional gait ability. Additionally, this study may provide evidence supporting the use of an ARPC training program for improving balance and gait ability in patients after a chronic stroke.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.23 no.7
• /
• pp.822-828
• /
• 2019

An Augmented Reality(AR) provides virtual information with a real environment, and the processor needs to access the memory for the AR system. However, the processor has the heavy workload as the technology improvement leads to increase the size of data. We need a specific module to reduce the workload to overcome the limitation. In this paper, we propose a Direct Memory Access(DMA) controller displaying image instead of the processor. We implemented the proposed DMA controller on a Field Programmable Gate Array(FPGA) and demonstrated the functionality of the DMA controller based on an Avalon Memory Mapped(Avalon-MM) interface. Also, the DMA controller is fabricated by using Magnachip/Hynix 0.35um CMOS technology and verified the feasibility of the embedded system.

• Journal of Broadcast Engineering
• /
• v.23 no.6
• /
• pp.914-924
• /
• 2018

In this paper, we implement an Android application for infant language education using marker-based augmented reality. Combining animal word markers (noun), size/color word markers (adjective), and action word markers (verb) in puzzle form to make a simple sentence, the application shows virtual contents related to the content of the sentence. For example, when an animal marker is showed up on a camera, the corresponding animal appears. Additionally, when the motion markers are combined, the animal's appearance changes into an animation in which it acts. When a user touched a marker, user can hear the sound of the word, which gives an auditory effect, and by adding the rotation function, user can see the animation in any direction. Our goal is to increase infants' interest in learning language and also increase the effectiveness of education on the meaning of words and the structure of simple sentences, by encouraging them to actively participate in language learning through visual and auditory stimuli.

• Journal of Advanced Navigation Technology
• /
• v.24 no.6
• /
• pp.633-639
• /
• 2020

Despite the growing educational demand for the extended reality (XR) convergence content creation for non-IT students, fewer studies have attempted to education material development. In this paper, non-IT students' requirement to create XR convergence contents was analyzed and designed framework system specification. The object-oriented application framework (OOAF) was developed for non-IT students to create XR convergence contents through simple interaction methods such as drag and drop in-game engines. To evaluate the developed framework XR contents development course was operated with 26 industrial design majors sophomore in university. More than 90% of students succeeded in working on prototype XR contents in Oculus Rift. This result will be expected to improve the quality of XR contents creation education for non-IT students and contribute to the growth of the future convergence contents industry.

• International Journal of Computer Science & Network Security
• /
• v.22 no.7
• /
• pp.268-282
• /
• 2022

One of the most important technologies today is augmented reality technology, it allows users to experience the real world using virtual objects that are combined with the real world. This technology is interesting and has become applied in many sectors such as the shopping and medicine, also it has been included in the sector of education. In the field of education, AR technology has become widely used due to its effectiveness. It has many benefits, such as arousing students' interest in learning imaginative concepts that are difficult to understand. On the other hand, studies have proven that collaborative between students increases learning opportunities by exchanging information, and this is known as Collaborative Learning. The use of multimodal creates a distinctive and interesting experience, especially for students, as it increases the interaction of users with the technologies. The research aims at developing collaborative framework for developing achievement of 6th graders through designing a framework that integrated a collaborative framework with a multimodal input "hand-gesture and touch", considering the development of an effective, fun and easy to use framework with a multimodal interaction in AR technology that was applied to reformulate the genetics and traits lesson from the science textbook for the 6th grade, the first semester, the second lesson, in an interactive manner by creating a video based on the science teachers' consultations and a puzzle game in which the game images were inserted. As well, the framework adopted the cooperative between students to solve the questions. The finding showed a significant difference between post-test and pre-test of the experimental group on the mean scores of the science course at the level of remembering, understanding, and applying. Which indicates the success of the framework, in addition to the fact that 43 students preferred to use the framework over traditional education.

• Journal of the Korea Society for Simulation
• /
• v.31 no.2
• /
• pp.21-32
• /
• 2022

The ROK Navy is seeking to secure an aircraft carrier(CVX) to take responsibility for the maritime security of the Republic of Korea. In order for the CVX to complete the mission given to it, the crew must be able to operate the CVX perfectly, and for this purpose, the operating skills of the CVX crew result from constant training. Therefore, this paper proposes an On-board Training System(OBTS) so that the best training can always be performed even on ship. CVX OBTS should be built in the form of a thorough simulator based on a Synthetic Training Environment(STE) so that it can be optimally applied to ship and provide the best training environment to the crew. In order to satisfy the various training requirements and implementation conditions of the CVX, this paper proposes a plan to consist of Embedded Training System(ETS), VR training system, AR maintenance system, MR training system, MR metaverse training system, and realistic simulator training system.