• Title/Summary/Keyword: Natural User Interfaces

Search Result 47, Processing Time 0.02 seconds

3D Virtual Reality Game with Deep Learning-based Hand Gesture Recognition (딥러닝 기반 손 제스처 인식을 통한 3D 가상현실 게임)

  • Lee, Byeong-Hee;Oh, Dong-Han;Kim, Tae-Young
    • Journal of the Korea Computer Graphics Society
    • /
    • v.24 no.5
    • /
    • pp.41-48
    • /
    • 2018
  • The most natural way to increase immersion and provide free interaction in a virtual environment is to provide a gesture interface using the user's hand. However, most studies about hand gesture recognition require specialized sensors or equipment, or show low recognition rates. This paper proposes a three-dimensional DenseNet Convolutional Neural Network that enables recognition of hand gestures with no sensors or equipment other than an RGB camera for hand gesture input and introduces a virtual reality game based on it. Experimental results on 4 static hand gestures and 6 dynamic hand gestures showed that they could be used as real-time user interfaces for virtual reality games with an average recognition rate of 94.2% at 50ms. Results of this research can be used as a hand gesture interface not only for games but also for education, medicine, and shopping.

Intelligent interface using hand gestures recognition based on artificial intelligence (인공지능 기반 손 체스처 인식 정보를 활용한 지능형 인터페이스)

  • Hangjun Cho;Junwoo Yoo;Eun Soo Kim;Young Jae Lee
    • Journal of Platform Technology
    • /
    • v.11 no.1
    • /
    • pp.38-51
    • /
    • 2023
  • We propose an intelligent interface algorithm using hand gesture recognition information based on artificial intelligence. This method is functionally an interface that recognizes various motions quickly and intelligently by using MediaPipe and artificial intelligence techniques such as KNN, LSTM, and CNN to track and recognize user hand gestures. To evaluate the performance of the proposed algorithm, it is applied to a self-made 2D top-view racing game and robot control. As a result of applying the algorithm, it was possible to control various movements of the virtual object in the game in detail and robustly. And the result of applying the algorithm to the robot control in the real world, it was possible to control movement, stop, left turn, and right turn. In addition, by controlling the main character of the game and the robot in the real world at the same time, the optimized motion was implemented as an intelligent interface for controlling the coexistence space of virtual and real world. The proposed algorithm enables sophisticated control according to natural and intuitive characteristics using the body and fine movement recognition of fingers, and has the advantage of being skilled in a short period of time, so it can be used as basic data for developing intelligent user interfaces.

  • PDF

Virtual Object Weight Information with Multi-modal Sensory Feedback during Remote Manipulation (다중 감각 피드백을 통한 원격 가상객체 조작 시 무게 정보 전달)

  • Changhyeon Park;Jaeyoung Park
    • Journal of Internet Computing and Services
    • /
    • v.25 no.1
    • /
    • pp.9-15
    • /
    • 2024
  • As virtual reality technology became popular, a high demand emerged for natural and efficient interaction with the virtual environment. Mid-air manipulation is one of the solutions to such needs, letting a user manipulate a virtual object in a 3D virtual space. In this paper, we focus on manipulating a remote virtual object while visually displaying the object and providing tactile information on the object's weight. We developed two types of wearable interfaces that can provide cutaneous or vibrotactile feedback on the virtual object weight to the user's fingertips. Human perception of the remote virtual object weight during manipulation was evaluated by conducting a psychophysics experiment. The results indicate a significant effect of haptic feedback on the perceived weight of the virtual object during manipulation.

Nationwide Comprehensive GIS for Natural Environment using Spatial Data Integration Technique (공간데이타 통합 기능을 활용한 국가자연환경 종합 GIS구축)

  • Um, Jung-Sup;Kim, Yeun-Jung
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.4 no.1
    • /
    • pp.1-17
    • /
    • 2001
  • This research is primarily intended to develop a decision-making support system about the natural environment in the country by integrating various formats of spatial data into a comprehensive GIS database. The first part of the research is to design GIS database as a means of combining thematic cartographic data with field survey records. Ecosystem records acquired by a field sampling have been reproduced as digital thematic maps. The database also included various natural environment related data (map for forestry, soil, national park etc.) collected from many other agencies. The second part of the research is devoted to the design of efficient man-machine interfaces. A key concern in the GUI (graphic user interface) design process was to address the need to handle and to manage large databases by non-GIS experts. The system has been checked experimentally, enabled the users to quarry the data required simply and execute spatial analysis accommodating versatile alternatives in decision-making process. Detailed visual maps can be generated over large areas quickly and easily. The system will serve to increase the scientific and objective decision-making by overcoming serious constraints suffered from the past non-GIS-based approach. It is anticipated that this research output could be used as a valuable reference in building a nationwide natural environment GIS-DB (database) in the central and local governments.

  • PDF

Performance Analysis of 3D Color Picker in Virtual Reality (가상현실 3차원 색상 선택기의 성능 분석)

  • Kim, Jieun;Lee, Jieun
    • Journal of the Korea Computer Graphics Society
    • /
    • v.27 no.2
    • /
    • pp.1-11
    • /
    • 2021
  • In a virtual environment, a 3D workspace and 3D interaction are possible, but most virtual reality applications use a 2D color picker. This paper implements a 3D color picker based on 3D color space in a virtual environment, and compares color selection performance with the existing 2D color picker. The 3D color picker is intuitive by using the 3D color space as it is, and it can position the 3D pointer at a specific point in the color space using a controller, which is a virtual reality device, so a user can select a color in one step. On the other hand, the 2D color picker has the advantage of being familiar with existing users who work with colors in a computer environment, but has a disadvantage that requires several steps of user interaction since it has to set color properties through 2D interfaces. Based on user experiments, we confirmed the usefulness of a 3D color picker in addition to a 2D color picker in a virtual environment, and it was possible to perform natural 3D work in a virtual environment using the 3D color picker.

Design and Implementation of Financial Information Systems for the Small Farm Business Decision Supports (소규모 농가의 영농의사결정 지원을 위한 재무정보시스템 설계 및 구현)

  • Lee Hee-Sook;Kim Sang-Wook;Oh Myeong-Ryoon;Kim Jong-Tae;Park Sang-Hyun
    • Journal of Information Technology Applications and Management
    • /
    • v.13 no.1
    • /
    • pp.149-166
    • /
    • 2006
  • During the past several years, a number of attempts have been made to develop computer applications for the farm business. However, none of them truned out properly applicable to small farms occupying more than 90% of the total agri-business in number as they failed to take it into consideration that small farm, typically a private busines is quite different by nature from the large-scaled farm corporate. Small-sized farming is usually done on the houshold basis, and thus there is no distinction between the household and the business economy. In addition, small farm managers are mostly lacking knowledge or skills of both computers and accounting. This study, therefore, aims at the design and implementation of the financial management and accountign information system for small farms, with an attempt to relax constraints and resolve pitfalls revealed in previously developed applications. The following principles were introduced for the study : 1) The user-system interfaces have to be managed in the natural language as much as possible, so that the users can operate the system without any professional terms. 2) Household accounting has to be seperarte by some means from the business accounting, so that small farm businesses can manage their finance and accounting as necessary. 3) The system has to be designed so as not only for the users to manage transactional data but to analyse historical data in multiple dimensions for their decision-makings. The results from this study would perhaps help not only for the farmers but for the educators, policy makers, and counselors for the farming.

  • PDF

A Study on the Interactive Narrative - Focusing on the analysis of VR animation <Wolves in the Walls> (인터랙티브 내러티브에 관한 연구 - VR 애니메이션 <Wolves in the Walls>의 분석을 중심으로)

  • Zhuang Sheng
    • Trans-
    • /
    • v.15
    • /
    • pp.25-56
    • /
    • 2023
  • VR is a dynamic image simulation technology with very high information density. Among them, spatial depth, temporality, and realism bring an unprecedented sense of immersion to the experience. However, due to its high information density, the information contained in it is very easy to be manipulated, creating an illusion of objectivity. Users need guidance to help them interpret the high density of dynamic image information. Just like setting up navigation interfaces and interactivity in games, interactivity in virtual reality is a way to interpret virtual content. At present, domestic research on VR content is mainly focused on technology exploration and visual aesthetic experience. However, there is still a lack of research on interactive storytelling design, which is an important part of VR content creation. In order to explore a better interactive storytelling model in virtual reality content, this paper analyzes the interactive storytelling features of the VR animated version of <Wolves in the walls> through the methods of literature review and case study. We find that the following rules can be followed when creating VR content: 1. the VR environment should fully utilize the advantages of free movement for users, and users should not be viewed as mere observers. The user's sense of presence should be fully considered when designing interaction modules. Break down the "fourth wall" to encourage audience interaction in the virtual reality environment, and make the hot media of VR "cool". 2.Provide developer-driven narrative in the early stages of the work so that users are not confused about the ambiguous world situation when they first enter a virtual environment with a high degree of freedom. 1.Unlike some games that guide users through text, you can guide them through a more natural interactive approach that adds natural dialog between the user and story characters (NPC). Also, since gaze guidance is an important part of story progression, you should set up spatial scene user gaze guidance elements within it. For example, you can provide eye-following cues, motion cues, language cues, and more. By analyzing the interactive storytelling features and innovations of the VR animation <Wolves in the walls>, I hope to summarize the main elements of interactive storytelling from its content. Based on this, I hope to explore how to better showcase interactive storytelling in virtual reality content and provide thoughts on future VR content creation.