• 제목/요약/키워드: Physical user interface

Search Result 230, Processing Time 0.033 seconds

Visual Feedback System for Manipulating Objects Using Hand Motions in Virtual Reality Environment (가상 환경에서의 손동작을 사용한 물체 조작에 대한 시각적 피드백 시스템)

  • Seo, Woong;Kwon, Sangmo;Ihm, Insung
    • Journal of the Korea Computer Graphics Society
    • /
    • v.26 no.3
    • /
    • pp.9-19
    • /
    • 2020
  • With the recent development of various kinds of virtual reality devices, there has been an active research effort to increase the sense of reality by recognizing the physical behavior of users rather than by classical user input methods. Among such devices, the Leap Motion controller recognizes the user's hand gestures and can realistically trace the user's hand in a virtual reality environment. However, manipulating an object in virtual reality using a recognized user's hand often causes the hand to pass through the object, which should not occur in the real world. This study presents a way to build a visual feedback system for enhancing the user's sense of interaction between hands and objects in virtual reality. In virtual reality, the user's hands are examined precisely by using a ray tracing method to see if the virtual object collides with the user's hand, and when any collision occurs, visual feedback is given through the process of reconstructing the user's hand by moving the position of the end of the user's fingers that enter the object through sign distance field and reverse mechanics. This enables realistic interaction in virtual reality in real time.

Network human-robot interface at service level

  • Nguyen, To Dong;Oh, Sang-Rok;You, Bum-Jae
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1938-1943
    • /
    • 2005
  • Network human-robot interface is an important research topic. In home application, users access the robotic system directly via voice, gestures or through the network. Users explore a system by using the services provided by this system and to some extend users are enable to participate in a service as partners. A service may be provided by a robot, a group of robots or robots and other network connected systems (distributed sensors, information systems, etc). All these services are done in the network environment, where uncertainty such as the unstable network connection, the availability of the partners in a service, exists. Moreover, these services are controlled by several users, accessing at different time by different methods. Our research aimed at solving this problem to provide a high available level, flexible coordination system. In this paper, a multi-agent framework is proposed. This framework is validated by using our new concept of slave agents, a responsive multi-agent environment, a virtual directory facilitator (VDF), and a task allocation system using contract net protocol. Our system uses a mixed model between distributed and centralized model. It uses a centralized agent management system (AMS) to control the overall system. However, the partners and users may be distributed agents connected to the center through agent communication or centralized at the AMS container using the slave agents to represent the physical agents. The system is able to determine the task allocation for a group of robot working as a team to provide a service. A number of experiments have been conducted successfully in our lab environment using Issac robot, a PDA for user agent and a wireless network system, operated under our multi agent framework control. The experiments show that this framework works well and provides some advantages to existing systems.

  • PDF

Tactile Sensing for Virtual Interaction as a Part of Ubiquitous Game Development (유비쿼터스게임의 상호작용 구성요소 개발을 위한 촉각응용)

  • Lee, Young-Jae
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.6
    • /
    • pp.1062-1068
    • /
    • 2007
  • In order to design and develop a ubiquitous game, it is necessary to develop a natural and flexible interface between the real world and the virtual world, based on social and physical context awareness. We design user interface model and the tactile sensing system that performs virtual interaction and collection of the sensor data. It is sensitive so the collected data should be filtered, rearranged and analyzed. This information is quite different from stylus input, keyboard, button or mouse for interaction. We detect kicked 3D force position of a ball, moment of area, moment of inertia and modified ball shape using tactile sensing system and analyzed data. The results demonstrate that the proposed approach is desirable and robust as well as the results can be used realistic actions and reactions considering attack force and to make interesting environments for ubiquitous game.

Efficient Mobile Writing System with Korean Input Interface Based on Face Recognition

  • Kim, Jong-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.25 no.6
    • /
    • pp.49-56
    • /
    • 2020
  • The virtual Korean keyboard system is a method of inputting characters by touching a fixed position. This system is very inconvenient for people who have difficulty moving their fingers. To alleviate this problem, this paper proposes an efficient framework that enables keyboard input and handwriting through video and user motion obtained through the RGB camera of the mobile device. To develop this system, we use face recognition to calculate control coordinates from the input video, and develop an interface that can input and combine Hangul using this coordinate value. The control position calculated based on face recognition acts as a pointer to select and transfer the letters on the keyboard, and finally combines the transmitted letters to integrate them to perform the Hangul keyboard function. The result of this paper is an efficient writing system that utilizes face recognition technology, and using this system is expected to improve the communication and special education environment for people with physical disabilities as well as the general public.

Development of Kinect-Based Pose Recognition Model for Exercise Game (운동 게임을 위한 키넥트 센서 기반 운동 자세 인식 모델 개발)

  • Park, Kyoung Shin
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.5 no.10
    • /
    • pp.303-310
    • /
    • 2016
  • Recently there has been growing popularity in exergame, such as Wii Sport or Xbox Fitness game, which enables users to get physical exercise while playing the games. In such experienced exercise games, the user's posture recognition is very important to find out exactly how much the users need to take their body posture as compared to the proper posture. This paper proposes a new exercise posture recognition model designed for the exercise game content for the elderly. The proposed model is based on extracting feature points of a skeleton model provided by the Kinect sensor to generate the feature vectors to recognize the user's exercise posture information. This paper describes the design and implementation of the exercise posture recognition model and demonstrates the feasibility of this proposed posture recognition model through a simple experiment. The experimental results showed 94.52% of average accordance rate for 12 exercise postures of 10 participants.

Interactive electronic book utilizing tabletop display and digi-pet (테이블탑 디스플레이와 디지팻을 활용한 상호작용 전자책)

  • Song, dae-hyeon;Park, jae-wan;Lee, yong-chul;Kim, dong-min;Moon, joo-pil;Lee, chil-woo
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.175-178
    • /
    • 2009
  • In this paper, we describe about interactive electronic book utilizing tabletop display interface and digi-pet. Because of this system can define a lot of gestures using touch point of finger, help that user experiences electronic book effectively more than existent input device. Also, support 1 users in 1 input device in existent mode, but this system can expect various effect because support Multi-user. The digi-pet(digital pet) is physical tools that convey emotion between tabletop display platform and user. And this shows various results acting as assistance because becomes master of story of imagination and participate directly on talk and makes change of story. In this paper, we described about oriented electronic book system the future that combines tabletop display and Digi-pet. This system is expected that the usefulness is increased by leaps and bounds along with technology development forward.

  • PDF

Virtual Tactical Map : Military Briefing Tools for Virtual Training based on Augmented Reality (가상 전술 지도 : 증강현실에 기반한 군사 훈련 브리핑 도구)

  • Jung Kyung-Boo;Lee Sang-Won;Choi Byung-Uk;Jeong Seung-Do
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.31 no.4C
    • /
    • pp.341-350
    • /
    • 2006
  • The sand table training is one of the most effective training method in military operations which can accomplish missions such as simulation and rehearsal without limitations related to time, space, money and so on. Previous sand table training has many problems like that the sand table cannot represent real field condition because of its physical properties. So, it is hard to be preserved and impossible to include much of information into them. In this paper, we make an approach based on Augmented Reality(AR) to solve these problems and propose an efficient military training briefing tool with virtual sand table environment described as actual battle field Virtual Tactical Map(VTM) can realize a virtual military training with simple action like moving marker or tangible interface by hand. Real-time state information of VTM gives us more organic intelligence for entire situation. Tangible AR interface provides users with a contents authoring tool that is natural, intuitive and easy to deal with as interaction between user in real world and system that augmented real world with virtual object. VTM is a newly designed military training briefing tools. A military training content can be reproduced and it is possible that user uses this content later. Thus, it shows us potential possibilities of AR applications on military leaning field.

Embedded System Integrated Prototyping Mechanism Based on Reusable Component (재사용 가능한 컴포넌트 기반의 임베디드 시스템 통합 프로토타이핑 기법)

  • Sukmana, Husni Teja;Lee, Jeong-Bae;Rim, Kee-Wook;Hwang, Young-Sup;Kim, Young-Jin;Ahn, Sung-Soon
    • The KIPS Transactions:PartA
    • /
    • v.16A no.3
    • /
    • pp.199-208
    • /
    • 2009
  • Recently, there are many embedded system prototyping tools for helping embedded system designers to trial their product before it releases to the market. A prototype is very important for early embedded system design to grasp the desire functions, to get a good performance, to create delightful user interface, and to increase the valuable of the product. Prototyping tools can be classified by three categories: Physical, Virtual and Modeling prototyping. The integration of these prototyping tools becomes valuable for speed up time-to-market and for decrease design cost when design embedded system. The problem comes up because these tools sometime do not provide an instrument for communicating each other. In this paper, we propose a flexible and reusable mechanism for integrate these tools base on JavaBeans and ActiveX technology. We show how this mechanism can be employed in various prototyping tools.

Comparison of Cost Function of IMRT Optimization with RTP Research Tool Box (RTB)

  • Ko, Young-Eun;Yi, Byong-Yong;Lee, Sang-Wook;Ahn, Seung-Do;Kim, Jong-Hoon;Park, Eun-Kyung
    • Proceedings of the Korean Society of Medical Physics Conference
    • /
    • 2002.09a
    • /
    • pp.65-67
    • /
    • 2002
  • A PC based software, the RTP Research Tool Box (RTB), was developed for IMRT optimization research. The software was consisted of an image module, a beam registration module, a dose calculation module, a dose optimization module and a dose display module. The modules and the Graphical User Interface (GUI) were designed to easily amendable by negotiating the speed of performing tasks. Each module can be easily replaced to new functions for research purpose. IDL 5.5 (RSI, USA) language was used for this software. Five major modules enable one to perform the research on the dose calculation, on the dose optimization and on the objective function. The comparison of three cost functions, such as the uncomplicated tumor control probability (UTCP), the physical objective function and the pseudo-biological objective function, which was designed in this study, were performed with the RTB. The optimizations were compared to the simulated annealing and the gradient search optimization technique for all of the optimization objective functions. No significant differences were found among the objective functions with the dose gradient search technique. But the DVH analysis showed that the pseudo-biological objective function is superior to the physical objective function when with the simulated annealing for the optimization.

  • PDF

Games for Elderly People using u-Table (유테이블을 활용한 노인용 게임)

  • Hwang, Tae-Doo;Roh, Young-Tae;Lee, Jun;Park, Sung-Jun;Shin, Hae-Won;Kim, Jee-In
    • Journal of the Korea Computer Graphics Society
    • /
    • v.13 no.4
    • /
    • pp.13-19
    • /
    • 2007
  • Computer games for elderly people can be utilized as a tool not only for enjoying themselves but also for improving their health and quality of lives. It is reported that such games could be played in order to stimulate and enhance mental and physical capabilities of elderly people. It is also reported that traditional folk games are preferred to be played by elderly people rather than modern computer games. In this paper, we propose to use a tabletop interface, u-Table, and its corresponding natural gestures as a user interface for playing traditional folk games by elderly people. Since a table is a good place for people to get together, talk to each other and share their experiences, a tabletop interface can be used for playing games of cooperation, conversation and sharing. A set of traditional folk games were digitalized using u-Table. It was demonstrated that its users had better experiences of playing games with u-Table comparing to playing games using a mouse of a conventional computer.

  • PDF