• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.2
• /
• pp.136-140
• /
• 2014

This paper introduces a multi-touch recognition and tracking method for self capacitive TSP(Touch Screen Pannel). Self capacitive TSP recognizes finger touches by sensing capacitive change of ITO transparent conducting film arranged by rows and columns on the TSP pannel. They have some advantages such as high SNR, fast sensing, and simple touch processing, but have very difficulties for multi-touch processing. This disadvantage makes that the mutual capacitive TSPs, which have no such disadvantage, have been more widely used especially for multi-touch applications. However, since the other applications for remote control pad or recently developed wearable devises have only restrictive requirements for multi-touch, the disadvantage of self capacitive TSP is not a critical problem. In this paper, we first describe multi-touch recognition problems in self capacitive TSP and then propose how to overcome those problems and a tracking method of two touches when they are moving. Experimental results of our method showed that our algorithm works well in two touches.

• Smart Media Journal
• /
• v.4 no.1
• /
• pp.16-24
• /
• 2015

In this paper, we propose a method for multi-touch tracking using MRF-based particle filters and gesture likelihood estimation Each touch (of one finger) is considered to be one object. One of frequently occurring issues is the hijacking problem which means that an object tracker can be hijacked by neighboring object. If a predicted particle is close to an adjacent object then the particle's weight should be lowered by analysing the influence of neighboring objects for avoiding hijacking problem. We define a penalty function to lower the weights of those particles. MRF is a graph representation where a node is the location of a target object and an edge describes the adjacent relation of target object. It is easy to utilize MRF as data structure of adjacent objects. Moreover, since MRF graph representation is helpful to analyze multi-touch gestures, we describe how to define gesture likelihoods based on MRF. The experimental results show that the proposed method can avoid the occurrence of hijacking problems and is able to estimate gesture likelihoods with high accuracy.

• Journal of Korea Society of Industrial Information Systems
• /
• v.21 no.1
• /
• pp.27-34
• /
• 2016

In this paper, we propose how to recognize a multi-touch in the virtual touch type. Virtual touch has an advantage that it is installed only simple depth camera compared to the physical touch manners and it can be implemented with low cost for extracting an object exactly from only the difference of the depth values between the object and background. However, the accuracy for implementing the multi-touch has lowered. This paper presents a method to increase the accuracy of the multi-touch through the algorithms of binarization, labelling, and object tracking for multi-object recognition. Simulation results show that the proposed method can provide a variety of multi-touch events.

• Proceedings of the KWS Conference
• /
• 2002.10a
• /
• pp.706-713
• /
• 2002

In the multi-pass welding of pressure vessels or ships, the mechanical touch sensor system is generally used together with a manipulator to measure the gap and depth of the narrow gap to perform seam tracking. Unfortunately, such mechanical touch sensors may commit measuring errors caused by the eterioration of the measuring device. An automation system of narrow gap multi-pass welding using a laser vision system which can track the seam line of narrow gap and which can control welding power has been developed. The joint profile of the narrow gap, with 250mm depth and 28mm width, can be captured by laser vision camera. The image is then processed for defining tracking positions of the torch during welding. Then, the real-time correction of lateral and vertical position of the torch can be done by the laser vision system. The adaptive control of welding conditions like welding Currents and welding speeds, can also be performed by the laser vision system, which cannot be done by conventional mechanical touch systems. The developed automation system will be adopted to reduce the idle time of welders, which happens frequently in conventional long welding processes, and to improve the reliability of the weld quality as well.

• International Journal of Korean Welding Society
• /
• v.2 no.1
• /
• pp.45-51
• /
• 2002

In the multi-pass welding of pressure vessels or ships, the mechanical touch sensor system is generally used together with a manipulator to measure the gap and depth of the narrow gap to perform seam tracking. Unfortunately, such mechanical touch sensors may commit measuring errors caused by the deterioration of the measuring device. An automation system of narrow gap multi-pass welding using a laser vision system which can track the seam line of narrow gap and which can control welding power has been developed. The joint profile of the narrow gap, with 250mm depth and 28mm width, can be captured by laser vision camera. The image is then processed for defining tracking positions of the torch during welding. Then, the real-time correction of lateral and vertical position of the torch can be done by the laser vision system. The adaptive control of welding conditions like welding currents and welding speeds, can also be performed by the laser vision system, which cannot be done by conventional mechanical touch systems. The developed automation system will be adopted to reduce the idle time of welders, which happens frequently in conventional long welding processes, and to improve the reliability of the weld quality as well.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.3
• /
• pp.1-12
• /
• 2011

Large-sized multi-touch screen is usually made using infrared rays. That is because it has technical constraints or cost problems to make the screen with the other ways using such as existing resistive overlays, capacitive overlay, or acoustic wave. Using infrared rays to make multi-touch screen is easy, but is likely to have technical limits to be implemented. To make up for these technical problems, two other methods were suggested through Surface project, which is a next generation user-interface concept of Microsoft. One is Frustrated Total Internal Reflection (FTIR) which uses infrared cameras, the other is Diffuse Illumination (DI). FTIR and DI are easy to be implemented in large screens and are not influenced by the number of touch points. Although FTIR method has an advantage in detecting touch-points, it also has lots of disadvantages such as screen size limit, quality of the materials, the module for infrared LED arrays, and high consuming power. On the other hand, DI method has difficulty in detecting touch-points because of it's structural problems but makes it possible to solve the problem of FTIR. In this thesis, we study the algorithms for effectively correcting the distort phenomenon of optical lens, and image processing algorithms in order to solve the touch detecting problem of the original DI method. Moreover, we suggest calibration algorithms for improving the accuracy of multi-touch, and a new tracking technique for accurate movement and gesture of the touch device. To verify our approaches, we implemented a table-based multi touch screen.

• Journal of Korea Entertainment Industry Association
• /
• v.5 no.2
• /
• pp.87-95
• /
• 2011

Recently, the issue has been tangible game environment due to the various interactive interface developments. In this paper, we propose the multi card touch based interactive arcade system by using marker recognition interface and multi-touch interaction interface. For our system, the card's location and orientation information is recognized through DI-based recognition algorithm. In addition, the user's hand gesture tracking informations are provided by the various interaction metaphors. The system provides the user with a higher engagement offers a new experience. Therefore, our system will be used in the tangible arcade game machine.

• The Journal of the Korea Contents Association
• /
• v.13 no.12
• /
• pp.551-559
• /
• 2013

In this paper, we proposed a tangible RealBook based on the interface of TouchFace-V which is able to recognize multi-touch and hand gesture. The TouchFace-V is applied projection technology on a flat surface such as table, without constraint of space. The system's configuration is addressed installation, calibration, and portability issues that are most existing front-projected vision-based tabletop display. It can provide hand touch and gesture applying computer vision by adopting tracking technology without sensor and traditional input device. The RealBook deals with the combination of each advantage of analog sensibility on texts and multimedia effects of e-book. Also, it provides digitally created stories that would differ in experiences and environments with interacting users' choices on the interface of the book. We proposed e-book that is new concept of electronic book; named RealBook, different from existing and TouchFace-V interface, which can provide more direct viewing, natural and intuitive interactions with hand touch and gesture.

• Journal of Korea Game Society
• /
• v.10 no.2
• /
• pp.57-66
• /
• 2010

In the prior works on tabletop systems, a projection-based tabletop surface is mostly used to display computer images, and the participants interact with the display surface by hand multi-touching or using some tangible objects. In this research, however, we developed the FishBowl game that employs a scalable tabletop tiled display with infrared camera tracking coupled with PDA mobile interfaces. The focus of this game is to enhance user interactivity and realistic experience by coupling the high-resolution tabletop virtual environment and PDA mobile interface. This paper describes the game design followed by the system design and its detailed implementations. It also discusses the system usability and recommendation for its improvements after interviewing game players and then concludes with future research directions.

• The Journal of the Korea Contents Association
• /
• v.13 no.1
• /
• pp.55-63
• /
• 2013

NUI(Natural User Interfaces) has been developed through CLI(Command Line Interfaces) and GUI(Graphical User Interfaces). NUI uses many different input modalities, including multi-touch, motion tracking, voice and stylus. In order to adopt NUI to legacy GUI applications, he/she must add device libraries, modify relevant source code and debug it. In this paper, we propose a gesture-based interface model that can be applied without modification of the existing event-based GUI applications and also present the XML schema for the specification of the model proposed. This paper shows a method of using the proposed model through a prototype.