• Journal of Intelligence and Information Systems
• /
• v.17 no.1
• /
• pp.53-69
• /
• 2011

Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

• 한국정보교육학회:학술대회논문집
• /
• 2005.08a
• /
• pp.409-415
• /
• 2005

세계적으로 로봇 산업이 차세대 신성장 동력 산업으로 급부상하여 인간과 상호작용 즉 HRI 연구가 활발히 이루어지고 있는데, 최근 들어 로봇의 교육적 활용 연구가 시작되고 있다. 이에 본 연구에서는 교사 보조 로봇의 수업에서의 활용 가능성을 보기위해 사전에 만화 시나리오를 통한 적합한 교과목 후보를 정하였고, 초등학생 6학년의 기대역할을 갖는 프로토타입 로봇을 설계 개발하여 후보 교과목 수업에 활용하는 실험을 실시하였다. 이를 통해 아동이 로봇에게 기대하는 역할이 실험자의 의도와 일치하는지와 교육적 효과 제고에 기여를 하는지를 알아보고자 하였다. 그 결과, 아동은 교사 보조 로봇을 자신보다 약간 높은 나이로 인식하고, 친근하지만 자신보다 우월하여 자신을 이끌어 줄 수 있는 역할을 기대한다는 것을 알 수 있었다. 또한 교사 보조 로봇 활용이 교사와 아동의 흥미 유발에 있어 매우 효과적임을 보여, 향후 교사 보조 로봇은 ICT 활용 교육의 또 다른 매체로서의 가능성을 확인하였다.

• International journal of advanced smart convergence
• /
• v.9 no.2
• /
• pp.28-37
• /
• 2020

We conducted a comprehensive review on the previous research on r-Learning. By reviewing 843 previous studies about r-Learning published from 2004 to 2015, this study investigated 1) the trend of research on r-Learning over time, 2) the characteristics of targeted students in r-Learning, 3) the educational activities implemented for r-Learning, and 4) the types of educational robots used for r-Learning. The study found that the research on r-Learning has rapidly and steadily increased and the types of educational activities and educational robots has been diversified. Relying on the findings of this review, this study suggests 1) ensuring growth in both the quality and the quantity of research on r-Learning, 2) broadening the target student population of r-Learning beyond the age-limited boundaries, 3) enhancing educational activities of r-Learning, and 4) recognizing the necessity for systematic and clear concepts of types of educational robots.

• Proceedings of the Korean Society of Machine Tool Engineers Conference
• /
• 2000.04a
• /
• pp.153-158
• /
• 2000

This paper addresses an intelligent robot control system using an off-line programming to teach a precise assembly task of electronic components in a flexible way. The investigated task consists of three job: heat caulking test, soldering on a circuit board, and checking of soldering defects on the back cover of a camera. This study investigates the remodelling of the most complicated cell in terms of the accuracy and fault rate among the twelve cells in a camera back-cover assembly line. We have attempted to enhance back-cover assembly line. We have attempted to enhance soldering quality, to add task flexibility, to reduce failure rate, and to increase product reliability. This study modifies the cell structure, and improves the soldering condition. The developed all system implements the real-time control of assembly with vision data, and realized an easier task teaching on off-line programming.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 1994.10a
• /
• pp.553-558
• /
• 1994

In this paper, we present a new approach for the automation of deburring process. An algorithm for teaching skills of a human expert to a robot manipulator is developed. This approach makes use of TSK fuzzy model that can express a highly nonlinear functional relation with small number of rules. Burr features such as height, width, area, cutting area are extracted from image processing by use of the vision system. Cutting depth, repeative number and normal cutting force are chosen as control signals representing actions of the human expert. It is verified that our processed fuzzy model can accurately express the skills of human experts for the deburring process.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 1996.10a
• /
• pp.27-34
• /
• 1996

GENIE is a learning-based engine for building intelligent systems. Learning in GENIE proceeds by incrementally modeling its human or technical environment using a neural network and a genetic algorithm. The neural network is used to represent the knowledge for solving a given task and has the ability to grow its structure. The genetic algorithm provides the neural network with training examples by actively exploring the example space of the problem. Integrated into the training examples by actively exploring the example space of the problem. Integrated into the GENIE system architecture, the genetic algorithm and the neural network build a virtually self-teaching autonomous learning system. This paper describes the structure of GENIE and its learning components. The performance is demonstrated on a robot learning problem. We also discuss the lessons learned from experiments with GENIE and point out further possibilities of effectively hybridizing genetic algorithms with neural networks and other softcomputing techniques.

• 제어로봇시스템학회:학술대회논문집
• /
• 2001.10a
• /
• pp.42.3-42
• /
• 2001

A human is an expert in manipulation. We have acquired skills to perform dexterous operations based upon knowledge and experience attained over a long period of time. It is important in robotics to understand these human skills, and utilize them to bring about better robot control and operation It is hoped that the neurocontroller can be trained and organized by simply presenting human teaching data, which implicate human intention, strategy and expertise. In designing a neurocontroller, we must determine the size of neurocontroller. Improper size may not only incur difficulties in training neural nets, e.g. no convergence, but also cause instability and erratic behavior in machines. Therefore, it is necessary to determine the proper size of neurocontroller for human control transfer. In this paper, a new pruning method is developed, based on the penalty-term methods. This method makes ...

• Journal of the Korean Society for Precision Engineering
• /
• v.13 no.3
• /
• pp.102-109
• /
• 1996

In this paper, we present a new approach for the automation of deburring process. An algorithm for teaching skills of a human expert to a robot manipulator is developed. This approach makes use of TSK fuzzy mode that can wxpress a highly nonlinear functional relation with small number of rules. Burr features such as height, width, area, grinding area are extracted from image processing by use of the vision system. Grinding depth, repetitive number and normal grinding force are chosen as control signals representing actions of the human expert. It is verified that our proposed fuzzy model can accurately express the skills of human experts for the deburring process.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.3
• /
• pp.135-142
• /
• 2015

As the importance of software to society has grown, more and more schools worldwide teach coding basics in the classroom. Despite the rapid spread of coding instruction in grade schools, experience in the classroom is certainly limited because there is a gap between the curriculum and the existing computing environment such as the mobile and cloud computing. We propose an approach to fill this gap by using a mobile environment and the robot on the cloud-based platform for effective teaching. In this paper, we propose an architecture called Cloudboard that enables knowledge sharing and collaboration among knowledge providers in the cloud-based robot platforms. We also describe five representative architectural patterns that are referenced and analyzed to design the Cloudboard architecture. Our early experimental results show that the Cloudboard can be effective in the development of collective robotic systems.

• Journal of the Korean Society of Manufacturing Process Engineers
• /
• v.12 no.6
• /
• pp.132-141
• /
• 2013

Robotic Drilling Systems(RDSs) set the standard for the factory automation systems in aerospace manufacturing. With the benefits of cost effective drilling and predictive maintenance, RDSs can provide greater flexibility in the manufacturing process. The system can be easily adopted to manage very complex and time-consuming processes, such as automated fastening hole drilling processes of large aircraft sections, where it would be difficult accomplished by workers following teaching or conventional guided methods. However, in order to build an RDS based on a CAD model, the precise calibration of the Tool Center Point(TCP) must be performed in order to define the relationships between the fastening-hole target and the End Effector(EEF). Based on the kinematics principle, the robot manipulator requires a new method to correct the 3D errors between the CAD model of the reference coordinate system and the actual measurements. The system can be called as a successful system if following conditions can be met; a. seamless integration of the industrial robot controller and the IO Level communication, b. performing pre-defined drilling procedures automatically. This study focuses on implementing a new technology called iGPS into the fastening-hole-drilling process, which is a critical process in aircraft manufacturing. The proposed system exhibits better than 100-micron 3D accuracy under the predefined working space. Based on the proposed EEF fastening-hole machining process, the corresponding processes and programs are developed, and its feasibility is studied.