• Title/Summary/Keyword: learning with a robot

Search Result 489, Processing Time 0.028 seconds

Multiple Human Recognition for Networked Camera based Interactive Control in IoT Space

  • Jin, Taeseok
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.22 no.1
    • /
    • pp.39-45
    • /
    • 2019
  • We propose an active color model based method for tracking motions of multiple human using a networked multiple-camera system in IoT space as a human-robot coexistent system. An IoT space is a space where many intelligent devices, such as computers and sensors(color CCD cameras for example), are distributed. Human beings can be a part of IoT space as well. One of the main goals of IoT space is to assist humans and to do different services for them. In order to be capable of doing that, IoT space must be able to do different human related tasks. One of them is to identify and track multiple objects seamlessly. In the environment where many camera modules are distributed on network, it is important to identify object in order to track it, because different cameras may be needed as object moves throughout the space and IoT space should determine the appropriate one. This paper describes appearance based unknown object tracking with the distributed vision system in IoT space. First, we discuss how object color information is obtained and how the color appearance based model is constructed from this data. Then, we discuss the global color model based on the local color information. The process of learning within global model and the experimental results are also presented.

Essential technical and intellectual abilities for autonomous mobile service medical robots

  • Rogatkin, Dmitry A.;Velikanov, Evgeniy V.
    • Advances in robotics research
    • /
    • v.2 no.1
    • /
    • pp.59-68
    • /
    • 2018
  • Autonomous mobile service medical robots (AMSMRs) are one of the promising developments in contemporary medical robotics. In this study, we consider the essential technical and intellectual abilities needed by AMSMRs. Based on expert analysis of the behavior exhibited by AMSMRs in clinics under basic scenarios, these robots can be classified as intellectual dynamic systems acting according to a situation in a multi-object and multi-agent environment. An AMSMR should identify different objects that define the presented territory (rooms and paths), different objects between and inside rooms (doors, tables, and beds, among others), and other robots. They should also identify the means for interacting with these objects, people and their speech, different information for communication, and small objects for transportation. These are included in the minimum set required to form the internal world model in an AMSMR. Recognizing door handles and opening doors are some of the most difficult problems for contemporary AMSMRs. The ability to recognize the meaning of human speech and actions and to assist them effectively are other problems that need solutions. These unresolved issues indicate that AMSMRs will need to pass through some learning and training programs before starting real work in hospitals.

Multi Modal Sensor Training Dataset for the Robust Object Detection and Tracking in Outdoor Surveillance (MMO (Multi Modal Outdoor) Dataset) (실외 경비 환경에서 강인한 객체 검출 및 추적을 위한 실외 멀티 모달 센서 기반 학습용 데이터베이스 구축)

  • Noh, DongKi;Yang, Wonkeun;Uhm, Teayoung;Lee, Jaekwang;Kim, Hyoung-Rock;Baek, SeungMin
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.8
    • /
    • pp.1006-1018
    • /
    • 2020
  • Dataset is getting more import to develop a learning based algorithm. Quality of the algorithm definitely depends on dataset. So we introduce new dataset over 200 thousands images which are fully labeled multi modal sensor data. Proposed dataset was designed and constructed for researchers who want to develop detection, tracking, and action classification in outdoor environment for surveillance scenarios. The dataset includes various images and multi modal sensor data under different weather and lighting condition. Therefor, we hope it will be very helpful to develop more robust algorithm for systems equipped with difference kinds of sensors in outdoor application. Case studies with the proposed dataset are also discussed in this paper.

Current Status of Robotic-assisted Surgery in Gastric Cancer

  • Eli Kakiashvili
    • Journal of Digestive Cancer Research
    • /
    • v.4 no.2
    • /
    • pp.99-106
    • /
    • 2016
  • Minimally invasive surgery for gastric cancer has increased in popularity during the last two decades mainly in the Asia for patients with early-stage cancer. Nevertheless, the development of laparoscopic surgery for gastric cancers in the Western world has been slow because of the advanced stage at diagnosis for which LG is not yet considered an acceptable alternative to standard open surgery. RAG has been reported as a safe alternative to conventional surgery for treating of early gastric carcinoma. We assess the current status of robotic surgery in the treatment of gastric cancer focusing on the technical details, postoperative outcome, oncological considerations and future perspectives. In gastrectomy the biggest advantage of the robotic approach is the ease and reproducibility of lymphadenectomy. Reports also show that even the intra corporeal digestive restoration is facilitated by use of the robotic approach, particularly following TG. Additionally, the accuracy of robotic dissection is confirmed by decreased blood loss in comparison to conventional laparoscopy. The learning curve and technical reproducibility also appear to be shorter with robotic surgery and, consequently, robotics can help to standardize and diffuse minimally invasive surgery in the treatment of gastric cancer. While published reports have shown no significant differences in surgical morbidity, mortality, or oncological adequacy between robot-assisted and conventional gastrectomy. There are some advantages in terms of postoperative recovery of patients after robotic surgery. More studies are needed to assess the true indications and oncological effectiveness of robotic use in the treatment of gastric carcinoma.

  • PDF

Deep Learning-based Object Detection of Panels Door Open in Underground Utility Tunnel (딥러닝 기반 지하공동구 제어반 문열림 인식)

  • Gyunghwan Kim;Jieun Kim;Woosug Jung
    • Journal of the Society of Disaster Information
    • /
    • v.19 no.3
    • /
    • pp.665-672
    • /
    • 2023
  • Purpose: Underground utility tunnel is facility that is jointly house infrastructure such as electricity, water and gas in city, causing condensation problems due to lack of airflow. This paper aims to prevent electricity leakage fires caused by condensation by detecting whether the control panel door in the underground utility tunnel is open using a deep learning model. Method: YOLO, a deep learning object recognition model, is trained to recognize the opening and closing of the control panel door using video data taken by a robot patrolling the underground utility tunnel. To improve the recognition rate, image augmentation is used. Result: Among the image enhancement techniques, we compared the performance of the YOLO model trained using mosaic with that of the YOLO model without mosaic, and found that the mosaic technique performed better. The mAP for all classes were 0.994, which is high evaluation result. Conclusion: It was able to detect the control panel even when there were lights off or other objects in the underground cavity. This allows you to effectively manage the underground utility tunnel and prevent disasters.

Directionally Adaptive Aliasing and Noise Removal Using Dictionary Learning and Space-Frequency Analysis (사전 학습과 공간-주파수 분석을 사용한 방향 적응적 에일리어싱 및 잡음 제거)

  • Chae, Eunjung;Lee, Eunsung;Cheong, Hejin;Paik, Joonki
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.8
    • /
    • pp.87-96
    • /
    • 2014
  • In this paper, we propose a directionally adaptive aliasing and noise removal using dictionary learning based on space-frequency analysis. The proposed aliasing and noise removal algorithm consists of two modules; i) aliasing and noise detection using dictionary learning and analysis of frequency characteristics from the combined wavelet-Fourier transform and ii) aliasing removal with suppressing noise based on the directional shrinkage in the detected regions. The proposed method can preserve the high-frequency details because aliasing and noise region is detected. Experimental results show that the proposed algorithm can efficiently reduce aliasing and noise while minimizing losses of high-frequency details and generation of artifacts comparing with the conventional methods. The proposed algorithm is suitable for various applications such as image resampling, super-resolution image, and robot vision.

Development of Smart Mobility System for Persons with Disabilities (장애인을 위한 스마트 모빌리티 시스템 개발)

  • Yu, Yeong Jun;Park, Se Eun;An, Tae Jun;Yang, Ji Ho;Lee, Myeong-Gyu;Lee, Chul-Hee
    • Journal of Drive and Control
    • /
    • v.19 no.4
    • /
    • pp.97-103
    • /
    • 2022
  • Low fertility rates and increased life expectancy further exacerbate the process of an aging society. This is also reflected in the gradual increase in the proportion of vulnerable groups in the social population. The demand for improved mobility among vulnerable groups such as the elderly or the disabled has greatly driven the growth of the electric-assisted mobility device market. However, such mobile devices generally require a certain operating capability, which limits the range of vulnerable groups who can use the device and increases the cost of learning. Therefore, autonomous driving technology needs to be introduced to make mobility easier for a wider range of vulnerable groups to meet their needs of work and leisure in different environments. This study uses mini PC Odyssey, Velodyne Lidar VLP-16, electronic device and Linux-based ROS program to realize the functions of working environment recognition, simultaneous localization, map generation and navigation of electric powered mobile devices for vulnerable groups. This autonomous driving mobility device is expected to be of great help to the vulnerable who lack the immediate response in dangerous situations.

A Research on V2I-based Accident Prevention System for the Prevention of Unexpected Accident of Autonomous Vehicle (자율주행 차량의 돌발사고 방지를 위한 V2I 기반의 사고 방지체계 연구)

  • Han, SangYong;Kim, Myeong-jun;Kang, Dongwan;Baek, Sunwoo;Shin, Hee-seok;Kim, Jungha
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.20 no.3
    • /
    • pp.86-99
    • /
    • 2021
  • This research proposes the Accident Prevention System to prevent collision accident that can occur due to blind spots such as crossway or school zone using V2I communication. Vision sensor and LiDAR sensor located in the infrastructure of crossway somewhere like that recognize objects and warn vehicles at risk of accidents to prevent accidents in advance. Using deep learning-based YOLOv4 to recognize the object entering the intersection and using the Manhattan Distance value with LiDAR sensors to calculate the expected collision time and the weight of braking distance and secure safe distance. V2I communication used ROS (Robot Operating System) communication to prevent accidents in advance by conveying various information to the vehicle, including class, distance, and speed of entry objects, in addition to collision warning.

Object Part Detection-based Manipulation with an Anthropomorphic Robot Hand Via Human Demonstration Augmented Deep Reinforcement Learning (행동 복제 강화학습 및 딥러닝 사물 부분 검출 기술에 기반한 사람형 로봇손의 사물 조작)

  • Oh, Ji Heon;Ryu, Ga Hyun;Park, Na Hyeon;Anazco, Edwin Valarezo;Lopez, Patricio Rivera;Won, Da Seul;Jeong, Jin Gyun;Chang, Yun Jung;Kim, Tae-Seong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2020.11a
    • /
    • pp.854-857
    • /
    • 2020
  • 최근 사람형(Anthropomorphic)로봇손의 사물조작 지능을 개발하기 위하여 행동복제(Behavior Cloning) Deep Reinforcement Learning(DRL) 연구가 진행중이다. 자유도(Degree of Freedom, DOF)가 높은 사람형 로봇손의 학습 문제점을 개선하기 위하여, 행동 복제를 통한 Human Demonstration Augmented(DA)강화 학습을 통하여 사람처럼 사물을 조작하는 지능을 학습시킬 수 있다. 그러나 사물 조작에 있어, 의미 있는 파지를 위해서는 사물의 특정 부위를 인식하고 파지하는 방법이 필수적이다. 본 연구에서는 딥러닝 YOLO기술을 적용하여 사물의 특정 부위를 인식하고, DA-DRL을 적용하여, 사물의 특정 부분을 파지하는 딥러닝 학습 기술을 제안하고, 2 종 사물(망치 및 칼)의 손잡이 부분을 인식하고 파지하여 검증한다. 본 연구에서 제안하는 학습방법은 사람과 상호작용하거나 도구를 용도에 맞게 사용해야하는 분야에서 유용할 것이다.

Development and Application of a Maker Education Program Using Virtual Reality Technology in Elementary Science Class: Focusing on the Unit of 'Animal Life' (초등 과학 수업에서 VR 기술을 활용한 메이커교육 프로그램의 개발과 적용 - '동물의 생활' 단원을 중심으로 -)

  • Kim, Hye-Ran;Choi, Sun-Young
    • Journal of Korean Elementary Science Education
    • /
    • v.42 no.3
    • /
    • pp.399-408
    • /
    • 2023
  • This study developed and applied a maker education program for an elementary school's science unit on 'Animal Life'. It examined the program's impact on students' academic achievement and creative problem-solving ability. The theme of the maker education program was 'creating a robot virtual reality (VR) exhibition hall mimicking animal characteristics'. It explored scientific concepts and creatively created a robot VR exhibition hall in accordance with the TMI maker education model. Findings revealed that the program significantly improved students' academic achievement and creative problem-solving ability (p<.05). This study provides evidence for the effectiveness of maker education in elementary school science classes and suggests that using maker education can increase students' interest in and engagement with science learning. To implement maker education more actively in elementary school science classes, stakeholders should develop various topics and programs. Additional research investigating the effectiveness of maker education in different age groups and various other areas of elementary science education is required to generalize the results of this study. Moreover, educational and teacher capacity building is required for educators to utilize maker education effectively.