• 제목/요약/키워드: Multi-Human Behavior

검색결과 114건 처리시간 0.026초

Multi-Human Behavior Recognition Based on Improved Posture Estimation Model

  • Zhang, Ning;Park, Jin-Ho;Lee, Eung-Joo
    • 한국멀티미디어학회논문지
    • /
    • 제24권5호
    • /
    • pp.659-666
    • /
    • 2021
  • With the continuous development of deep learning, human behavior recognition algorithms have achieved good results. However, in a multi-person recognition environment, the complex behavior environment poses a great challenge to the efficiency of recognition. To this end, this paper proposes a multi-person pose estimation model. First of all, the human detectors in the top-down framework mostly use the two-stage target detection model, which runs slow down. The single-stage YOLOv3 target detection model is used to effectively improve the running speed and the generalization of the model. Depth separable convolution, which further improves the speed of target detection and improves the model's ability to extract target proposed regions; Secondly, based on the feature pyramid network combined with context semantic information in the pose estimation model, the OHEM algorithm is used to solve difficult key point detection problems, and the accuracy of multi-person pose estimation is improved; Finally, the Euclidean distance is used to calculate the spatial distance between key points, to determine the similarity of postures in the frame, and to eliminate redundant postures.

Human Activity Recognition Based on 3D Residual Dense Network

  • Park, Jin-Ho;Lee, Eung-Joo
    • 한국멀티미디어학회논문지
    • /
    • 제23권12호
    • /
    • pp.1540-1551
    • /
    • 2020
  • Aiming at the problem that the existing human behavior recognition algorithm cannot fully utilize the multi-level spatio-temporal information of the network, a human behavior recognition algorithm based on a dense three-dimensional residual network is proposed. First, the proposed algorithm uses a dense block of three-dimensional residuals as the basic module of the network. The module extracts the hierarchical features of human behavior through densely connected convolutional layers; Secondly, the local feature aggregation adaptive method is used to learn the local dense features of human behavior; Then, the residual connection module is applied to promote the flow of feature information and reduced the difficulty of training; Finally, the multi-layer local feature extraction of the network is realized by cascading multiple three-dimensional residual dense blocks, and use the global feature aggregation adaptive method to learn the features of all network layers to realize human behavior recognition. A large number of experimental results on benchmark datasets KTH show that the recognition rate (top-l accuracy) of the proposed algorithm reaches 93.52%. Compared with the three-dimensional convolutional neural network (C3D) algorithm, it has improved by 3.93 percentage points. The proposed algorithm framework has good robustness and transfer learning ability, and can effectively handle a variety of video behavior recognition tasks.

진주지역 복합영화관의 공간구조와 피난행태특성에 관한 연구 (A Study on Characteristics of Spatial Configuration and Human Evacuation Behavior in Multi-Plex Theater of Jinju)

  • 안은희
    • 한국농촌건축학회논문집
    • /
    • 제7권3호
    • /
    • pp.93-100
    • /
    • 2005
  • The purpose of this study is to investigate specific crowding areas resulted from diverse physical factors of multi-plex theaters in a fire evacuation, and more accurately predict the evacuation route of people. To achieve these purpose, the architectural characteristics of three multi-plex theaters in Jinju have been chosen, and the evacuation experiments through the computer simulation called Simulex were carried out for each on the these theaters. The conclusions from this study are as follows: (1) Crowding usually happens cross areas between theater inside and corridors, and Crowding rate depending on the number of cross areas. (2) It is necessary to design the escape routes being employed ordinary times. And the egress routes planning should be integrated into space programming at the early stage of building design.

  • PDF

신경 회로망을 이용한 원격조작 로보트의 컴플라이언스 제어 (A compliance control of telerobot using neural network)

  • 차동혁;박영수;조형석
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 1991년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 22-24 Oct. 1991
    • /
    • pp.850-855
    • /
    • 1991
  • In this paper, neural network-based compliance control of telerobot is presented, This is a method to learn the compliance of human behavior and control telerobot using learned compliance. The consistency of human behavior is checked using Lipschitz's condition. The neural compliance model is composed of a multi-layered neural network which mimics the compliant notion of the human operator. The effectiveness of proposed scheme ie verified by a simulation study.

  • PDF

효과적인 로봇 행동 생성을 위한 선형의 정서-표정 공간 내 감정 경계의 결정 -비선형의 제스처 동기화를 위한 정서, 표정 공간의 영역 결정 (The Emotional Boundary Decision in a Linear Affect-Expression Space for Effective Robot Behavior Generation)

  • 조수훈;이희승;박정우;김민규;정영진
    • 한국HCI학회:학술대회논문집
    • /
    • 한국HCI학회 2008년도 학술대회 1부
    • /
    • pp.540-546
    • /
    • 2008
  • 미래에는 로봇이 사람의 감정 상태를 이해하거나 적절하게 자신의 행동을 표현하는 기능은 중요해 질 것이다. 사람간의 교류에서 메세지의 93%가 행동 표현에 있으며, 바디 랭귀지는 감정의 양을 표현하므로 행동 표현은 중요한 감정 표현 수단이다. 최근의 로봇들은 얼굴, 제스처, LED, 소리 등의 복합적 방법을 이용하여 사람과 교류하고 있지만 포즈는 위치와 방위, 얼굴이나 제스처는 속도, 말이나 색 풍은 시간에 대한 정보가 필요하기 때문에 하나의 모델로 통합하거나 동기화 시키기 어렵다. 한편 작은 세기의 감정에서, 얼굴은 쉽게 표현이 가능하지만 제스처는 표현이 힘들다. 또한 기존의 감정 경계는 같은 형태와 크기를 가지거나, HHI 분야에 국한되어 연구되어 왔다. 본 논문에서는 정서 공간에서 감정의 경계를 어떻게 정의할 것이며, 복합적 표현 방법을 시스템적으로 어떻게 동기화할 수 있을지를 제안한다.

  • PDF

실외에서 로봇의 인간 탐지 및 행위 학습을 위한 멀티모달센서 시스템 및 데이터베이스 구축 (Multi-modal Sensor System and Database for Human Detection and Activity Learning of Robot in Outdoor)

  • 엄태영;박정우;이종득;배기덕;최영호
    • 한국멀티미디어학회논문지
    • /
    • 제21권12호
    • /
    • pp.1459-1466
    • /
    • 2018
  • Robots which detect human and recognize action are important factors for human interaction, and many researches have been conducted. Recently, deep learning technology has developed and learning based robot's technology is a major research area. These studies require a database to learn and evaluate for intelligent human perception. In this paper, we propose a multi-modal sensor-based image database condition considering the security task by analyzing the image database to detect the person in the outdoor environment and to recognize the behavior during the running of the robot.

Prediction of Human Performance Time to Find Objects on Multi-display Monitors using ACT-R Cognitive Architecture

  • Oh, Hyungseok;Myung, Rohae;Kim, Sang-Hyeob;Jang, Eun-Hye;Park, Byoung-Jun
    • 대한인간공학회지
    • /
    • 제32권2호
    • /
    • pp.159-165
    • /
    • 2013
  • Objective: The aim of this study was to predict human performance time in finding objects on multi-display monitors using ACT-R cognitive architecture. Background: Display monitors are one of the representative interfaces for interaction between people and the system. Nowadays, the use of multi-display monitors is increasing so that it is necessary to research about the interaction between users and the system on multi-display monitors. Method: A cognitive model using ACT-R cognitive architecture was developed for the model-based evaluation on multi-display monitors. To develop the cognitive model, first, an experiment was performed to extract the latency about the where system of ACT-R. Then, a menu selection experiment was performed to develop a human performance model to find objects on multi-display monitors. The validation of the cognitive model was also carried out between the developed ACT-R model and empirical data. Results: As a result, no significant difference on performance time was found between the model and empirical data. Conclusion: The ACT-R cognitive architecture could be extended to model human behavior in the search of objects on multi-display monitors.. Application: This model can help predicting performance time for the model-based usability evaluation in the area of multi-display work environments.

공간지능화에서 다중카메라를 이용한 이동로봇의 인간추적행위 (Human-Tracking Behavior of Mobile Robot Using Multi-Camera System in a Networked ISpace)

  • 진태석;하시모토 히데키
    • 로봇학회논문지
    • /
    • 제2권4호
    • /
    • pp.310-316
    • /
    • 2007
  • The paper proposes a human-following behavior of mobile robot and an intelligent space (ISpace) is used in order to achieve these goals. An ISpace is a 3-D environment in which many sensors and intelligent devices are distributed. Mobile robots exist in this space as physical agents providing humans with services. A mobile robot is controlled to track a walking human using distributed intelligent sensors as stably and precisely as possible. The moving objects is assumed to be a point-object and projected onto an image plane to form a geometrical constraint equation that provides position data of the object based on the kinematics of the intelligent space. Uncertainties in the position estimation caused by the point-object assumption are compensated using the Kalman filter. To generate the shortest time trajectory to track the walking human, the linear and angular velocities are estimated and utilized. The computer simulation and experimental results of estimating and trackinging of the walking human with the mobile robot are presented.

  • PDF

다중 시구간 신경회로망을 이용한 인간 행동 인식 (Human Activity Recognition using Multi-temporal Neural Networks)

  • 이현진
    • 디지털콘텐츠학회 논문지
    • /
    • 제18권3호
    • /
    • pp.559-565
    • /
    • 2017
  • 스마트폰에 내장된 가속도 센서를 이용하여 사용자의 동작 상태나 행동을 인식하기 위한 연구가 다양하게 진행되어 왔다. 본 논문에서는 스마트폰의 3D 가속도 정보에 신경회로망을 적용하여 사람의 행동을 인식하는 연구를 진행하였다. 시계열 데이터를 신경회로망에 그대로 적용하면 성능상의 문제가 발생한다. 따라서 여러 시구간에 대해 특징을 추출하여 각 시구간에 대해 신경회로망을 학습시키고, 이 신경회로망들의 출력들을 입력으로 하여 학습하여 구성하는 다중 시구간 신경회로망을 제안하였다. 제안하는 방법을 실제 가속도 데이터에 적용한 결과 SVM, AdaBoost, IBk 등 다른 분류기보다 우수한 성능을 보였다.