• Title/Summary/Keyword: multi-camera system

Search Result 477, Processing Time 0.035 seconds

Deep learning based Person Re-identification with RGB-D sensors

  • Kim, Min;Park, Dong-Hyun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.3
    • /
    • pp.35-42
    • /
    • 2021
  • In this paper, we propose a deep learning-based person re-identification method using a three-dimensional RGB-Depth Xtion2 camera considering joint coordinates and dynamic features(velocity, acceleration). The main idea of the proposed identification methodology is to easily extract gait data such as joint coordinates, dynamic features with an RGB-D camera and automatically identify gait patterns through a self-designed one-dimensional convolutional neural network classifier(1D-ConvNet). The accuracy was measured based on the F1 Score, and the influence was measured by comparing the accuracy with the classifier model (JC) that did not consider dynamic characteristics. As a result, our proposed classifier model in the case of considering the dynamic characteristics(JCSpeed) showed about 8% higher F1-Score than JC.

Monitoring system for grain sorting using embedded Linux-based servers and Web applications (임베디드 리눅스 기반의 서버와 웹 어플리케이션을 이용한 곡물 선별 모니터링 시스템)

  • Park, Se-hyun;Geum, Young-wook;Kim, Hyun-jae
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.12
    • /
    • pp.2341-2347
    • /
    • 2016
  • In this paper, we implement monitoring system for grain sorting using a high-speed FPGA and embedded LINUX. The proposed system is designed by base on web server and web-based applications while existing system was designed by base on stand-alone mode.The interface the Web server with high speed hardware of FPGA is designed on the implemented monitoring system. The proposed system has the advantages of multi-tasking on Linux web server and real-time high speed on FPGA also. The control logic of a high speed rate line-scan CCD camera, the method of center of gravity, HSL decoding and the interface on the Web server are implemented in FPGA. The implemented monitoring system has the advantage of being able to control the grain monitoring, system failure and recovery remotely by web application. As a result, we can upgrade the performance of sorting quality compared by existing system.

Intelligent Face Recognition and Tracking System to Distribute GPU Resources using CUDA (쿠다를 사용하여 GPU 리소스를 분배하는 지능형 얼굴 인식 및 트래킹 시스템)

  • Kim, Jae-Heong;Lee, Seung-Ho
    • Journal of IKEEE
    • /
    • v.22 no.2
    • /
    • pp.281-288
    • /
    • 2018
  • In this paper, we propose an intelligent face recognition and tracking system that distributes GPU resources using CUDA. The proposed system consists of five steps such as GPU allocation algorithm that distributes GPU resources in optimal state, face area detection and face recognition using deep learning, real time face tracking, and PTZ camera control. The GPU allocation algorithm that distributes multi-GPU resources optimally distributes the GPU resources flexibly according to the activation level of the GPU, unlike the method of allocating the GPU to the thread fixedly. Thus, there is a feature that enables stable and efficient use of multiple GPUs. In order to evaluate the performance of the proposed system, we compared the proposed system with the non - distributed system. As a result, the system which did not allocate the resource showed unstable operation, but the proposed system showed stable resource utilization because it was operated stably. Thus, the utility of the proposed system has been demonstrated.

Design of a Motion Recognition System for the Realistic Biathlon Simulator System (실감형 바이애슬론 시뮬레이터를 위한 동작 인식 시스템 설계)

  • Kim, Cheol-min;Lee, Min-tae
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.10a
    • /
    • pp.396-399
    • /
    • 2018
  • In this paper, we propose a motion recognition system for identification and interaction with simulator used in the realistic biathlon simulator. The proposed system tried to improve the motions data which is obstructed by the obstacles or overlapping joints and the motion due to the fast motion in the process of recognizing the various motion patterns in the biathlon. In this paper, we constructed a multi-camera motion recognition system based on IoT devices, and then we applied a skeletal area interpolation method for normal motion identification. We designed a system that can increase the recognition rate of motion from the biathlon. The proposed system can be applied to the analysis of snow sports motion and it will be used to develop realistic biathlon simulator system.

  • PDF

Implementation of Optimized 3D Input & Output Systems for Web-based Real-time 3D Video Communication (웹 기반의 입체 동영상 통신을 위한 3차원 입출력 시스템의 최적화 구현)

  • Ko, Jung-Hwan;Lee, Jung-Suk;An, Young-Hwan
    • 전자공학회논문지 IE
    • /
    • v.43 no.4
    • /
    • pp.105-114
    • /
    • 2006
  • In this paper, 3D input and output systems for a web-based real-time 3D video communication system using IEEE 1394 digital cameras, Intel Xeon Server system and Microsoft Directshow library is proposed. And some conditions for optimizing the operations of the stereo camera, 3D display and signal processing system are analyzed. Input & output systems are carefully selected, which can satisfy the required optimization conditions and the final 3D video communication system is implemented by using three optimized devices. The overall control system is developed with Microsoft Visual C++.Net and Microsoft DirectX 9.1 SDK. Some experimental results show that the observer can feel the natural presence from multi-view(4-view) 3D video of server system in real-time and also can feel the natural presence from 3D video of client system and finally suggest an application possibility of the proposed web-based real-time 3D video communication in real fields.

Color Vision System for Intelligent Rehabilitation Robot mounted on the Wheelchair (휠체어 장착형 지능형 재활 로봇을 위한 칼라 비전 시스템)

  • Song, Won-Kyung;Lee, He-Young;Kim, Jong-Sung;Bien, Zeung-Nam
    • Journal of the Korean Institute of Telematics and Electronics S
    • /
    • v.35S no.11
    • /
    • pp.75-87
    • /
    • 1998
  • KARES (KAIST Rehabilitation Engineering System) is the rehabilitation robot system in the type of the 6 degrees of freedom robot arm mounted on the wheelchair, in order to assist the independent livelihood of the disabled and the elderly. The interface device for programming and controlling of the robot arm is essential in the rehabilitation robotic system. Specially, in the case of the manual operation of the robot arm, the user has the burden of cognition and the difficulty for the operation of the robot arm. As a remedy, color vision system for the autonomous performance of jobs is proposed, and four basic desired jobs are specified. By mounting the camera in eye-in-hand type, color vision system for KARES is set up. The desired jobs for picking up the target and moving it to the user's face for drinking are successfully performed in real-time at the indoor environment.

  • PDF

The Individual Discrimination Location Tracking Technology for Multimodal Interaction at the Exhibition (전시 공간에서 다중 인터랙션을 위한 개인식별 위치 측위 기술 연구)

  • Jung, Hyun-Chul;Kim, Nam-Jin;Choi, Lee-Kwon
    • Journal of Intelligence and Information Systems
    • /
    • v.18 no.2
    • /
    • pp.19-28
    • /
    • 2012
  • After the internet era, we are moving to the ubiquitous society. Nowadays the people are interested in the multimodal interaction technology, which enables audience to naturally interact with the computing environment at the exhibitions such as gallery, museum, and park. Also, there are other attempts to provide additional service based on the location information of the audience, or to improve and deploy interaction between subjects and audience by analyzing the using pattern of the people. In order to provide multimodal interaction service to the audience at the exhibition, it is important to distinguish the individuals and trace their location and route. For the location tracking on the outside, GPS is widely used nowadays. GPS is able to get the real time location of the subjects moving fast, so this is one of the important technologies in the field requiring location tracking service. However, as GPS uses the location tracking method using satellites, the service cannot be used on the inside, because it cannot catch the satellite signal. For this reason, the studies about inside location tracking are going on using very short range communication service such as ZigBee, UWB, RFID, as well as using mobile communication network and wireless lan service. However these technologies have shortcomings in that the audience needs to use additional sensor device and it becomes difficult and expensive as the density of the target area gets higher. In addition, the usual exhibition environment has many obstacles for the network, which makes the performance of the system to fall. Above all these things, the biggest problem is that the interaction method using the devices based on the old technologies cannot provide natural service to the users. Plus the system uses sensor recognition method, so multiple users should equip the devices. Therefore, there is the limitation in the number of the users that can use the system simultaneously. In order to make up for these shortcomings, in this study we suggest a technology that gets the exact location information of the users through the location mapping technology using Wi-Fi and 3d camera of the smartphones. We applied the signal amplitude of access point using wireless lan, to develop inside location tracking system with lower price. AP is cheaper than other devices used in other tracking techniques, and by installing the software to the user's mobile device it can be directly used as the tracking system device. We used the Microsoft Kinect sensor for the 3D Camera. Kinect is equippedwith the function discriminating the depth and human information inside the shooting area. Therefore it is appropriate to extract user's body, vector, and acceleration information with low price. We confirm the location of the audience using the cell ID obtained from the Wi-Fi signal. By using smartphones as the basic device for the location service, we solve the problems of additional tagging device and provide environment that multiple users can get the interaction service simultaneously. 3d cameras located at each cell areas get the exact location and status information of the users. The 3d cameras are connected to the Camera Client, calculate the mapping information aligned to each cells, get the exact information of the users, and get the status and pattern information of the audience. The location mapping technique of Camera Client decreases the error rate that occurs on the inside location service, increases accuracy of individual discrimination in the area through the individual discrimination based on body information, and establishes the foundation of the multimodal interaction technology at the exhibition. Calculated data and information enables the users to get the appropriate interaction service through the main server.

Generation of Mosaic Image using Aerial Oblique Images (경사사진을 이용한 모자이크 영상 제작)

  • Seo, Sang Il;Park, Byung-Wook;Lee, Byoung Kil;Kim, Jong In
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.22 no.3
    • /
    • pp.145-154
    • /
    • 2014
  • The road network becomes more complex and extensive. Therefore, the inconveniences are caused in accordance with the time delay of the restoration of damaged roads, demands for excessive costs on information collection, and limitations on acquisition of damage information of the roads. Recently, road centric spatial information is gathered using mobile multi sensor system for road inventory. But expensive MMS(Mobile Mapping System) equipments require high maintenance costs from beginning and takes a lot of time in the data processing. So research is needed for continuous maintenance by collecting and displaying the damaged information on a digital map using low cost mobile camera system. In this research we aim to develop the techniques for mosaic with a regular ground sample distance using successive image from oblique camera on a vehicle. For doing this, mosaic image is generated by estimating the homography of high resolution oblique image, and the ground sample distance and appropriate overlap are analyzed using high resolution aerial oblique images which contain resolution target. Based on this we have proposed the appropriate overlap and exposure interval for mobile road inventory system.

Natural Language based Video Retrieval System with Event Analysis of Multi-camera Image Sequence in Office Environment (사무실 환경 내 다중카메라 영상의 이벤트분석을 통한 자연어 기반 동영상 검색시스템)

  • Lim, Soo-Jung;Hong, Jin-Hyuk;Cho, Sung-Bae
    • 한국HCI학회:학술대회논문집
    • /
    • 2008.02a
    • /
    • pp.384-389
    • /
    • 2008
  • Recently, the necessity of systems which effectively store and retrieve video data has increased. Conventional video retrieval systems retrieve data using menus or text based keywords. Due to the lack of information, many video clips are simultaneously searched, and the user must have a certain level of knowledge to utilize the system. In this paper, we suggest a natural language based conversational video retrieval system that reflects users' intentions and includes more information than keyword based queries. This system can also retrieve from events or people to their movements. First, an event database is constructed based on meta-data which are generated by domain analysis for collected video in an office environment. Then, a script database is also constructed based on the query pre-processing and analysis. From that, a method to retrieve a video through a matching technique between natural language queries and answers is suggested and validated through performance and process evaluation for 10 users The natural language based retrieval system has shown its better efficiency in performance and user satisfaction than the menu based retrieval system.

  • PDF

A High-speed Automatic Mapping System Based on a Multi-sensor Micro UAV System (멀티센서 초소형 무인항공기 기반의 고속 자동 매핑 시스템)

  • Jeon, Euiik;Choi, Kyoungah;Lee, Impyeong
    • Spatial Information Research
    • /
    • v.23 no.3
    • /
    • pp.91-100
    • /
    • 2015
  • We developed a micro UAV based rapid mapping system that provides geospatial information of target areas in a rapid and automatic way. Users can operate the system easily although they are inexperienced in UAV operation and photogrammetric processes. For the aerial data acquisition, we constructed a micro UAV system mounted with a digital camera, a GPS/IMU, and a control board for the sensor integration and synchronization. We also developed a flight planning software and data processing software for the generation of geo-spatial information. The processing software operates automatically with a high speed to perform data quality control, image matching, georeferencing, and orthoimage generation. With the system, we have generated individual ortho-images within 30 minutes from 57 images of 3cm resolution acquired from a target area of $400m{\times}300m$.