• Title/Summary/Keyword: multiple cameras

Search Result 225, Processing Time 0.023 seconds

Images Grouping Technology based on Camera Sensors for Efficient Stitching of Multiple Images (다수의 영상간 효율적인 스티칭을 위한 카메라 센서 정보 기반 영상 그룹핑 기술)

  • Im, Jiheon;Lee, Euisang;Kim, Hoejung;Kim, Kyuheon
    • Journal of Broadcast Engineering
    • /
    • v.22 no.6
    • /
    • pp.713-723
    • /
    • 2017
  • Since the panoramic image can overcome the limitation of the viewing angle of the camera and have a wide field of view, it has been studied effectively in the fields of computer vision and stereo camera. In order to generate a panoramic image, stitching images taken by a plurality of general cameras instead of using a wide-angle camera, which is distorted, is widely used because it can reduce image distortion. The image stitching technique creates descriptors of feature points extracted from multiple images, compares the similarities of feature points, and links them together into one image. Each feature point has several hundreds of dimensions of information, and data processing time increases as more images are stitched. In particular, when a panorama is generated on the basis of an image photographed by a plurality of unspecified cameras with respect to an object, the extraction processing time of the overlapping feature points for similar images becomes longer. In this paper, we propose a preprocessing process to efficiently process stitching based on an image obtained from a number of unspecified cameras for one object or environment. In this way, the data processing time can be reduced by pre-grouping images based on camera sensor information and reducing the number of images to be stitched at one time. Later, stitching is done hierarchically to create one large panorama. Through the grouping preprocessing proposed in this paper, we confirmed that the stitching time for a large number of images is greatly reduced by experimental results.

Real-Time Hand Pose Tracking and Finger Action Recognition Based on 3D Hand Modeling (3차원 손 모델링 기반의 실시간 손 포즈 추적 및 손가락 동작 인식)

  • Suk, Heung-Il;Lee, Ji-Hong;Lee, Seong-Whan
    • Journal of KIISE:Software and Applications
    • /
    • v.35 no.12
    • /
    • pp.780-788
    • /
    • 2008
  • Modeling hand poses and tracking its movement are one of the challenging problems in computer vision. There are two typical approaches for the reconstruction of hand poses in 3D, depending on the number of cameras from which images are captured. One is to capture images from multiple cameras or a stereo camera. The other is to capture images from a single camera. The former approach is relatively limited, because of the environmental constraints for setting up multiple cameras. In this paper we propose a method of reconstructing 3D hand poses from a 2D input image sequence captured from a single camera by means of Belief Propagation in a graphical model and recognizing a finger clicking motion using a hidden Markov model. We define a graphical model with hidden nodes representing joints of a hand, and observable nodes with the features extracted from a 2D input image sequence. To track hand poses in 3D, we use a Belief Propagation algorithm, which provides a robust and unified framework for inference in a graphical model. From the estimated 3D hand pose we extract the information for each finger's motion, which is then fed into a hidden Markov model. To recognize natural finger actions, we consider the movements of all the fingers to recognize a single finger's action. We applied the proposed method to a virtual keypad system and the result showed a high recognition rate of 94.66% with 300 test data.

Evaluation on Motion Features of the World's Second Archer during Back-Tension in Archery (양궁 백 텐션 국면에서 최우수 양궁선수의 동작특성 평가)

  • Yi, Jae-Hun;Hah, Chong-Ku;Ryu, Ji-Seon;Kim, Ki-Chan
    • Korean Journal of Applied Biomechanics
    • /
    • v.17 no.3
    • /
    • pp.197-207
    • /
    • 2007
  • It has been reported that Back-Tension played a significant role in archery (Lee & Bondit, 2005; Kim, 2007) but there are a few researches related Back-Tension in Korea recently. Therefore, the purpose of this study was to investigate archery back tension technique for the second ranked archer in the World and to find ways to improve performance. A subject(height: 185cm, mass: 82kg, years: 21yrs, careers: 12yrs) who is a number of national team and the second ranked archer in the World authorized by FITA (Federation Internationale de Trial Arc) was perticipated in this experiment. When shooting 60 shots($12{\times}5$), shooting motions were recorded with 7 infrared cameras and 2 ultrahigh-speed cameras. A QTM and an Auto Track were used to acquire raw data. The sampling rates of both cameras were 200 Hz. and 1000 Hz. respectively and data were filtered using a fourth order Butterworth low pass filtering with a cutoff-frequency of 30Hz. The parameters were calculated with Matlab6.5 and analyzed with SPSS11.0. After Pearson's correlations between 8 parameters were analyzed, 5 parameters from 13parameters that affected records were analyzed with multiple regression analysis (Enter order: x1, x2, x3, x4, x5). The results were as follows: 1. Comparing between parameters according to scores, the patterns of horizontal and vertical angular velocity(av.) of scapular relative angle was different between 8 score and 9 or 10 scores. 2. The correlations of parameters that affected records were a horizontal av.(x1, p=.032<.05) and a vertical av.(x3, p=.033<.05) of scapular from release to delivery in KB back-tension (anchoring-delivery). 3. The decision coefficients(R2) of above two parameters and three parameters selected by experts that may affect record, that is, an absolute trunk angle(x4) from in KKC back-tension (anchoring-release) and a horizontal relative scapular angle(x2) and an absolute trunk angle(x5) from release to delivery in KB back-tension were 7.7%(x1), 0.1%(x2), 8.5%(x3), 0.7%(x4) and 0.9%(x5) in sequence. 4. The multiple regression equation was a y= -1.16E-2 x1 + 0.109 x2 + 3.437E-2 x3 + 6.139E-2 x4 + 0.117 x5 + 3.420 In conclusion, a total contribution was low, that is, R2(17.9%) suggested that on the one hand, Lim's motion may not depend on a certain factor because his postural factors affected shooting motion are some stable on the other hand, unknown factors may exist(e.g. psychological, physiological factors etc.). Further study of EMG patterns of muscles and anatomic consideration related to shoulder girdle and scapular bones may help to identify mechanism of Back-Tension.

GPU-Accelerated Single Image Depth Estimation with Color-Filtered Aperture

  • Hsu, Yueh-Teng;Chen, Chun-Chieh;Tseng, Shu-Ming
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.3
    • /
    • pp.1058-1070
    • /
    • 2014
  • There are two major ways to implement depth estimation, multiple image depth estimation and single image depth estimation, respectively. The former has a high hardware cost because it uses multiple cameras but it has a simple software algorithm. Conversely, the latter has a low hardware cost but the software algorithm is complex. One of the recent trends in this field is to make a system compact, or even portable, and to simplify the optical elements to be attached to the conventional camera. In this paper, we present an implementation of depth estimation with a single image using a graphics processing unit (GPU) in a desktop PC, and achieve real-time application via our evolutional algorithm and parallel processing technique, employing a compute shader. The methods greatly accelerate the compute-intensive implementation of depth estimation with a single view image from 0.003 frames per second (fps) (implemented in MATLAB) to 53 fps, which is almost twice the real-time standard of 30 fps. In the previous literature, to the best of our knowledge, no paper discusses the optimization of depth estimation using a single image, and the frame rate of our final result is better than that of previous studies using multiple images, whose frame rate is about 20fps.

Real-Time Panorama Video Generation System using Multiple Networked Cameras (다중 네트워크 카메라 기반 실시간 파노라마 동영상 생성 시스템)

  • Choi, KyungYoon;Jun, KyungKoo
    • Journal of KIISE
    • /
    • v.42 no.8
    • /
    • pp.990-997
    • /
    • 2015
  • Panoramic image creation has been extensively studied. Existing methods use customized hardware, or apply post-processing methods to seamlessly stitch images. These result in an increase in either cost or complexity. In addition, images can only be stitched under certain conditions such as existence of characteristic points of the images. This paper proposes a low cost and easy-to-use system that produces realtime panoramic video. We use an off-the-shelf embedded platform to capture multiple images, and these are then transmitted to a server in a compressed format to be merged into a single panoramic video. Finally, we analyze the performance of the implemented system by measuring time to successfully create the panoramic image.

Design and Implementation of Multiple View Image Synthesis Scheme based on RAM Disk for Real-Time 3D Browsing System (실시간 3D 브라우징 시스템을 위한 램 디스크 기반의 다시점 영상 합성 기법의 설계 및 구현)

  • Sim, Chun-Bo;Lim, Eun-Cheon
    • The Journal of the Korea Contents Association
    • /
    • v.9 no.5
    • /
    • pp.13-23
    • /
    • 2009
  • One of the main purpose of multiple-view image processing technology is support realistic 3D image to device user by using multiple viewpoint display devices and compressed data restoration devices. This paper proposes a multiple view image synthesis scheme based on RAM disk which makes possible to browse 3D images generated by applying effective composing method to real time input stereo images. The proposed scheme first converts input images to binary image. We applies edge detection algorithm such as Sobel algorithm and Prewiit algorithm to find edges used to evaluate disparities from images of 4 multi-cameras. In addition, we make use of time interval between hardware trigger and software trigger to solve the synchronization problem which has stated ambiguously in related studies. We use a unique identifier on each snapshot of images for distributed environment. With respect of performance results, the proposed scheme takes 0.67 sec in each binary array. to transfer entire images which contains left and right side with disparity information for high quality 3D image browsing. We conclude that the proposed scheme is suitable for real time 3D applications.

Efficient Multi-spot Monitoring System Using PTZ Camera and Wireless Sensor Network (PTZ 카메라와 무선 센서 네트워크를 이용한 효율적인 다중 지역 절전형 모니터링 시스템)

  • Seo, Dong-kyu;Son, Cheol-su;Yang, Su-yeong;Cho, Byung-lok;Kim, Won-jung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.581-584
    • /
    • 2009
  • Recently, the cameras which used for observation are installed in children protection area and local crime prevention area in order to protect life and property and by its work being recognized and are installed more. Normal cameras have cost problem to observe multiple area and detail, because they can observe only one place. PTZ camera can observe multiple area by moving focus by schedule or remote control, but it can't automatically move the focus of it to the place where event occurred, because it can't recognize the place. In this study, we can monitor multiple area effectively, by installing a wireless sensor node equipped with temperature, lighting, gas and human detection sensor to each area, to monitor many place low-price and actively and to move the focus of PTZ camera to preset position, and send recorded video to the user, when the various sensor data received from wireless sensors in observation area are to be determined abnormal by analyzing. In addition, at night we can record a scene using infrared, but to reduce power consumption of lighting system which are installed to improve resolution, it supplies power to the lighting system when event occurred. So we were able to implement low power green monitoring system.

  • PDF

Development of Multi-Camera based Mobile Mapping System for HD Map Production (정밀지도 구축을 위한 다중카메라기반 모바일매핑시스템 개발)

  • Hong, Ju Seok;Shin, Jin Soo;Shin, Dae Man
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.39 no.6
    • /
    • pp.587-598
    • /
    • 2021
  • This study aims to develop a multi-camera based MMS (Mobile Mapping System) technology for building a HD (High Definition) map for autonomous driving and for quick update. To replace expensive lidar sensors and reduce long processing times, we intend to develop a low-cost and efficient MMS by applying multiple cameras and real-time data pre-processing. To this end, multi-camera storage technology development, multi-camera time synchronization technology development, and MMS prototype development were performed. We developed a storage module for real-time JPG compression of high-speed images acquired from multiple cameras, and developed an event signal and GNSS (Global Navigation Satellite System) time server-based synchronization method to record the exposure time multiple images taken in real time. And based on the requirements of each sector, MMS was designed and prototypes were produced. Finally, to verify the performance of the manufactured multi-camera-based MMS, data were acquired from an actual 1,000 km road and quantitative evaluation was performed. As a result of the evaluation, the time synchronization performance was less than 1/1000 second, and the position accuracy of the point cloud obtained through SFM (Structure from Motion) image processing was around 5 cm. Through the evaluation results, it was found that the multi-camera based MMS technology developed in this study showed the performance that satisfies the criteria for building a HD map.

Multiple Moving Person Tracking based on the IMPRESARIO Simulator

  • Kim, Hyun-Deok;Jin, Tae-Seok
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2008.05a
    • /
    • pp.877-881
    • /
    • 2008
  • In this paper, we propose a real-time people tracking system with multiple CCD cameras for security inside the building. The camera is mounted from the ceiling of the laboratory so that the image data of the passing people are fully overlapped. The implemented system recognizes people movement along various directions. To track people even when their images are partially overlapped, the proposed system estimates and tracks a bounding box enclosing each person in the tracking region. The approximated convex hull of each individual in the tracking area is obtained to provide more accurate tracking information. To achieve this goal, we propose a method for 3D walking human tracking based on the IMPRESARIO framework incorporating cascaded classifiers into hypothesis evaluation. The efficiency of adaptive selection of cascaded classifiers have been also presented. We have shown the improvement of reliability for likelihood calculation by using cascaded classifiers. Experimental results show that the proposed method can smoothly and effectively detect and track walking humans through environments such as dense forests.

  • PDF

Patch-Based Processing and Occlusion Area Recovery for True Orthoimage Generation (정밀정사영상 생성을 위한 패치기반 처리와 폐색지역 복원)

  • Yoo, Eun-Jin;Lee, Dong-Cheon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.28 no.1
    • /
    • pp.83-92
    • /
    • 2010
  • Emergence of high-resolution digital aerial cameras and airborne laser scanners have made innovative progress in photogrammetry and spatial information technology. The purpose of this study is to generate true orthoimage by recovering occlusion areas. The orthoimages were generated patch-based transformation. The occlusion areas were mutually corrected by using multiple aerial images. This study proposed a novel method of building roof based orthoimage generation and an effective method of occlusion area detection and recovery. The proposed methods could be efficient to generate true orthoimages in urban areas where occlusion areas are problematic.