• Title/Summary/Keyword: Vision Based Monitoring

Search Result 233, Processing Time 0.021 seconds

AprilTag and Stereo Visual Inertial Odometry (A-SVIO) based Mobile Assets Localization at Indoor Construction Sites

  • Khalid, Rabia;Khan, Muhammad;Anjum, Sharjeel;Park, Junsung;Lee, Doyeop;Park, Chansik
    • International conference on construction engineering and project management
    • /
    • 2022.06a
    • /
    • pp.344-352
    • /
    • 2022
  • Accurate indoor localization of construction workers and mobile assets is essential in safety management. Existing positioning methods based on GPS, wireless, vision, or sensor based RTLS are erroneous or expensive in large-scale indoor environments. Tightly coupled sensor fusion mitigates these limitations. This research paper proposes a state-of-the-art positioning methodology, addressing the existing limitations, by integrating Stereo Visual Inertial Odometry (SVIO) with fiducial landmarks called AprilTags. SVIO determines the relative position of the moving assets or workers from the initial starting point. This relative position is transformed to an absolute position when AprilTag placed at various entry points is decoded. The proposed solution is tested on the NVIDIA ISAAC SIM virtual environment, where the trajectory of the indoor moving forklift is estimated. The results show accurate localization of the moving asset within any indoor or underground environment. The system can be utilized in various use cases to increase productivity and improve safety at construction sites, contributing towards 1) indoor monitoring of man machinery coactivity for collision avoidance and 2) precise real-time knowledge of who is doing what and where.

  • PDF

A study on the development of surveillance system for multiple drones in school drone education sites (학내 드론 교육현장의 다중드론 감시시스템 개발에 관한 연구)

  • Jin-Taek Lim;Sung-goo Yoo
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.1
    • /
    • pp.697-702
    • /
    • 2023
  • Recently, with the introduction of drones, a core technology of the 4th industrial revolution, various convergence education using drones is being conducted in school education sites. In particular, drone theory and practice education is being conducted in connection with free semester classes and career exploration. The drone convergence education program has higher learner satisfaction than simple demonstration and practice education, and the learning effect is high due to direct practical experience. However, since practical education is being conducted for a large number of learners, it is impossible to restrict and control the flight of a large number of drones in a limited place. In this paper, we propose a monitoring system that allows the instructor to monitor multiple drones in real time and learners to recognize collisions between drones in advance when multiple drones are operated, focusing on education operated in schools. The communication module used in the experiment was equipped with GPS in Murata LoRa, and the server and client were configured to enable monitoring based on the location data received in real time. The performance of the proposed system was evaluated in an open space, and it was confirmed that the communication signal was good up to a distance of about 120m. In other words, it was confirmed that 25 educational drones can be controlled within a range of 240m and the instructor can monitor them.

Wireless image processing based management system the driver of the vehicle (무선 영상처리 기반의 차량 운전자 관리 시스템)

  • Seo, Ji-Hwan;Lee, Jae-Hyun;Kang, Sung-In;Shin, Dong-Suk;Kim, Kwan-Hyung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.13 no.11
    • /
    • pp.2349-2354
    • /
    • 2009
  • Due to growth of electronics and control devices, automation and situational awareness systems have been applied by automobile. Vision systems with the introduction of unmanned system being actively developed, but are still high price and visual information is passed through the cable, because of cars are difficult to install. In this paper, can be installed inside the car at low-cost, simple image processing device through a wireless communication know the obstacles and the alarm system based on Zigbee wireless communication, infrared and ultrasonic sensors to monitor the situation through with easy parking cars outside the system design was implemented.

A Study on Detecting Moving Objects using Multiple Fisheye Cameras (다중 어안 카메라를 이용한 움직이는 물체 검출 연구)

  • Bae, Kwang-Hyuk;Suhr, Jae-Kyu;Park, Kang-Ryoung;Kim, Jai-Hie
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.45 no.4
    • /
    • pp.32-40
    • /
    • 2008
  • Since vision-based surveillance system uses a conventional camera which has a narrow field of view, it is difficult to apply it into the environment whose the ceiling is low and the monitoring area is wide. To overcome this problem, the method of increasing the number of camera causes the increase of the cost and the difficulties of camera set-up For these problems, we propose a new surveillance system based on multiple fisheye cameras which have 180 degree field of view. The proposed method handles occlusions using the homography relation between the multiple fisheye cameras. In the experiment, four fisheye cameras were set up within the area of $17{\times}14m$ at height of 2.5 m and five people wandered and crossed with one another within this area. The detection rates of the proposed system was 83.0% while that of a single camera was 46.1%.

Development of a Real Time Video Image Processing System for Vehicle Tracking (실시간 영상처리를 이용한 개별차량 추적시스템 개발)

  • Oh, Ju-Taek;Min, Joon-Young
    • International Journal of Highway Engineering
    • /
    • v.10 no.3
    • /
    • pp.19-31
    • /
    • 2008
  • Video image processing systems(VIPS) offer numerous benefits to transportation models and applications, due to their ability to monitor traffic in real time. VIPS based on wide-area detection, i.e., multi-lane surveillance algorithm provide traffic parameters with single camera such as flow and velocity, as well as occupancy and density. However, most current commercial VIPS utilize a tripwire detection algorithm that examines image intensity changes in the detection regions to indicate vehicle presence and passage, i.e., they do not identify individual vehicles as unique targets. If VIPS are developed to track individual vehicles and thus trace vehicle trajectories, many existing transportation models will benefit from more detailed information of individual vehicles. Furthermore, additional information obtained from the vehicle trajectories will improve incident detection by identifying lane change maneuvers and acceleration/deceleration patterns. The objective of this research was to relate traffic safety to VIPS tracking and this paper has developed a computer vision system of monitoring individual vehicle trajectories based on image processing, and offer the detailed information, for example, volumes, speed, and occupancy rate as well as traffic information via tripwire image detectors. Also the developed system has been verified by comparing with commercial VIP detectors.

  • PDF

Ensemble-based deep learning for autonomous bridge component and damage segmentation leveraging Nested Reg-UNet

  • Abhishek Subedi;Wen Tang;Tarutal Ghosh Mondal;Rih-Teng Wu;Mohammad R. Jahanshahi
    • Smart Structures and Systems
    • /
    • v.31 no.4
    • /
    • pp.335-349
    • /
    • 2023
  • Bridges constantly undergo deterioration and damage, the most common ones being concrete damage and exposed rebar. Periodic inspection of bridges to identify damages can aid in their quick remediation. Likewise, identifying components can provide context for damage assessment and help gauge a bridge's state of interaction with its surroundings. Current inspection techniques rely on manual site visits, which can be time-consuming and costly. More recently, robotic inspection assisted by autonomous data analytics based on Computer Vision (CV) and Artificial Intelligence (AI) has been viewed as a suitable alternative to manual inspection because of its efficiency and accuracy. To aid research in this avenue, this study performs a comparative assessment of different architectures, loss functions, and ensembling strategies for the autonomous segmentation of bridge components and damages. The experiments lead to several interesting discoveries. Nested Reg-UNet architecture is found to outperform five other state-of-the-art architectures in both damage and component segmentation tasks. The architecture is built by combining a Nested UNet style dense configuration with a pretrained RegNet encoder. In terms of the mean Intersection over Union (mIoU) metric, the Nested Reg-UNet architecture provides an improvement of 2.86% on the damage segmentation task and 1.66% on the component segmentation task compared to the state-of-the-art UNet architecture. Furthermore, it is demonstrated that incorporating the Lovasz-Softmax loss function to counter class imbalance can boost performance by 3.44% in the component segmentation task over the most employed alternative, weighted Cross Entropy (wCE). Finally, weighted softmax ensembling is found to be quite effective when used synchronously with the Nested Reg-UNet architecture by providing mIoU improvement of 0.74% in the component segmentation task and 1.14% in the damage segmentation task over a single-architecture baseline. Overall, the best mIoU of 92.50% for the component segmentation task and 84.19% for the damage segmentation task validate the feasibility of these techniques for autonomous bridge component and damage segmentation using RGB images.

Active Object Tracking System based on Stereo Vision (스테레오 비젼 기반의 능동형 물체 추적 시스템)

  • Ko, Jung-Hwan
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.53 no.4
    • /
    • pp.159-166
    • /
    • 2016
  • In this paper, an active object tracking system basing on the pan/tilt-embedded stereo camera system is suggested and implemented. In the proposed system, once the face area of a target is detected from the input stereo image by using a YCbCr color model and phase-type correlation scheme and then, using this data as well as the geometric information of the tracking system, the distance and 3D information of the target are effectively extracted in real-time. Basing on these extracted data the pan/tilted-embedded stereo camera system is adaptively controlled and as a result, the proposed system can track the target adaptively under the various circumstance of the target. From some experiments using 480 frames of the test input stereo image, it is analyzed that a standard variation between the measured and computed the estimated target's height and an error ratio between the measured and computed 3D coordinate values of the target is also kept to be very low value of 1.03 and 1.18% on average, respectively. From these good experimental results a possibility of implementing a new real-time intelligent stereo target tracking and surveillance system using the proposed scheme is finally suggested.

Developing an Occupants Count Methodology in Buildings Using Virtual Lines of Interest in a Multi-Camera Network (다중 카메라 네트워크 가상의 관심선(Line of Interest)을 활용한 건물 내 재실자 인원 계수 방법론 개발)

  • Chun, Hwikyung;Park, Chanhyuk;Chi, Seokho;Roh, Myungil;Susilawati, Connie
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.43 no.5
    • /
    • pp.667-674
    • /
    • 2023
  • In the event of a disaster occurring within a building, the prompt and efficient evacuation and rescue of occupants within the building becomes the foremost priority to minimize casualties. For the purpose of such rescue operations, it is essential to ascertain the distribution of individuals within the building. Nevertheless, there is a primary dependence on accounts provided by pertinent individuals like building proprietors or security staff, alongside fundamental data encompassing floor dimensions and maximum capacity. Consequently, accurate determination of the number of occupants within the building holds paramount significance in reducing uncertainties at the site and facilitating effective rescue activities during the golden hour. This research introduces a methodology employing computer vision algorithms to count the number of occupants within distinct building locations based on images captured by installed multiple CCTV cameras. The counting methodology consists of three stages: (1) establishing virtual Lines of Interest (LOI) for each camera to construct a multi-camera network environment, (2) detecting and tracking people within the monitoring area using deep learning, and (3) aggregating counts across the multi-camera network. The proposed methodology was validated through experiments conducted in a five-story building with the average accurary of 89.9% and the average MAE of 0.178 and RMSE of 0.339, and the advantages of using multiple cameras for occupant counting were explained. This paper showed the potential of the proposed methodology for more effective and timely disaster management through common surveillance systems by providing prompt occupancy information.

Case Study on BSC System Implementation in Korean Public-Sector R&D Institution: Focused on K-Institute (정부출연연구기관 전략적 성과관리체계(BSC) 구축사례: K연구원을 중심으로)

  • Lim, Hwan;Rhim, Ho-Sun;Song, Yong-Il
    • Journal of Korea Technology Innovation Society
    • /
    • v.11 no.4
    • /
    • pp.639-670
    • /
    • 2008
  • The BSC which was proposed by Kaplan and Norton, is being used as a general performance measurement tool in various firms and industries. BSC approach links strategic objectives with specific operation indices and it can efficiently evaluate the attainment of the goals of the firm. This study is a BSC based case of the government R&D institute which is staffed with knowledge experts in the research areas. In order to bring a major change to a public research organization and shape a strategy focused organization, it is essential to understand the proper methodology of the whole construction process of BSC from the mission of the institute through the establishment of vision and strategic direction, KPI building, and a strategy map set, to the implementation of the BSC monitoring system. By investigating the application process, in this research we intend to provides useful implications in the BSC construction process of public research agencies.

  • PDF

Three Dimensional Volume Reconstruction of an Object from X-ray Iamges using Uniform and Simultaneous ART (USART 방법에 의한 X선 영상으로부터의 삼차원 물체의 형상 복원)

  • Roh, Young-Jun;Cho, Hyung-Suck;Kim, Hyeong-Cheol;Kim, Jong-Hyung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.8 no.1
    • /
    • pp.21-27
    • /
    • 2002
  • Inspection and shape measurement of three-dimensional objects are widely needed in industries for quality monitoring and control. A number of visual or optical technologies have been successfully applied to measure three-dimensional surfaces. However, those conventional visual or optical methods have inherent shortcomings such as occlusion and variant surface reflection. X-ray vision system can be a good solution to these conventional problems, since we can extract the volume information including both the surface geometry and the inner structure of any objects. In the x-ray system, the surface condition of an object, whether it is lambertian or specular, does not affect the inherent characteristics of its x-ray images. In this paper, we propose a three-dimensional x-ray imaging method to reconstruct a three dimensional structure of an object out of two dimensional x-ray image sets. To achieve this by the proposed method, two or more x-ray images projected from different views are needed. Once these images are acquired, the simultaneous algebraic reconstruction technique(SART) is usually utilized. Since the existing SART algorithms have several shortcomings such as low performance in convergence and different convergence within the reconstruction volume of interest, an advanced SART algorithm named as USART(uniform SART) is proposed to avoid such shortcomings and improve the reconstruction performance. Because, each voxel within the volume is equally weighted to update instantaneous value of its internal density, it can achieve uniform convergence property of the reconstructed volume. The algorithm is simulated on various shapes of objects such as a pyramid, a hemisphere and a BGA model. Based on simulation results the performance of the proposed method is compared with that of the conventional SART method.