• Title/Summary/Keyword: image segmentation method

Search Result 1,342, Processing Time 0.025 seconds

Crack Inspection and Mapping of Concrete Bridges using Integrated Image Processing Techniques (통합 이미지 처리 기술을 이용한 콘크리트 교량 균열 탐지 및 매핑)

  • Kim, Byunghyun;Cho, Soojin
    • Journal of the Korean Society of Safety
    • /
    • v.36 no.1
    • /
    • pp.18-25
    • /
    • 2021
  • In many developed countries, such as South Korea, efficiently maintaining the aging infrastructures is an important issue. Currently, inspectors visually inspect the infrastructure for maintenance needs, but this method is inefficient due to its high costs, long logistic times, and hazards to the inspectors. Thus, in this paper, a novel crack inspection approach for concrete bridges is proposed using integrated image processing techniques. The proposed approach consists of four steps: (1) training a deep learning model to automatically detect cracks on concrete bridges, (2) acquiring in-situ images using a drone, (3) generating orthomosaic images based on 3D modeling, and (4) detecting cracks on the orthmosaic image using the trained deep learning model. Cascade Mask R-CNN, a state-of-the-art instance segmentation deep learning model, was trained with 3235 crack images that included 2415 hard negative images. We selected the Tancheon overpass, located in Seoul, South Korea, as a testbed for the proposed approach, and we captured images of pier 34-37 and slab 34-36 using a commercial drone. Agisoft Metashape was utilized as a 3D model generation program to generate an orthomosaic of the captured images. We applied the proposed approach to four orthomosaic images that displayed the front, back, left, and right sides of pier 37. Using pixel-level precision referencing visual inspection of the captured images, we evaluated the trained Cascade Mask R-CNN's crack detection performance. At the coping of the front side of pier 37, the model obtained its best precision: 94.34%. It achieved an average precision of 72.93% for the orthomosaics of the four sides of the pier. The test results show that this proposed approach for crack detection can be a suitable alternative to the conventional visual inspection method.

Deep Learning-based Depth Map Estimation: A Review

  • Abdullah, Jan;Safran, Khan;Suyoung, Seo
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.1
    • /
    • pp.1-21
    • /
    • 2023
  • In this technically advanced era, we are surrounded by smartphones, computers, and cameras, which help us to store visual information in 2D image planes. However, such images lack 3D spatial information about the scene, which is very useful for scientists, surveyors, engineers, and even robots. To tackle such problems, depth maps are generated for respective image planes. Depth maps or depth images are single image metric which carries the information in three-dimensional axes, i.e., xyz coordinates, where z is the object's distance from camera axes. For many applications, including augmented reality, object tracking, segmentation, scene reconstruction, distance measurement, autonomous navigation, and autonomous driving, depth estimation is a fundamental task. Much of the work has been done to calculate depth maps. We reviewed the status of depth map estimation using different techniques from several papers, study areas, and models applied over the last 20 years. We surveyed different depth-mapping techniques based on traditional ways and newly developed deep-learning methods. The primary purpose of this study is to present a detailed review of the state-of-the-art traditional depth mapping techniques and recent deep learning methodologies. This study encompasses the critical points of each method from different perspectives, like datasets, procedures performed, types of algorithms, loss functions, and well-known evaluation metrics. Similarly, this paper also discusses the subdomains in each method, like supervised, unsupervised, and semi-supervised methods. We also elaborate on the challenges of different methods. At the conclusion of this study, we discussed new ideas for future research and studies in depth map research.

Semantic Segmentation of Clouds Using Multi-Branch Neural Architecture Search (멀티 브랜치 네트워크 구조 탐색을 사용한 구름 영역 분할)

  • Chi Yoon Jeong;Kyeong Deok Moon;Mooseop Kim
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.2
    • /
    • pp.143-156
    • /
    • 2023
  • To precisely and reliably analyze the contents of the satellite imagery, recognizing the clouds which are the obstacle to gathering the useful information is essential. In recent times, deep learning yielded satisfactory results in various tasks, so many studies using deep neural networks have been conducted to improve the performance of cloud detection. However, existing methods for cloud detection have the limitation on increasing the performance due to the adopting the network models for semantic image segmentation without modification. To tackle this problem, we introduced the multi-branch neural architecture search to find optimal network structure for cloud detection. Additionally, the proposed method adopts the soft intersection over union (IoU) as loss function to mitigate the disagreement between the loss function and the evaluation metric and uses the various data augmentation methods. The experiments are conducted using the cloud detection dataset acquired by Arirang-3/3A satellite imagery. The experimental results showed that the proposed network which are searched network architecture using cloud dataset is 4% higher than the existing network model which are searched network structure using urban street scenes with regard to the IoU. Also, the experimental results showed that the soft IoU exhibits the best performance on cloud detection among the various loss functions. When comparing the proposed method with the state-of-the-art (SOTA) models in the field of semantic segmentation, the proposed method showed better performance than the SOTA models with regard to the mean IoU and overall accuracy.

A Study on the automatic vehicle monitoring system based on computer vision technology (컴퓨터 비전 기술을 기반으로 한 자동 차량 감시 시스템 연구)

  • Cheong, Ha-Young;Choi, Chong-Hwan;Choi, Young-Gyu;Kim, Hyon-Yul;Kim, Tae-Woo
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.10 no.2
    • /
    • pp.133-140
    • /
    • 2017
  • In this paper, we has proposed an automatic vehicle monitoring system based on computer vision technology. The real-time display system has displayed a system that can be performed in automatic monitoring and control while meeting the essential requirements of ITS. Another advantage has that for a powerful vehicle tracking, the main obstacle handing system, which has the shadow tracking of moving objects. In order to obtain all kinds of information from the tracked vehicle image, the vehicle must be clearly displayed on the surveillance screen. Over time, it's necessary to precisely control the vehicle, and a three-dimensional model-based approach has been also necessary. In general, each type of vehicle has represented by the skeleton of the object or wire frame model, and the trajectory of the vehicle can be measured with high precision in a 3D-based manner even if the system has not running in real time. In this paper, we has applied on segmentation method to vehicle, background, and shadow. The validity of the low level vehicle control tracker was also detected through speed tracking of the speeding car. In conclusion, we intended to improve the improved tracking method in the tracking control system and to develop the highway monitoring and control system.

The thresholding method for cervical cell image segmentation (자궁경부암 세포 영상 분할을 위한 Thresholding 기법)

  • 김재륜;하진영;김백섭;김호성
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1999.10b
    • /
    • pp.419-421
    • /
    • 1999
  • 본 논문은 자궁경부암 검사를 위한 전처리 과정인 자궁경부암 세포 영상분할 문제 연구의 결과이다. 자궁경부암 세포 영상은 배경과 세포질 및 세포핵의 구별이 어렵다. 게다가 자궁경부암 검사 시스템은 짧은 시간동안 많은 영상을 처리해야 하기 때문에, 영상의 분석 속도가 빠르고 강력한 영상 분할 기법이 필요하다. 이를 위하여 우리는 thresholding 기법을 연구하였다. 먼저 세포 영상의 각 화소의 명암의 분포를 조사하여 히스토그램을 구하였다. 히스토그램은 0~255 사이에 존재하게 되는데, 0~255의 전 영역에 존재하기 보다는 그 중 일부분에만 존재한다. 우리는 히스토그램이 존재하는 영역을 백분율로 나누고 세포핵 및 세포질이 존재하는 영역의 분포를 구하여 global threshold를 찾았고, 이를 기준으로 각 점을 thresholding 할 때에 주위의 평균값을 보정값으로 두어 local thresholding을 수행하였다. 결과 영상은 핵의 영역을 탐색하기 위한 seed로 사용하기에 적합하다.

  • PDF

Marine Object Detection Based on Kalman Filtering

  • Hwang, Jae-Jeong;Pak, Sang-Hyon;Park, Gil-Yang
    • Journal of information and communication convergence engineering
    • /
    • v.9 no.3
    • /
    • pp.347-352
    • /
    • 2011
  • In this paper, although Radar has been used for a long time, integrated scheme with visual camera is an efficient way to enhance marine surveillance system. Camera image is focused by radar information but it is easy to be fallen into inaccurate operation due to environmental noises. We have proposed a method to filter the noises by moving average filter and Kalman filter. It is proved that Kalman filtered results preserves linearity while the former includes larger variance.

A Fast Method for Finding the Optimal Threshold for Image Segmentation (영상분할의 최적 임계치를 구하는 빠른 방법)

  • 신용식;이정훈
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2001.12a
    • /
    • pp.109-112
    • /
    • 2001
  • 영상분할에 있어서 최적의 임계치를 구하는 것은 영상을 구성하고 있는 픽셀들을 의미있는 집단으로 나누는 거와 같으며 이를 위하여 퍼지화 정도를 측정하여 최소의 퍼지화 정도를 갖는 임계치를 최적의 임계치로 설정한다. 일반적으로 소속도는 하나의 픽셀과 그 픽셀이 속한 영역의 관계로 표현될 수 있는데 소속도 계산을 위한 엔트로피로 샤논(Shannon)함수를 사용한다[1]. Liang-Kai Huang에 의하여 제안된 알고리즘은 그 수렴속도 면에 있어서 많은 문제점을 갖고 있다[2]. 본 논문에서는 이런 수렴속도를 좀더 개선하기 위하여 SPOI(Simplified Fixed Point Iteration)를 제안하고 여러 가지 실험영상을 사용하여 졔안된 논문의 우수성을 보이고자 한다. 실험결과 적절한 임계치를 구하면서도 기존의 논문보다 속도면에서 상당히 우수한 특성을 보이고 있다.

  • PDF

2D/3D image Conversion Method using Object Segmentation for decrease processing and Create Dept.h Map (연산량을 감소한 객체 분할과 깊이정보 생성을 이용한 2D/3D 동영상 변환 연구)

  • Han, Hyeon-Ho;Hong, Yeong-Pyo;Kim, Jin-Su;Lee, Sang-Hun
    • Proceedings of the KAIS Fall Conference
    • /
    • 2010.11a
    • /
    • pp.92-95
    • /
    • 2010
  • 본 논문에서는 2차원 영상을 3차원 영상으로 변환하여 입체감을 주는 방법을 제안하였다. 2D/3D 변환을 위해 Normalized Cut을 사용하여 객체를 분할하였고, 분할된 객체에 Optical Flow 값을 계산해 깊이정보를 생성하여 입체감을 주었다. 객체를 분할하기 위해 Normalized Cut을 이용한 방법에 Optical Flow를 이용한 가중치 값을 추가하여 정확한 객체 분할을 하였고, 처리속도 향상을 위해 영상의 밝기, 색상을 고려한 Watershed 알고리즘을 적용하여 연산량을 줄였다. 분할된 영상에 Optical Flow를 이용하여 색상 정보의 차이를 통해 객체별 고유벡터 값을 연산하여 객체의 움직임 정보를 추출하고 운동시차를 고려해 깊이 정보를 생성하였다. 제안한 방법으로 변환하기 위해 MATLAB을 사용하였다. 제안한 변환 방법은 2D/3D 입체변환에 효과적이었다.

  • PDF

Recognition of Patterns and Marks on the Glass Panel of Computer Monitor (컴퓨터 모니터용 유리 패널의 문자 마크 인식)

  • Ahn, In-Mo;Lee, Kee-Sang
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.52 no.1
    • /
    • pp.35-41
    • /
    • 2003
  • In this paper, a machine vision system for recognizing and classifying the patterns and marks engraved by die molding or laser marking on the glass panels of computer monitors is suggested and evaluated experimentally. The vision system is equipped with a neural network and an NGC pattern classifier including searching process based on normalized grayscale correlation and adaptive binarization. This system is found to be applicable even to the cases in which the segmentation of the pattern area from the background using ordinary blob coloring technique is quite difficult. The inspection process is accomplished by the use of the NGC hypothesis and ANN verification. The proposed pattern recognition system is composed of three parts: NGC matching process and the preprocessing unit for acquiring the best quality of binary image data, a neural network-based recognition algorithm, and the learning algorithm for the neural network. Another contribution of this paper is the method of generating the training patterns from only a few typical product samples in place of real images of all types of good products.

Object Extraction Method Using Contour Information-based Saliency Map and Object andidate Image (윤곽선 정보 기반의 Saliency Map과 객체 후보 영상을 이용한 객체 추출 기법)

  • Han, Sung-Ho;Hong, Yeong-Pyo;Lee, Gang-Seong;Lee, Sang-Hun
    • Proceedings of the KAIS Fall Conference
    • /
    • 2012.05b
    • /
    • pp.527-530
    • /
    • 2012
  • 본 논문은 윤곽선이 두드러지는 Saliency Map모델을 생성하고 객체 후보 영상을 획득하여 객체를 추출할 수 있는 기법에 관한 연구이다. 제안하는 기법은 객체의 윤곽선 정보가 두드러지는 Saliency Map을 생성하기 위해 에지(Edge), 초점(Focus), 엔트로피(Entropy)를 특징 정보로써 사용하고, 획득한 Saliency Map의 임계화 과정 및 라벨링 과정을 통해 배경 영역을 제거한 객체 후보 영상을 획득한다. 이후 Mean Shift Segmentation 알고리즘을 적용한 영상의 세그먼트별 객체 후보 영상의 픽셀 평균값을 적용한 영상을 다시 라벨링 과정을 이용하여 객체를 추출한다.

  • PDF