• Title/Summary/Keyword: mIoU

Search Result 65, Processing Time 0.022 seconds

Keypoint-based Deep Learning Approach for Building Footprint Extraction Using Aerial Images

  • Jeong, Doyoung;Kim, Yongil
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.1
    • /
    • pp.111-122
    • /
    • 2021
  • Building footprint extraction is an active topic in the domain of remote sensing, since buildings are a fundamental unit of urban areas. Deep convolutional neural networks successfully perform footprint extraction from optical satellite images. However, semantic segmentation produces coarse results in the output, such as blurred and rounded boundaries, which are caused by the use of convolutional layers with large receptive fields and pooling layers. The objective of this study is to generate visually enhanced building objects by directly extracting the vertices of individual buildings by combining instance segmentation and keypoint detection. The target keypoints in building extraction are defined as points of interest based on the local image gradient direction, that is, the vertices of a building polygon. The proposed framework follows a two-stage, top-down approach that is divided into object detection and keypoint estimation. Keypoints between instances are distinguished by merging the rough segmentation masks and the local features of regions of interest. A building polygon is created by grouping the predicted keypoints through a simple geometric method. Our model achieved an F1-score of 0.650 with an mIoU of 62.6 for building footprint extraction using the OpenCitesAI dataset. The results demonstrated that the proposed framework using keypoint estimation exhibited better segmentation performance when compared with Mask R-CNN in terms of both qualitative and quantitative results.

Impacts of label quality on performance of steel fatigue crack recognition using deep learning-based image segmentation

  • Hsu, Shun-Hsiang;Chang, Ting-Wei;Chang, Chia-Ming
    • Smart Structures and Systems
    • /
    • v.29 no.1
    • /
    • pp.207-220
    • /
    • 2022
  • Structural health monitoring (SHM) plays a vital role in the maintenance and operation of constructions. In recent years, autonomous inspection has received considerable attention because conventional monitoring methods are inefficient and expensive to some extent. To develop autonomous inspection, a potential approach of crack identification is needed to locate defects. Therefore, this study exploits two deep learning-based segmentation models, DeepLabv3+ and Mask R-CNN, for crack segmentation because these two segmentation models can outperform other similar models on public datasets. Additionally, impacts of label quality on model performance are explored to obtain an empirical guideline on the preparation of image datasets. The influence of image cropping and label refining are also investigated, and different strategies are applied to the dataset, resulting in six alternated datasets. By conducting experiments with these datasets, the highest mean Intersection-over-Union (mIoU), 75%, is achieved by Mask R-CNN. The rise in the percentage of annotations by image cropping improves model performance while the label refining has opposite effects on the two models. As the label refining results in fewer error annotations of cracks, this modification enhances the performance of DeepLabv3+. Instead, the performance of Mask R-CNN decreases because fragmented annotations may mistake an instance as multiple instances. To sum up, both DeepLabv3+ and Mask R-CNN are capable of crack identification, and an empirical guideline on the data preparation is presented to strengthen identification successfulness via image cropping and label refining.

Modification of Endothelium on Contractile Response of Brain Vessels to Contracting Agents (혈관 수축제의 뇌혈관 수축반응에 대한 혈관근 내피세포의 역할)

  • Kook, Young-Johng;Baik, Yung-Hong;Kim, Jong-Keun;Choi, Bong-Kyu;Choi, Soo-Hyung;Kim, Yung-In
    • The Korean Journal of Pharmacology
    • /
    • v.24 no.2
    • /
    • pp.203-216
    • /
    • 1988
  • To delineate the mechanisms of vasoconstriction and vasodilation in cerebral arteries the effects of some vasoconstrictors and calcium antagonists on the basilar artery (BA) and arterial circle of Willis (WC) were examined and also the role of endothelium in the action of these drugs was investigated in pigs, cats and rabbits. In pig cerebral arteries, dose-dependent contractile responses were elicited by KCI, histamine, 5-hydroxytryptamine (5-HT) and angiotensin, but norepinephrine (NE), phenylephrine (PE) and epinephrine (EP) elicited dose-dependent contractions only under pretreatment with propranolol 10-6 M. The magnitudes of maximal contractile effects of these drugs were different from each other, and 5-H~ was the largest and angiotensin the smallest. Some calcium antagonists dose-dependently inhibited KCI (35 mM)-induced contraction and the order of potency in inhibiting the contraction was nifedipine > > diltiazem > flunarizine > oxybutynin > isosorbide dinitrate (ISDN) > glyceryl trinitrate. 5-HT (10-6 M)-induced contraction was dosedependently inhibited by nifedipine but slightly inhibited by diltiazem and ISDN. In rings with intact endothelium, KCI (35 mM)-induced contraction was not affected by acetylcholine (ACh) but $PGF_{2{\alpha}}$ (lO-SM)-induced contraction was dose-dependently relaxed by ACh and adenosine. This endothelium-dependent relaxation was not affected by nifedipine (l0-6M)-pretreatment but markedly inhibited by methylene blue (50,uM)-pretreatment. In the porcine arterial rings without endothelium, ACh had no effect or even contracted the $PGF_{2{\alpha}}-induced$ contraction. However, the dosedependent relaxing effect of ACh appeared when the deendothelized porcine ring and rabbit thoracic aorta with intact endotheli urn were simultaneously suspended into a bath and this relaxing effect was also inhibited by methylene blue-pretreatment. In cat cerebral arteries, 5-HT and NE elicited dose-dependent contractile responses and ACh also produced dose-dependent contraction regardless of the existence of endothelium. ACh-induced contraction was most prominent. 5-HT (IO-SM)induced contraction was not relaxed but contracted additionally by ACh even in the intact endothelial ring. In rabbit cerebral arteries, 5-HT and NE elicited dose-dependent contractile responses and 5-HT-induced contraction was more prominent. In the intact endothelial preparations, 5-HT (lO-s M)-induced contraction was markedly relaxed by the addition of ACh( IO-SM) and this endothelium-dependent relaxing effect was inhibited by atropine (l0-7M)-pretreatment but notaffected by diltiazem (l0-6M)-pretreatment. These results suggest that ACh elicits endotheliumdependent relaxing effect mediated by muscarinic receptors in cerebral arteries of pig and rabbit, and that ACh acts as vasoconstrictor in cat cerebral artery.

  • PDF

A Study of AI-based Monitoring Techniques for Land-based Debris in Stream (AI기반 하천 부유쓰레기 모니터링 기술 연구)

  • Kyungsu Lee;Haein Yoon;Jonghwa Won;Sang Hwa Jung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.137-137
    • /
    • 2023
  • 해양쓰레기는 해안의 심미적 가치 저하뿐만 아니라 생태계 파괴, 유령 어업에 따른 수산업 피해 등의 사회적·환경적 문제를 발생시키며, 그중 70% 이상은 육상 기인으로 플라스틱 및 기타 쓰레기가 주를 이루는 해외와 달리 국내의 경우 다량의 초목류를 포함하고 있다. 다양한 부유쓰레기에 대한 기존의 해양쓰레기량 추정의 한계와 하천·하구 쓰레기 수거의 효율화를 위해 해양으로 유입되는 부유쓰레기 방지를 위한 실효성 있는 대책 수립이 필요한 실정이다. 본 연구는 해양 유입 전 하천의 차단시설에 차집된 부유쓰레기의 수거 효율화 및 지속가능한 해양쓰레기 데이터 구축을 위해 AI기반의 기술을 통해 부유쓰레기 성상 분석 기법(Object Detection)과 차집량 분석 기법(Semantic Segmentation)을 활용하였다. 실제와 유사한 데이터 수집을 위해 다양한 하천 환경(정수조, 소하천, 급경사수로)에 대해 탁도(녹조, 유사), 광량, 쓰레기형상, 초목류 함량, 날씨(소하천), 유속(급경사수로) 등의 실험조건에 대하여 해양쓰레기 분류 기준 및 통계를 바탕으로 부유쓰레기 종류 선정하여 학습을 위한 데이터를 수집하였다. 학습 목적에 따라 구분하여 라벨링(Bounding box, Polygon)을 수행하고, 각 분석 기법별 전이학습을 통해 Phase 1(정수조), Phase 2(소하천), Phase 3(급경사수로) 순서로 모델을 고도화하였다. 성상 분석을 위해 YOLO v4를 활용하여 Train, Test DataSet(9:1)을 구성하고 학습 및 평가는 Iteration마다의 mAP, loss 값을 통해 비교하였으며, 학습 Phase에 따라 모델 고도화로 Test Set의 mAP 값이 성상별로 높아짐을 확인하였으며, 차집량 분석을 위해 Unet을 활용하여 Train, Test, Validation DataSet(8.5:1:0.5)을 구성하고 epoch별 IoU(intersection over Union), F1-score, loss 값을 비교하여 정성적, 정량적 평가 모두 Phase 3에서 가장 높은 성능을 확인하였다. 향후 하천 환경에서의 다양한 영양인자별 분석을 통해 주요 영향인자 도출 및 Hyper Parameter 최적화를 통한 모델 고도화로 인해 활용성이 높아질 것으로 판단된다.

  • PDF

Deep Learning-based Interior Design Recognition (딥러닝 기반 실내 디자인 인식)

  • Wongyu Lee;Jihun Park;Jonghyuk Lee;Heechul Jung
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.19 no.1
    • /
    • pp.47-55
    • /
    • 2024
  • We spend a lot of time in indoor space, and the space has a huge impact on our lives. Interior design plays a significant role to make an indoor space attractive and functional. However, it should consider a lot of complex elements such as color, pattern, and material etc. With the increasing demand for interior design, there is a growing need for technologies that analyze these design elements accurately and efficiently. To address this need, this study suggests a deep learning-based design analysis system. The proposed system consists of a semantic segmentation model that classifies spatial components and an image classification model that classifies attributes such as color, pattern, and material from the segmented components. Semantic segmentation model was trained using a dataset of 30000 personal indoor interior images collected for research, and during inference, the model separate the input image pixel into 34 categories. And experiments were conducted with various backbones in order to obtain the optimal performance of the deep learning model for the collected interior dataset. Finally, the model achieved good performance of 89.05% and 0.5768 in terms of accuracy and mean intersection over union (mIoU). In classification part convolutional neural network (CNN) model which has recorded high performance in other image recognition tasks was used. To improve the performance of the classification model we suggests an approach that how to handle data that has data imbalance and vulnerable to light intensity. Using our methods, we achieve satisfactory results in classifying interior design component attributes. In this paper, we propose indoor space design analysis system that automatically analyzes and classifies the attributes of indoor images using a deep learning-based model. This analysis system, used as a core module in the A.I interior recommendation service, can help users pursuing self-interior design to complete their designs more easily and efficiently.