• 제목/요약/키워드: multi-scale features

검색결과 185건 처리시간 0.022초

Road Damage Detection and Classification based on Multi-level Feature Pyramids

  • Yin, Junru;Qu, Jiantao;Huang, Wei;Chen, Qiqiang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제15권2호
    • /
    • pp.786-799
    • /
    • 2021
  • Road damage detection is important for road maintenance. With the development of deep learning, more and more road damage detection methods have been proposed, such as Fast R-CNN, Faster R-CNN, Mask R-CNN and RetinaNet. However, because shallow and deep layers cannot be extracted at the same time, the existing methods do not perform well in detecting objects with fewer samples. In addition, these methods cannot obtain a highly accurate detecting bounding box. This paper presents a Multi-level Feature Pyramids method based on M2det. Because the feature layer has multi-scale and multi-level architecture, the feature layer containing more information and obvious features can be extracted. Moreover, an attention mechanism is used to improve the accuracy of local boundary boxes in the dataset. Experimental results show that the proposed method is better than the current state-of-the-art methods.

Single Exposure Imaging of Talbot Carpets and Resolution Characterization of Detectors for Micro- and Nano- Patterns

  • Kim, Hyun-su;Danylyuk, Serhiy;Brocklesby, William S.;Juschkin, Larissa
    • Journal of the Optical Society of Korea
    • /
    • 제20권2호
    • /
    • pp.245-250
    • /
    • 2016
  • In this paper, we demonstrate a self-imaging technique that can visualize longitudinal interference patterns behind periodically-structured objects, which is often referred to as Talbot carpet. Talbot carpet is of great interest due to ever-decreasing scale of interference features. We demonstrate experimentally that Talbot carpets can be imaged in a single exposure configuration revealing a broad spectrum of multi-scale features. We have performed rigorous diffraction simulations for showing that Talbot carpet print can produce ever-decreasing structures down to limits set by mask feature sizes. This demonstrates that large-scale pattern masks may be used for direct printing of features with substantially smaller scales. This approach is also useful for characterization of image sensors and recording media.

Dual Attention Based Image Pyramid Network for Object Detection

  • Dong, Xiang;Li, Feng;Bai, Huihui;Zhao, Yao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제15권12호
    • /
    • pp.4439-4455
    • /
    • 2021
  • Compared with two-stage object detection algorithms, one-stage algorithms provide a better trade-off between real-time performance and accuracy. However, these methods treat the intermediate features equally, which lacks the flexibility to emphasize meaningful information for classification and location. Besides, they ignore the interaction of contextual information from different scales, which is important for medium and small objects detection. To tackle these problems, we propose an image pyramid network based on dual attention mechanism (DAIPNet), which builds an image pyramid to enrich the spatial information while emphasizing multi-scale informative features based on dual attention mechanisms for one-stage object detection. Our framework utilizes a pre-trained backbone as standard detection network, where the designed image pyramid network (IPN) is used as auxiliary network to provide complementary information. Here, the dual attention mechanism is composed of the adaptive feature fusion module (AFFM) and the progressive attention fusion module (PAFM). AFFM is designed to automatically pay attention to the feature maps with different importance from the backbone and auxiliary network, while PAFM is utilized to adaptively learn the channel attentive information in the context transfer process. Furthermore, in the IPN, we build an image pyramid to extract scale-wise features from downsampled images of different scales, where the features are further fused at different states to enrich scale-wise information and learn more comprehensive feature representations. Experimental results are shown on MS COCO dataset. Our proposed detector with a 300 × 300 input achieves superior performance of 32.6% mAP on the MS COCO test-dev compared with state-of-the-art methods.

Mutual Fund 수익률의 비정상 함수형 시그널을 위한 다해상도 클러스터 계층구조 (Multi-scale Cluster Hierarchy for Non-stationary Functional Signals of Mutual Fund Returns)

  • 김대룡;정욱
    • 경영과학
    • /
    • 제24권2호
    • /
    • pp.57-72
    • /
    • 2007
  • Many Applications of scientific research have coupled with functional data signal clustering techniques to discover novel characteristics that can be used for the diagnoses of several issues. In this article we present an interpretable multi-scale cluster hierarchy framework for clustering functional data using its multi-aspect frequency information. The suggested method focuses on how to effectively select transformed features/variables in unsupervised manner so that finally reduce the data dimension and achieve the multi-purposed clustering. Specially, we apply our suggested method to mutual fund returns and make superior-performing funds group based on different aspects such as global patterns, seasonal variations, levels of noise, and their combinations. To promise our method producing a quality cluster hierarchy, we give some empirical results under the simulation study and a set of real life data. This research will contribute to financial market analysis and flexibly fit to other research fields with clustering purposes.

Gabor 특징에 기반한 이동 및 회전 불변 지문인증 (Translation- and Rotation-Invariant Fingerprint Authentication Based on Gabor Features)

  • 김종화;조상현;성효경;최홍문
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2000년도 제13회 신호처리 합동 학술대회 논문집
    • /
    • pp.901-904
    • /
    • 2000
  • A direct authentication from gray-scale image, instead of the conventional multi-step preprocessing, is proposed using Gabor filter-based features from the gray-scale fingerprint around core point. The core point is located as a reference point for the translation invariant matching. And its principal symmetry axis is detected for the rotation invariant matching from its neighboring region centered at the core point. And then fingerprint is divided into non-overlapping blocks with respect to the core point and features are directly extracted form the blocked gray level fingerprint using Gabor filter. The proposed fingerprint authentication is based on the Euclidean distance between the corresponding Gabor features of the input and the template fingerprints. Experiments are conducted on 300${\times}$300 fingerprints obtained from a CMOS sensor with 500 dpi resolution, and the proposed method could lower the False Reject Rate(FRR) to 18.2% under False Acceptance Rate(FAR) of 0%.

  • PDF

Probabilistic Load Flow for Power Systems with Wind Power Considering the Multi-time Scale Dispatching Strategy

  • Qin, Chao;Yu, Yixin;Zeng, Yuan
    • Journal of Electrical Engineering and Technology
    • /
    • 제13권4호
    • /
    • pp.1494-1503
    • /
    • 2018
  • This paper proposes a novel probabilistic load flow model for power systems integrated with large-scale wind power, which considers the multi-time scale dispatching features. The ramp limitations of the units and the steady-state security constraints of the network have been comprehensively considered for the entire duration of the study period; thus, the coupling of the system operation states at different time sections has been taken into account. For each time section, the automatic generation control (AGC) strategy is considered, and all variations associated with the wind power and loads are compensated by all AGC units. Cumulants and the Gram-Charlier expansion are used to solve the proposed model. The effectiveness of the proposed method is validated using the modified IEEE RTS 24-bus system and the modified IEEE 118-bus system.

Multi-scale U-SegNet architecture with cascaded dilated convolutions for brain MRI Segmentation

  • 챠이트라 다야난다;이범식
    • 한국방송∙미디어공학회:학술대회논문집
    • /
    • 한국방송∙미디어공학회 2020년도 추계학술대회
    • /
    • pp.25-28
    • /
    • 2020
  • Automatic segmentation of brain tissues such as WM, GM, and CSF from brain MRI scans is helpful for the diagnosis of many neurological disorders. Accurate segmentation of these brain structures is a very challenging task due to low tissue contrast, bias filed, and partial volume effects. With the aim to improve brain MRI segmentation accuracy, we propose an end-to-end convolutional based U-SegNet architecture designed with multi-scale kernels, which includes cascaded dilated convolutions for the task of brain MRI segmentation. The multi-scale convolution kernels are designed to extract abundant semantic features and capture context information at different scales. Further, the cascaded dilated convolution scheme helps to alleviate the vanishing gradient problem in the proposed model. Experimental outcomes indicate that the proposed architecture is superior to the traditional deep-learning methods such as Segnet, U-net, and U-Segnet and achieves high performance with an average DSC of 93% and 86% of JI value for brain MRI segmentation.

  • PDF

고해상도 시계열 광학 위성 영상과 특징점 추적 기법을 이용한 북극해 해빙 이동 탐지 (Arctic Sea Ice Motion Measurement Using Time-Series High-Resolution Optical Satellite Images and Feature Tracking Techniques)

  • 현창욱;김현철
    • 대한원격탐사학회지
    • /
    • 제34권6_2호
    • /
    • pp.1215-1227
    • /
    • 2018
  • 해빙의 이동은 지역적 분포뿐만 아니라 해빙의 생성 및 두께에도 영향을 미치기 때문에 해빙의 변화를 평가하는 데에 중요한 정보가 된다. 이 연구에서는 북극해 해빙의 이동 특성 탐지를 위해 Korea Multi-Purpose Satellite-2(KOMPSAT-2)와 Korea Multi-Purpose Satellite-3(KOMPSAT-3)의 두 위성 센서로부터 다중 시기 고해상도 광학 위성 영상을 획득하고, SIFT(Scale-Invariant Feature Transform), SURF(Speeded Up Robust Features) 및 ORB(Oriented FAST and Rotated BRIEF)의 특징점 추적 기법을 적용하였다. 두 위성 센서에서 획득된 영상의 활용을 위해 전처리 단계에서 공간해상도와 방사해상도를 일치시킨 후 특징점 추적 기법을 적용한 결과 SIFT의 경우 영상 전반에 걸쳐 특징점의 고른 공간 분포가 나타났고, SURF의 경우 해빙과 해양의 경계 부분에 특징점이 주요하게 분포하는 경향이 관찰되었으며 이러한 경향은 ORB에서 가장 현저하게 나타났다. 특징점 추적 기법별 연산 시간 측정 결과 SIFT, SURF 및 ORB의 순서로 연산 시간이 감소하였다. ORB의 경우 SIFT 기법 대비 추적된 특징점 수가 평균 59.8%로 줄어들었지만 연산 시간은 평균 8.7%에 해당하는 시간이 소요되어 해빙 이동 특성의 고속 탐지에 적합한 기법으로 판단된다.

항공 영상 분석을 위한 고유영상과 멀티 스케일 감마 보정 기반의 그림자 복원 (Shadow Reconstruction Based on Intrinsic Image and Multi-Scale Gamma Correction for Aerial Image Analysis)

  • 박기홍
    • 한국항행학회논문지
    • /
    • 제23권5호
    • /
    • pp.400-407
    • /
    • 2019
  • 본 논문에서는 다양한 조도의 영향에도 본질적인 특성이 변하지 않는 고유영상을 이용한 그림자 검출과 멀티 스케일 감마 보정 기반의 그림자 복원 방법을 제안하였다. 그림자 검출은 컬러 영상의 그레이스케일 영상과 고유영상 간의 화소 변화 정보를 이용하여 추정하였으며, 그림자 복원 과정에서는 감마 보정을 통해 영상의 밝기를 조절하는 방법을 적용하였다. 감마 보정은 개별적 화소값에 대한 비선형 조정으로 채도가 변경될 수 있으므로 컬러 영상의 채널별로 수행되는 멀티 스케일 감마 보정을 수행한다. 멀티 스케일 감마 값은 컬러 영상에서 그림자와 그림자가 아닌 영역의 교차 윤곽을 획득한 후 이 정보를 기반으로 추정되며, 결과적으로 서로 다른 유형의 영역 특징을 멀티 스케일 감마 값으로 보정하여 그림자를 복원하였다. 실험 결과, 제안하는 방법이 그림자가 포함된 단일 자연 영상에서 그림자를 효과적으로 복원함을 보였다.

Restoring Turbulent Images Based on an Adaptive Feature-fusion Multi-input-Multi-output Dense U-shaped Network

  • Haiqiang Qian;Leihong Zhang;Dawei Zhang;Kaimin Wang
    • Current Optics and Photonics
    • /
    • 제8권3호
    • /
    • pp.215-224
    • /
    • 2024
  • In medium- and long-range optical imaging systems, atmospheric turbulence causes blurring and distortion of images, resulting in loss of image information. An image-restoration method based on an adaptive feature-fusion multi-input-multi-output (MIMO) dense U-shaped network (Unet) is proposed, to restore a single image degraded by atmospheric turbulence. The network's model is based on the MIMO-Unet framework and incorporates patch-embedding shallow-convolution modules. These modules help in extracting shallow features of images and facilitate the processing of the multi-input dense encoding modules that follow. The combination of these modules improves the model's ability to analyze and extract features effectively. An asymmetric feature-fusion module is utilized to combine encoded features at varying scales, facilitating the feature reconstruction of the subsequent multi-output decoding modules for restoration of turbulence-degraded images. Based on experimental results, the adaptive feature-fusion MIMO dense U-shaped network outperforms traditional restoration methods, CMFNet network models, and standard MIMO-Unet network models, in terms of image-quality restoration. It effectively minimizes geometric deformation and blurring of images.