• 제목/요약/키워드: Depth segmentation

Search Result 175, Processing Time 0.03 seconds

Cleaning robot system with deep learning-based sidewalk environment recognition and waste sorting technology (딥러닝 기반 보도(步道) 환경 인식 및 쓰레기 분류 기술을 탑재한 청소로봇 시스템)

  • Lee, Jong-Soo;Lim, Kyeong-Min;Lee, Young-Min;Lim, Jun-Oh;Yang, Woo-Sung
    • Annual Conference of KIPS
    • /
    • 2022.11a
    • /
    • pp.925-927
    • /
    • 2022
  • 본 논문에서는 자율주행을 통해 보도를 청소하는 동안 분실물을 인지할 수 있는 로봇 시스템을 개발하였다. 분실물의 종류는 딥러닝 모델에 의해 지정되고 학습되며 로봇은 이를 인식하여 저장한다. 보도 경계 및 장애물을 감지하기 위해 Image-Segmentation 기술을 사용하였으며, 물체 감지에 사용되는 depth 카메라(d435)를 사용하였다. 학습하기 위한 딥러닝 모델로 YOLOv5 를 사용하였으며, 그 결과 정해진 사물을 인식하는 데 평균 84%의 정확도를 보였다. 이 시스템을 로봇에 적용할 경우 예상되는 효과로는 정확한 보도 인식으로 로봇이 경로를 이탈하지 않도록 하는 것, 유실물품의 신속하고 안전한 인계 등이 있다.

Edge-based Surface Segmentation Algorithm of 3-D Image using Curvature (곡률을 이용한 3차원 영상의 에지 기반 표면 분할 알고리즘)

  • Seol, Seong-Uk;Lee, Jae-Chul;Nam, Gi-Gon;Jeon, Gye-Rok;Ju, Jae-Heum
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.2
    • /
    • pp.199-207
    • /
    • 2001
  • In this paper, we suggest an edge-based surface segmentation algorithm of 3D image using curvature. For the first, in this proposed method, we approximate 3D depth data to second order curves by each scan line and decide splitting points of 3D edges by curvature of the approximated curves. And finally make a group as 3D surface with the region of input image by the 3D edges. In the conventional algorithms, there are some difficulties in detecting 3D edge with the separated processes for the jump edge and the crease edge and especially, in deciding the ambiguous discontinuity of surface directions about the crease edge. The proposed algorithm decides curvature discontinuity using curvature which is simply calculated by a geometrical approximation. Furthermore, the algorithm has a cooperated process to calculate the jump and crease edges. The results of computer simulations with several 3D images show that the proposed method yields better performance as comparing with the conventional methods.

  • PDF

Multiple Texture Image Recognition with Unsupervised Block-based Clustering (비교사 블록-기반 군집에 의한 다중 텍스쳐 영상 인식)

  • Lee, Woo-Beom;Kim, Wook-Hyun
    • The KIPS Transactions:PartB
    • /
    • v.9B no.3
    • /
    • pp.327-336
    • /
    • 2002
  • Texture analysis is an important technique in many image understanding areas, such as perception of surface, object, shape and depth. But the previous works are intend to the issue of only texture segment, that is not capable of acquiring recognition information. No unsupervised method is basased on the recognition of texture in image. we propose a novel approach for efficient texture image analysis that uses unsupervised learning schemes for the texture recognition. The self-organization neural network for multiple texture image identification is based on block-based clustering and merging. The texture features used are the angle and magnitude in orientation-field that might be different from the sample textures. In order to show the performance of the proposed system, After we have attempted to build a various texture images. The final segmentation is achieved by using efficient edge detection algorithm applying to block-based dilation. The experimental results show that the performance of the system Is very successful.

Newly Modified Watershed Algorithm Determining Dynamic Region Merging or Watershed Line in the Flooding Process (담수과정에서 동적 영역 병합과 분수령선을 결정하는 개선된 분수령 알고리즘)

  • Kim, Sang-Gon;Jeoune, Dae-Seong;Lee, Jae-Do;Kim, Hwi-Won;Yoon, Young-Woo
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.38 no.6
    • /
    • pp.113-119
    • /
    • 2001
  • In this paper, we propose an improved watershed algorithm that resolves the oversegmentation problem shown in the previous watershed algorithm and its modifications when the spatial video segmentation is performed. The principal idea of the proposed algorithm is merging the shallow catchment basin whose depth is less than a given threshold into the deeper one during flooding step. In the flooding process, the growth of the existing catchment basins and the extraction of newly flooded ones are accomplished. We present the experimental results using several MPEG test sequences in the last part of the paper. As a consequence, the proposed algorithm shows good segmentation results according to the thresholds applied by adding very small amount of calculations.

  • PDF

Deleuze's Deterritorialization Body without Organs in Contemporary Fashion -Focusing on Central Saint Martins, Royal College of Art, Antwerp Royal Academy of Fine Arts Graduation works- (현대 패션에 표현된 들뢰즈의 탈영토화와 기관 없는 신체 -영국 센트럴 세인트 마틴스 예술대학, 영국 왕립예술대학교, 벨기에 앤트워프 왕립예술대학의 2017-2019 줄업 작품을 중심으로-)

  • Wang, Xin-yu;Kim, Hyun-Joo
    • Journal of Digital Convergence
    • /
    • v.18 no.12
    • /
    • pp.549-563
    • /
    • 2020
  • Based on Deleuze's body aesthetics and from the perspective of 'deterritoraliazation', this study makes an in-depth discussion on the modern fashion design modeling by four visual characteristics: hysteria, visualization, body segmentation and becoming animals. First, hysteria embodies the strong visual effect brought by the deformation and exaggeration of clothing. Second, visualization in fashion shows the elimination or ambiguity of faces, representing the weakening of identity and the prominence of clothing and body. Third, body segmentation represents the deconstruction and reorganization of clothing, and a new way of thinking, as well. Fourth, becoming-animals are manifested in the physical mutation caused by the heterogeneous connection between humans and animals, which brings about the possibility of rethinking the body.

Sinkhole Tracking by Deep Learning and Data Association (딥 러닝과 데이터 결합에 의한 싱크홀 트래킹)

  • Ro, Soonghwan;Hoai, Nam Vu;Choi, Bokgil;Dung, Nguyen Manh
    • The Journal of Korean Institute of Information Technology
    • /
    • v.17 no.6
    • /
    • pp.17-25
    • /
    • 2019
  • Accurate tracking of the sinkholes that are appearing frequently now is an important method of protecting human and property damage. Although many sinkhole detection systems have been proposed, it is still far from completely solved especially in-depth area. Furthermore, detection of sinkhole algorithms experienced the problem of unstable result that makes the system difficult to fire a warning in real-time. In this paper, we proposed a method of sinkhole tracking by deep learning and data association, that takes advantage of the recent development of CNN transfer learning. Our system consists of three main parts which are binary segmentation, sinkhole classification, and sinkhole tracking. The experiment results show that the sinkhole can be tracked in real-time on the dataset. These achievements have proven that the proposed system is able to apply to the practical application.

Automated 3D scoring of fluorescence in situ hybridization (FISH) using a confocal whole slide imaging scanner

  • Ziv Frankenstein;Naohiro Uraoka;Umut Aypar;Ruth Aryeequaye;Mamta Rao;Meera Hameed;Yanming Zhang;Yukako Yagi
    • Applied Microscopy
    • /
    • v.51
    • /
    • pp.4.1-4.12
    • /
    • 2021
  • Fluorescence in situ hybridization (FISH) is a technique to visualize specific DNA/RNA sequences within the cell nuclei and provide the presence, location and structural integrity of genes on chromosomes. A confocal Whole Slide Imaging (WSI) scanner technology has superior depth resolution compared to wide-field fluorescence imaging. Confocal WSI has the ability to perform serial optical sections with specimen imaging, which is critical for 3D tissue reconstruction for volumetric spatial analysis. The standard clinical manual scoring for FISH is labor-intensive, time-consuming and subjective. Application of multi-gene FISH analysis alongside 3D imaging, significantly increase the level of complexity required for an accurate 3D analysis. Therefore, the purpose of this study is to establish automated 3D FISH scoring for z-stack images from confocal WSI scanner. The algorithm and the application we developed, SHIMARIS PAFQ, successfully employs 3D calculations for clear individual cell nuclei segmentation, gene signals detection and distribution of break-apart probes signal patterns, including standard break-apart, and variant patterns due to truncation, and deletion, etc. The analysis was accurate and precise when compared with ground truth clinical manual counting and scoring reported in ten lymphoma and solid tumors cases. The algorithm and the application we developed, SHIMARIS PAFQ, is objective and more efficient than the conventional procedure. It enables the automated counting of more nuclei, precisely detecting additional abnormal signal variations in nuclei patterns and analyzes gigabyte multi-layer stacking imaging data of tissue samples from patients. Currently, we are developing a deep learning algorithm for automated tumor area detection to be integrated with SHIMARIS PAFQ.

Depth-Based Recognition System for Continuous Human Action Using Motion History Image and Histogram of Oriented Gradient with Spotter Model (모션 히스토리 영상 및 기울기 방향성 히스토그램과 적출 모델을 사용한 깊이 정보 기반의 연속적인 사람 행동 인식 시스템)

  • Eum, Hyukmin;Lee, Heejin;Yoon, Changyong
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.26 no.6
    • /
    • pp.471-476
    • /
    • 2016
  • In this paper, recognition system for continuous human action is explained by using motion history image and histogram of oriented gradient with spotter model based on depth information, and the spotter model which performs action spotting is proposed to improve recognition performance in the recognition system. The steps of this system are composed of pre-processing, human action and spotter modeling and continuous human action recognition. In pre-processing process, Depth-MHI-HOG is used to extract space-time template-based features after image segmentation, and human action and spotter modeling generates sequence by using the extracted feature. Human action models which are appropriate for each of defined action and a proposed spotter model are created by using these generated sequences and the hidden markov model. Continuous human action recognition performs action spotting to segment meaningful action and meaningless action by the spotter model in continuous action sequence, and continuously recognizes human action comparing probability values of model for meaningful action sequence. Experimental results demonstrate that the proposed model efficiently improves recognition performance in continuous action recognition system.

Performance Improvement of Stereo Matching by Image Segmentation based on Color and Multi-threshold (컬러와 다중 임계값 기반 영상 분할 기법을 통한 스테레오 매칭의 성능 향상)

  • Kim, Eun Kyeong;Cho, Hyunhak;Jang, Eunseok;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.26 no.1
    • /
    • pp.44-49
    • /
    • 2016
  • This paper proposed the method to improve performance of a pixel, which has low accuracy, by applying image segmentation methods based on color and multi-threshold of brightness. Stereo matching is the process to find the corresponding point on the right image with the point on the left image. For this process, distance(depth) information in stereo images is calculated. However, in the case of a region which has textureless, stereo matching has low accuracy and bad pixels occur on the disparity map. In the proposed method, the relationship between adjacent pixels is considered for compensating bad pixels. Generally, the object has similar color and brightness. Therefore, by considering the relationship between regions based on segmented regions by means of color and multi-threshold of brightness respectively, the region which is considered as parts of same object is re-segmented. According to relationship information of segmented sets of pixels, bad pixels in the disparity map are compensated efficiently. By applying the proposed method, the results show a decrease of nearly 28% in the number of bad pixels of the image applied the method which is established.

Segmentation of Target Objects Based on Feature Clustering in Stereoscopic Images (입체영상에서 특징의 군집화를 통한 대상객체 분할)

  • Jang, Seok-Woo;Choi, Hyun-Jun;Huh, Moon-Haeng
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.10
    • /
    • pp.4807-4813
    • /
    • 2012
  • Since the existing methods of segmenting target objects from various images mainly use 2-dimensional features, they have several constraints due to the shortage of 3-dimensional information. In this paper, we therefore propose a new method of accurately segmenting target objects from three dimensional stereoscopic images using 2D and 3D feature clustering. The suggested method first estimates depth features from stereo images by using a stereo matching technique, which represent the distance between a camera and an object from left and right images. It then eliminates background areas and detects foreground areas, namely, target objects by effectively clustering depth and color features. To verify the performance of the proposed method, we have applied our approach to various stereoscopic images and found that it can accurately detect target objects compared to other existing 2-dimensional methods.