• IEIE Transactions on Smart Processing and Computing
• /
• 제1권3호
• /
• pp.125-132
• /
• 2012

This paper proposes an automatic object segmentation and background composition method for video communication over consumer mobile phones. The object regions were extracted based on the motion and color variance of the first two frames. To combine the motion and variance information, the Euclidean distance between the motion boundary pixel and the neighboring color variance edge pixels was calculated, and the nearest edge pixel was labeled to the object boundary. The labeling results were refined using the morphology for a more accurate and natural-looking boundary. The grow-cut segmentation algorithm begins in the expanded label map, where the inner and outer boundary belongs to the foreground and background, respectively. The segmented object region and a new background image stored a priori in the mobile phone was then composed. In the background composition process, the background motion was measured using the optical-flow, and the final result was synthesized by accurately locating the object region according to the motion information. This study can be considered an extended, improved version of the existing background composition algorithm by considering motion information in a video. The proposed segmentation algorithm reduces the computational complexity significantly by choosing the minimum resolution at each segmentation step. The experimental results showed that the proposed algorithm can generate a fast, accurate and natural-looking background composition.

• 한국정보기술학회 영문논문지
• /
• 제9권2호
• /
• pp.29-39
• /
• 2019

Tidal Flats are very important natural resource and various efforts have been made to protect it from environmental pollutions. The projects to monitor the environmental changes by periodically observing the creatures in tidal flats are underway. However, they are being done inefficiently by people directly observing. In this paper, we propose an object segmentation method that can be applied to the applications which automatically monitor the living creatures in tidal flats. In the proposed method, a foreground map representing the location of objects is obtained by using a temporal difference method, and then a superpixel method is applied to detect the detailed boundary of an object. The region of a crab is extracted finally by combining the foreground map and the superpixel information. Experimental results show that the proposed method separates crab regions from a tidal flat image easily and accurately.

• 한국멀티미디어학회논문지
• /
• 제17권4호
• /
• pp.420-432
• /
• 2014

In detection of moving objects from video sequences, an essential process for intelligent visual surveillance, the cast shadows accompanying moving objects are different from background so that they may be easily extracted as foreground object blobs, which causes errors in localization, segmentation, tracking and classification of objects. Most of the previous research results about moving cast shadow detection and removal usually utilize color information about objects and scenes. In this paper, we proposes a novel cast shadow removal method of moving objects in gray level video data for visual surveillance application. The proposed method utilizes observations about edge patterns in the shadow region in the current frame and the corresponding region in the background scene, and applies Laplacian edge detector to the blob regions in the current frame and the corresponding regions in the background scene. Then, the product of the outcomes of application determines moving object blob pixels from the blob pixels in the foreground mask. The minimal rectangle regions containing all blob pixles classified as moving object pixels are extracted. The proposed method is simple but turns out practically very effective for Adative Gaussian Mixture Model-based object detection of intelligent visual surveillance applications, which is verified through experiments.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권11호
• /
• pp.5563-5582
• /
• 2016

Parametric min-cuts is an object proposal algorithm, which can be used for accurate image segmentation. In parametric min-cuts, foreground seeds generation plays an important role since the number and quality of foreground seeds have great effect on its efficiency and accuracy. To improve the performance of parametric min-cuts, this paper proposes a new framework for foreground seeds generation. First, to increase the odds of finding objects, saliency detection at multiple scales is used to generate a large set of diverse candidate seeds. Second, to further select good-quality seeds, a two-stage cascaded ranking classifier is used to filter and rank the candidates based on their appearance features. Experimental results show that parametric min-cuts using our seeding strategy can obtain a relative small pool of proposals with high accuracy.

• 한국멀티미디어학회논문지
• /
• 제25권5호
• /
• pp.685-694
• /
• 2022

The goal of few-shot semantic segmentation is to build a network that quickly adapts to novel classes with extreme data shortage regimes. Most existing few-shot segmentation methods leverage single or multiple prototypes from extracted support features. Although there have been promising results for natural images, these methods are not directly applicable to the aerial image domain. A key factor in few-shot segmentation on aerial images is to effectively exploit information that is robust against extreme changes in background and object scales. In this paper, we propose a Mask-Guided Attention module to extract more comprehensive support features for few-shot segmentation in aerial images. Taking advantage of the support ground-truth masks, the area correlated to the foreground object is highlighted and enables the support encoder to extract comprehensive support features with contextual information. To facilitate reproducible studies of the task of few-shot semantic segmentation in aerial images, we further present the few-shot segmentation benchmark iSAID-, which is constructed from a large-scale iSAID dataset. Extensive experimental results including comparisons with the state-of-the-art methods and ablation studies demonstrate the effectiveness of the proposed method.

• 전자공학회논문지CI
• /
• 제41권4호
• /
• pp.9-21
• /
• 2004

본 논문은 동영상내의 객체를 자동으로 추출하고 추적할 수 있는 유전자 알고리즘 기반의 분할 방법을 제안한다. 제안된 방법은 시간 분할과 공간 분할로 이루어진다. 공간 분할은 각 프레임을 정확한 경계를 가진 영역으로 나누고 시간 분할은 각 프레임을 전경 영역과 배경 영역으로 나눈다. 공간 분할은 분산 유전자 알고리즘을 이용하여 수행된다. 그러나, 일반적인 유전자 알고리즘과는 달리, 염색체는 이전 프레임의 분할 결과로부터 초기화되고, 동적인 객체 부분에 대응하는 불안정 염색체만이 진화연산자에 의해 진화된다. 시간 분할은 두 개의 연속적인 프레임의 밝기 차이에 기반을 둔 적응적 임계치 방법에 의해 수행한다. 얻어진 공간과 시간 분할 결과의 결합을 통해서 객체를 추출하고, 이 객체들은 natural correspondence에 의해 전체 동영상을 통해 정확히 추적된다. 제안된 방법은 다음의 두 가지 장점을 가진다. 1) 제안된 비디오 분할 방법은 사전 정보를 필요로 하지 않는 자동 동영상 분할 방법이다. 2) 제안된 공간 분할방법은 기존의 유전자 알고리즘보다 해공간의 효율적인 탐색을 제공할 수 있을 뿐만 아니라, 정확한 객체 추적 메커니즘을 포함하고 있는 새로운 진화 알고리즘이다. 이러한 장점들은 제안된 방법이 잘 알려진 동영상과 실제 동영상에 성공적으로 적용됨을 통해 검증된다.

• Journal of Electrical Engineering and Technology
• /
• 제10권1호
• /
• pp.372-378
• /
• 2015

Background subtraction is the first processing stage in video surveillance. It is a general term for a process which aims to separate foreground objects from a background. The goal is to construct and maintain a statistical representation of the scene that the camera sees. The output of background subtraction will be an input to a higher-level process. Background subtraction under dynamic environment in the video sequences is one such complex task. It is an important research topic in image analysis and computer vision domains. This work deals background modeling based on modified adaptive Gaussian mixture model (GMM) with three temporal differencing (TTD) method in dynamic environment. The results of background subtraction on several sequences in various testing environments show that the proposed method is efficient and robust for the dynamic environment and achieves good accuracy.

• 디지털산업정보학회논문지
• /
• 제4권1호
• /
• pp.25-31
• /
• 2008

In this paper, we propose a new method that separates background and foreground from stereo images. This method can be improved automatic target tracking system by using disparity map of the stereo vision system and background-separating mask, which can be obtained camera configuration parameters. We use disparity map and camera configuration parameters to separate object from background. Disparity map is made with block matching algorithm from stereo images. A morphology filter is used to compensate disparity error that can be caused by occlusion area. We could obtain a separated object from background when the proposed method was applied to real stereo cameras system.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권4호
• /
• pp.1712-1731
• /
• 2016

In this paper, we propose a novel saliency detection framework via multiple random walks (MRW) which simulate multiple agents on a graph simultaneously. In the MRW system, two agents, which represent the seeds of background and foreground, traverse the graph according to a transition matrix, and interact with each other to achieve a state of equilibrium. The proposed algorithm is divided into three steps. First, an initial segmentation is performed to partition an input image into homogeneous regions (i.e., superpixels) for saliency computation. Based on the regions of image, we construct a graph that the nodes correspond to the superpixels in the image, and the edges between neighboring nodes represent the similarities of the corresponding superpixels. Second, to generate the seeds of background, we first filter out one of the four boundaries that most unlikely belong to the background. The superpixels on each of the three remaining sides of the image will be labeled as the seeds of background. To generate the seeds of foreground, we utilize the center prior that foreground objects tend to appear near the image center. In last step, the seeds of foreground and background are treated as two different agents in multiple random walkers to complete the process of salient object detection. Experimental results on three benchmark databases demonstrate the proposed method performs well when it against the state-of-the-art methods in terms of accuracy and robustness.

• 한국정보전자통신기술학회논문지
• /
• 제5권1호
• /
• pp.1-6
• /
• 2012

본 논문에서는 HMM(Hidden Markov Model)방법에 기초하여 전경과 배경영역 뿐만 아니라 그림자 까지도 분할 할 수 있는 교통모니터링 방법을 제안하였다. 움직이는 물체의 그림자는 시각적 추적을 방해하기 때문에 이러한 문제점을 해결하기 위한 방법으로 각 화소나 영역을 3개의 카테고리 즉, 그림자, 전경, 배경물체로 분할하였다. 교통 모니터링 영상의 경우, 실험결과를 통해 제안된 방법의 효율성을 입증 할 수 있었다.