• Title/Summary/Keyword: Occlusion information

Search Result 424, Processing Time 0.022 seconds

Active Fusion Model with Robustness against Partial Occlusions (부분적 폐색에 강건한 활동적 퓨전 모델)

  • Lee Joong-Jae;Lee Geun-Soo;Kim Gye-Young
    • The KIPS Transactions:PartB
    • /
    • v.13B no.1 s.104
    • /
    • pp.35-46
    • /
    • 2006
  • The dynamic change of background and moving objects is an important factor which causes the problem of occlusion in tracking moving objects. The tracking accuracy is also remarkably decreased in the presence of occlusion. We therefore propose an active fusion model which is robust against partial occlusions that are occurred by background and other objects. The active fusion model is consisted of contour-based md region-based snake. The former is a conventional snake model using contour features of a moving object and the latter is a regional snake model which considers region features inside its boundary. First, this model classifies total occlusion into contour and region occlusion. And then it adjusts the confidence of each model based on calculating the location and amount of occlusion, so it can overcome the problem of occlusion. Experimental results show that the proposed method can successfully track a moving object but the previous methods fail to track it under partial occlusion.

Construction of Skin Color Map for Resolving Hand Occlusion in AR Environments (증강현실 환경에서 손 가림 해결을 위한 피부 색상 정보 획득)

  • Park, Sang-Jin;Park, Hyungjun
    • Korean Journal of Computational Design and Engineering
    • /
    • v.19 no.2
    • /
    • pp.111-118
    • /
    • 2014
  • In tangible augmented reality (AR) environments, the user interacts with virtual objects by manipulating their physical counterparts, but he or she often encounters awkward situations in which his or her hands are occluded by the augmented virtual objects, which causes great difficulty in figuring out hand positions, and reduces both immersion and ease of interaction. To solve the problem of such hand occlusion, skin color information has been usefully exploited. In this paper, we propose an approach to simple and effective construction of a skin color map which is suitable for hand segmentation and tangible AR interaction. The basic idea used herein is to obtain hand images used in a target AR environment by simple image subtraction and to represent their color information by a convex polygonal map in the YCbCr color space. We experimentally found that the convex polygonal map is more accurate in representing skin color than a conventional rectangular map. After implementing a solution for resolving hand occlusion using the proposed skin color map construction, we showed its usefulness by applying it to virtual design evaluation of digital handheld products in a tangible AR environment.

Resolving Occlusion Technique of Virtual Target on Real Image using DEM (DEM을 이용한 실영상기반 가상표적의 폐색처리기법)

  • Cha, Jeong-Hee;Jang, Hyo-Jong;Kim, Gye-Young
    • The KIPS Transactions:PartB
    • /
    • v.13B no.7 s.110
    • /
    • pp.663-670
    • /
    • 2006
  • For virtual target to be displaying on real image realistically, it is essential to determine the location of the virtual object together with producing the occlusions area after registering two world. In this paper, we propose the new method to solve occlusions which happens during virtual target moves according to the simulated route on real image. For this purpose, we first construct three dimensional virtual world by DEM of experimental area and register CCD camera image on it by visual clues. Next, we also propose a method to solve the occlusion using snake and picking algorithm which can extract the three dimensional information of the position happening occlusion in the image and can use it when target moves that area. In the experiment, we proved the effectiveness of the proposed method in the environment which a partial occlusions happens.

Partially Occluded Face Recognition in Video using Intensity Distortion (Intensity Distortion을 이용한 Partially Occluded 얼굴인식)

  • Ju, Myung-Ho;Kang, Hang-Bong
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.683-684
    • /
    • 2006
  • 본 논문은 비디오기반의 얼굴인식에 있어서 환경의 변화나 왜곡, 노이즈 등으로 발생할 수 있는 부분적인 가림현상(Partial Occlusion)에 대한 처리기법을 제시한다. 인증되는 각 사람은 하나의 Manifold 를 구성하며 각 Manifold 는 m 개의 pose-Manifold 로 구성된다. Pose-Manifold 를 구성하기 위한 학습데이터는 매우 유사한 포즈들로 구성되기 때문에 얼굴을 이루는 영역의 픽셀에 대한 Intensity 의 변화는 크지 않다. 입력되는 이미지의 Intensity 를 학습데이터의 Intensity 의 변화량을 고려한 Intensity Distortion 을 이용하면 Occlusion 이 발생한 영역을 찾을 수 있고, Occlusion 이 발생한 정도에 따라 가중치를 부여할 수 있다. 이렇게 Occlusion 에 따라 영역에 중요도를 다르게 하여 얼굴인식률을 높이고자 한다. 실험에서는 제시하는 Mask 를 사용하지 않았을 경우와 기존에 제시된 알고리즘과의 성능을 비교한다.

  • PDF

Visual Quality Enhancement of Three-Dimensional Integral Imaging Reconstruction for Partially Occluded Objects Using Exemplar-Based Image Restoration

  • Zhang, Miao;Zhong, Zhaolong;Piao, Yongri
    • Journal of information and communication convergence engineering
    • /
    • v.14 no.1
    • /
    • pp.57-63
    • /
    • 2016
  • In generally, the resolution of reconstructed three-dimensional images can be seriously degraded by undesired occlusions in the integral imaging system, because the undesired information of the occlusion overlap the three-dimensional images to be reconstructed. To solve the problem of the undesired occlusion, we present an exemplar-based image restoration method in integral imaging system. In the proposed method, a minimum spanning tree-based stereo matching method is used to remove the region of undesired occlusions in each elemental image. After that, the removed occlusion region of each elemental images are re-established by using the exemplar-based image restoration method. For further improve the performance of the image restoration, the structure tensor is used to solve the filling error cause by discontinuous structures. Finally, the resolution enhanced three-dimensional images are reconstructed by using the restored elemental images. The preliminary experiments are presented to demonstrate the feasibility of the proposed method.

Computational Integral Imaging Reconstruction of a Partially Occluded Three-Dimensional Object Using an Image Inpainting Technique

  • Lee, Byung-Gook;Ko, Bumseok;Lee, Sukho;Shin, Donghak
    • Journal of the Optical Society of Korea
    • /
    • v.19 no.3
    • /
    • pp.248-254
    • /
    • 2015
  • In this paper we propose an improved version of the computational integral imaging reconstruction (CIIR) for visualizing a partially occluded object by utilizing an image inpainting technique. In the proposed method the elemental images for a partially occluded three-dimensional (3D) object are recorded through the integral imaging pickup process. Next, the depth of occlusion within the elemental images is estimated using two different CIIR methods, and the weight mask pattern for occlusion is generated. After that, we apply our image inpainting technique to the recorded elemental images to fill in the occluding area with reliable data, using information from neighboring pixels. Finally, the inpainted elemental images for the occluded region are reconstructed using the CIIR process. To verify the validity of the proposed system, we carry out preliminary experiments in which faces are the objects. The experimental results reveal that the proposed system can dramatically improve the quality of a reconstructed CIIR image.

Lightweight high-precision pedestrian tracking algorithm in complex occlusion scenarios

  • Qiang Gao;Zhicheng He;Xu Jia;Yinghong Xie;Xiaowei Han
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.3
    • /
    • pp.840-860
    • /
    • 2023
  • Aiming at the serious occlusion and slow tracking speed in pedestrian target tracking and recognition in complex scenes, a target tracking method based on improved YOLO v5 combined with Deep SORT is proposed. By merging the attention mechanism ECA-Net with the Neck part of the YOLO v5 network, using the CIoU loss function and the method of CIoU non-maximum value suppression, connecting the Deep SORT model using Shuffle Net V2 as the appearance feature extraction network to achieve lightweight and fast speed tracking and the purpose of improving tracking under occlusion. A large number of experiments show that the improved YOLO v5 increases the average precision by 1.3% compared with other algorithms. The improved tracking model, MOTA reaches 54.3% on the MOT17 pedestrian tracking data, and the tracking accuracy is 3.7% higher than the related algorithms and The model presented in this paper improves the FPS by nearly 5 on the fps indicator.

Frame Rate Up Conversion for Multi-View Video (다시점 영상의 프레임율 변환 기법)

  • Yang, YoonMo;Lee, Dohoon;Oh, Byung Tae
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2016.06a
    • /
    • pp.228-230
    • /
    • 2016
  • In this paper, we introduce new FRUC method for Multi-View Video based on DIBR (Depth Image based Rendering, DIBR). In the proposed method, we divide each block to sub-regions using depth map. Then, we reconstruct occlusion region information at each sub-regions by using other views. With reconstructed occlusion region information, we estimate and compensate each sub-regions' motion. The proposed method estimates more accurate motion compared to the conventional methods in occlusion region.

  • PDF

Handled in real-time tracking of moving object occlusion (가림현상에 대처한 실시간 이동 물체 추적)

  • Kim, Hag-Hee;Yun, Han-Kyung
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.4 no.3
    • /
    • pp.158-166
    • /
    • 2011
  • Generally, moving object tracking used Lucas-Kanade feature tracking method which is strong in movement, rotation and size. But this method is very weak of occlusion by background or another object and so on. In this case, this method tracks backgrounds or another objects instead a moving object, or a tracking is finished. In order to solve this problem, we proposes Lucas-Kanade feature tracking method which introduce a destimation function and prediction function.

Visual tracking based Discriminative Correlation Filter Using Target Separation and Detection

  • Lee, Jun-Haeng
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.12
    • /
    • pp.55-61
    • /
    • 2017
  • In this paper, we propose a novel tracking method using target separation and detection that are based on discriminative correlation filter (DCF), which is studied a lot recently. 'Retainability' is one of the most important factor of tracking. There are some factors making retainability of tracking worse. Especially, fast movement and occlusion of a target frequently occur in image data, and when it happens, it would make target lost. As a result, the tracking cannot be retained. For maintaining a robust tracking, in this paper, separation of a target is used so that normal tracking is maintained even though some part of a target is occluded. The detection algorithm is executed and find new location of the target when the target gets out of tracking range due to occlusion of whole part of a target or fast movement speed of a target. A variety of experiments with various image data sets are conducted. The algorithm proposed in this paper showed better performance than other conventional algorithms when fast movement and occlusion of a target occur.