• Title/Summary/Keyword: Shadow Removal

Search Result 58, Processing Time 0.025 seconds

GAN-based shadow removal using context information

  • Yoon, Hee-jin;Kim, Kang-jik;Chun, Jun-chul
    • Journal of Internet Computing and Services
    • /
    • v.20 no.6
    • /
    • pp.29-36
    • /
    • 2019
  • When dealing with outdoor images in a variety of computer vision applications, the presence of shadow degrades performance. In order to understand the information occluded by shadow, it is essential to remove the shadow. To solve this problem, in many studies, involves a two-step process of shadow detection and removal. However, the field of shadow detection based on CNN has greatly improved, but the field of shadow removal has been difficult because it needs to be restored after removing the shadow. In this paper, it is assumed that shadow is detected, and shadow-less image is generated by using original image and shadow mask. In previous methods, based on CGAN, the image created by the generator was learned from only the aspect of the image patch in the adversarial learning through the discriminator. In the contrast, we propose a novel method using a discriminator that judges both the whole image and the local patch at the same time. We not only use the residual generator to produce high quality images, but we also use joint loss, which combines reconstruction loss and GAN loss for training stability. To evaluate our approach, we used an ISTD datasets consisting of a single image. The images generated by our approach show sharp and restored detailed information compared to previous methods.

Shadow Removal based on the Deep Neural Network Using Self Attention Distillation (자기 주의 증류를 이용한 심층 신경망 기반의 그림자 제거)

  • Kim, Jinhee;Kim, Wonjun
    • Journal of Broadcast Engineering
    • /
    • v.26 no.4
    • /
    • pp.419-428
    • /
    • 2021
  • Shadow removal plays a key role for the pre-processing of image processing techniques such as object tracking and detection. With the advances of image recognition based on deep convolution neural networks, researches for shadow removal have been actively conducted. In this paper, we propose a novel method for shadow removal, which utilizes self attention distillation to extract semantic features. The proposed method gradually refines results of shadow detection, which are extracted from each layer of the proposed network, via top-down distillation. Specifically, the training procedure can be efficiently performed by learning the contextual information for shadow removal without shadow masks. Experimental results on various datasets show the effectiveness of the proposed method for shadow removal under real world environments.

Shadow Removal based on Chromaticity and Brightness Distortion for Effective Moving Object Tracking (효과적인 이동물체 추적을 위한 색도와 밝기 왜곡 기반의 그림자 제거)

  • Kim, Yeon-Hee;Kim, Jae-Ho;Kim, Yoon-Ho
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.8 no.4
    • /
    • pp.249-256
    • /
    • 2015
  • Shadow is a common physical phenomenon in natural images and may cause problems in computer vision tasks. Therefore, shadow removal is an essential preprocessing process for effective moving object tracking in video image. In this paper, we proposed the method of shadow removal algorithm using chromaticity, brightness distortion and direction of shadow candidate. The proposed method consists of two steps. First, removal process of primary shadow candidate region by using chromaticity, brightness and distortion. The second stage applies the final shadow candidate region to obtain a direction feature of shadow which is estimated by the thinning algorithm after calculating the lowest pixel position of the moving object. To verify the proposed approach, some experiments are conducted to draw a compare between conventional method and that of proposed. Experimental results showed that proposed methodology is simple, but robust and well adaptive to be need to remove a shadow removal operation.

A method of generating virtual shadow dataset of buildings for the shadow detection and removal

  • Kim, Kangjik;Chun, Junchul
    • Journal of Internet Computing and Services
    • /
    • v.21 no.5
    • /
    • pp.49-56
    • /
    • 2020
  • Detecting shadows in images and restoring or removing them was a very challenging task in computer vision. Traditional researches used color information, edges, and thresholds to detect shadows, but there were errors such as not considering the penumbra area of shadow or even detecting a black area that is not a shadow. Deep learning has been successful in various fields of computer vision, and research on applying deep learning has started in the field of shadow detection and removal. However, it was very difficult and time-consuming to collect data for network learning, and there were many limited conditions for shooting. In particular, it was more difficult to obtain shadow data from buildings and satellite images, which hindered the progress of the research. In this paper, we propose a method for generating shadow data from buildings and satellites using Unity3D. In the virtual Unity space, 3D objects existing in the real world were placed, and shadows were generated using lights effects to shoot. Through this, it is possible to get all three types of images (shadow-free, shadow image, shadow mask) necessary for shadow detection and removal when training deep learning networks. The method proposed in this paper contributes to helping the progress of the research by providing big data in the field of building or satellite shadow detection and removal research, which is difficult for learning deep learning networks due to the absence of data. And this can be a suboptimal method. We believe that we have contributed in that we can apply virtual data to test deep learning networks before applying real data.

Real-Time Moving Object Detection and Shadow Removal in Video Surveillance System (비디오 감시 시스템에서 실시간 움직이는 물체 검출 및 그림자 제거)

  • Lee, Young-Sook;Chung, Wan-Young
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.574-578
    • /
    • 2009
  • Real-time object detection for distinguishing a moving object of interests from the background image in still image or video image sequence is an essential step to a correct object tracking and recognition. Moving cast shadow can be misclassified as part of objects or moving objects because the shadow region is included in the moving object region after object segmentation. For this reason, an algorithm for shadow removal plays an important role in the results of accurate moving object detection and tracking systems. To handle with the problems, an accurate algorithm based on the features of moving object and shadow in color space is presented in this paper. Experimental results show that the proposed algorithm is effective to detect a moving object and to remove shadow in test video sequences.

  • PDF

An Effective Moving Cast Shadow Removal in Gray Level Video for Intelligent Visual Surveillance (지능 영상 감시를 위한 흑백 영상 데이터에서의 효과적인 이동 투영 음영 제거)

  • Nguyen, Thanh Binh;Chung, Sun-Tae;Cho, Seongwon
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.4
    • /
    • pp.420-432
    • /
    • 2014
  • In detection of moving objects from video sequences, an essential process for intelligent visual surveillance, the cast shadows accompanying moving objects are different from background so that they may be easily extracted as foreground object blobs, which causes errors in localization, segmentation, tracking and classification of objects. Most of the previous research results about moving cast shadow detection and removal usually utilize color information about objects and scenes. In this paper, we proposes a novel cast shadow removal method of moving objects in gray level video data for visual surveillance application. The proposed method utilizes observations about edge patterns in the shadow region in the current frame and the corresponding region in the background scene, and applies Laplacian edge detector to the blob regions in the current frame and the corresponding regions in the background scene. Then, the product of the outcomes of application determines moving object blob pixels from the blob pixels in the foreground mask. The minimal rectangle regions containing all blob pixles classified as moving object pixels are extracted. The proposed method is simple but turns out practically very effective for Adative Gaussian Mixture Model-based object detection of intelligent visual surveillance applications, which is verified through experiments.

Shadow Removal Based on Chromaticity and Entropy for Efficient Moving Object Tracking (효과적인 이동물체 추적을 위한 색도 영상과 엔트로피 기반의 그림자 제거)

  • Park, Ki-Hong
    • Journal of Advanced Navigation Technology
    • /
    • v.18 no.4
    • /
    • pp.387-392
    • /
    • 2014
  • Recently, various research for intelligent video surveillance system have been proposed, but the existing monitoring systems are inefficient because all of situational awareness is judged by the human. In this paper, shadow removal based moving object tracking method is proposed using the chromaticity and entropy image. The background subtraction model, effective in the context awareness environment, has been applied for moving object detection. After detecting the region of moving object, the shadow candidate region has been estimated and removed by RGB based chromaticity and minimum cross entropy images. For the validity of the proposed method, the highway video is used to experiment. Some experiments are conducted so as to verify the proposed method, and as a result, shadow removal and moving object tracking are well performed.

An Efficient Shadow Removal Technique adapted to Environmental Changes (환경변화에 적응하는 효율적인 그림자 제거 기법)

  • Ryu, Nam-Hoon;Ban, Kyeong-Jin;Oh, Kyeong-Sug;Kim, Eung-Kon
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.4 no.3
    • /
    • pp.204-210
    • /
    • 2009
  • There has been a lot of research into a background separation method, which is a preprocess of a technique of automatically perceiving an invader, and the removal of shadows around a moving object in the video monitoring field. When a moving object is not clearly separated from its shadow, it is difficult to analyze the shape accurately, and it is also hard to trace its position. This study suggests how to utilize a brightness value for removing a shadow. It came from the fact that there appears to be no change of color in the shadow area relative to the background area, and there only occurs a difference in brightness. In addition, this method uses the renewal of a critical value used for the removal of shadow in the previous frame, in the next frame.

  • PDF

A New Shadow Removal Method using Color Information and History Data (물체 색정보와 예전 제거기록을 활용하는 새로운 그림자 제거방법)

  • Choi Hye-Seung;Wang Akun;Soh Young-Sung
    • The KIPS Transactions:PartB
    • /
    • v.12B no.4 s.100
    • /
    • pp.395-402
    • /
    • 2005
  • Object extraction is needed to track objects in color traffic image sequence. To extract objects, we use background differencing method based on MOG(Mixture of Gaussians). In extracted objects, shadows may be included. Due to shadows, we may not find exact location of objects and sometimes we find adjacent objects are glued together. Many methods have been proposed to remove shadows. Conventional methods usually assume that color and texture information are preserved under the shadow. Thus these methods do not work well if these assumptions do not hold. In this paper, we propose a new robust shadow removal method which works well in those situations. First we extract shadow pixel candidates by analysing color information and compute the ratio of shadow pixel candidates over the total number of Pixels. W the ratio is reasonable, we remove shadow candidate Pixels and if not, we use data in history array containing Previous removal records. We applied the method to real color traffic image sequences and obtained good results.

Fuzzy Based Shadow Removal and Integrated Boundary Detection for Video Surveillance

  • Niranjil, Kumar A.;Sureshkumar, C.
    • Journal of Electrical Engineering and Technology
    • /
    • v.9 no.6
    • /
    • pp.2126-2133
    • /
    • 2014
  • We present a scalable object tracking framework, which is capable of removing shadows and tracking the people. The framework consists of background subtraction, fuzzy based shadow removal and boundary tracking algorithm. This work proposes a general-purpose method that combines statistical assumptions with the object-level knowledge of moving objects, apparent objects, and shadows acquired in the processing of the previous frames. Pixels belonging to moving objects and shadows are processed differently in order to supply an object-based selective update. Experimental results demonstrate that the proposed method is able to track the object boundaries under significant shadows with noise and background clutter.