• The KIPS Transactions:PartB
• /
• v.14B no.5
• /
• pp.351-360
• /
• 2007

Video Completion refers to a computer vision technique which restores damaged images by filling missing pixels with suitable color in a video sequence. We propose a new video completion technique to fill in image holes which are caused by removing an unnecessary object in a video sequence, where two objects cross each other in the presence of camera motion. We remove the closer object from a camera which results in image holes. Then these holes are filled by color information of some others frames. First of all, spatio-temporal volumes of occluding and occluded objects are created according to the centroid of the objects. Secondly, a temporal search technique by voxel matching separates and removes the occluding object. Finally. these holes are filled by using spatial search technique. Seams on the boundary of completed pixels we removed by a simple blending technique. Experimental results using real video sequences show that the proposed technique produces new completed videos.

• Journal of the Korea Computer Graphics Society
• /
• v.25 no.5
• /
• pp.1-9
• /
• 2019

In this paper, we propose a video enhancement method using generative adversarial networks to remove raindrops and restore the background information on the removed region in the coastal wave video imagery distorted by raindrops during rainfall. Two experimental models are implemented: Pix2Pix network widely used for image-to-image translation and Attentive GAN, which is currently performing well for raindrop removal on a single images. The models are trained with a public dataset of paired natural images with and without raindrops and the trained models are evaluated their performance of raindrop removal and background information recovery of rainwater distortion of coastal wave video imagery. In order to improve the performance, we have acquired paired video dataset with and without raindrops at the real coast and conducted transfer learning to the pre-trained models with those new dataset. The performance of fine-tuned models is improved by comparing the results from pre-trained models. The performance is evaluated using the peak signal-to-noise ratio and structural similarity index and the fine-tuned Pix2Pix network by transfer learning shows the best performance to reconstruct distorted coastal wave video imagery by raindrops.

• Review of KIISC
• /
• v.33 no.6
• /
• pp.55-63
• /
• 2023

현대 해양선박은 PLC 등 기존의 OT 시스템과 선박자동식별시스템 등 IT 시스템의 접목으로 스마트선박, 자율운항선박으로 진화되고 있다. 하지만 이러한 기술 통합은 공격이 가능한 접점이 늘어나며, 이는 사이버보안 위협을 증가시키고 있다. 선박은 대부분 항만으로부터 고립된 환경에서 운영되기 때문에 사이버공격이 발생 시 외부의 기술 지원이나 긴급대응이 어려워진다. 이러한 배경으로 해양선박을 대상으로 하는 사이버 복원력은 해양선박 환경에서 중요한 개념으로 자리잡고 있다. 본 논문은 해양선박 환경 표준 통신 네트워크인 SAN을 분석하고, 사이버 복원력을 소개한 후, NIST의 사이버 복원력 모델을 기반으로 해양선박 대상 사이버 복원력 연구를 분석한다.

• Journal of Internet Computing and Services
• /
• v.18 no.6
• /
• pp.25-34
• /
• 2017

Autoencoder is a type of deep learning method where input layer and output layer are the same, and effectively extracts and restores characteristics of input vector using constraints of hidden layer. In this paper, we propose methods of Autoencoders to remove a natural background image which is a noise to the CAPTCHA and recover only a numerical images by applying various autoencoder models to a region where one number of CAPTCHA images and a natural background are mixed. The suitability of the reconstructed image is verified by using the softmax function with the output of the autoencoder as an input. And also, we compared the proposed methods with the other method and showed that our methods are superior than others.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2010.04a
• /
• pp.550-553
• /
• 2010

최근 영화, 광고 그리고 증강현실과 혼합현실 등 다양한 분야에서 실제 영상에 가상의 객체를 합성하는 기법이 자주 사용되고 있다. 보다 사실적인 합성 결과를 생성하기 위해서는 실제 배경영상의 광원정보를 그대로 적용해야 한다. 이러한 실 세계의 광원 정보를 이용하기 위해서는 HDR(High Dynamic Range) 영상을 생성해야 한다. 일반적으로 HDR 영상을 생성하기 위해서는 고가의 HDR 카메라를 사용하거나 LDR(Low Dynamic Range) 카메라를 사용하여 노출 시간을 달리한 일련의 LDR 영상을 촬영하여 이를 기반으로 HDR 영상을 생성해야 한다. 본 논문에서는 이러한 단점을 보완하기 위해 한 장의 LDR 환경 맵을 HDR 환경 맵으로 복원하는 방법에 대해 제안한다. 제안하는 방법을 통해 LDR 환경 맵을 HDR 환경 맵으로 복원할 수 있으며 결과에서 볼 수 있듯이 HDR 영상을 이용했을 때와 유사한 렌더링 결과를 생성할 수 있다.

• Journal of KIISE:Software and Applications
• /
• v.29 no.11
• /
• pp.767-774
• /
• 2002

Conventional research on image restoration has focused on restoring degraded images resulting from image formation, storage and communication, mainly in the signal processing field. Related research on recovering original image information of caption regions includes a method using BMA(block matching algorithm). The method has problem with frequent incorrect matching and propagating the errors by incorrect matching. Moreover, it is impossible to recover the frames between two scene changes when scene changes occur more than twice. In this paper, we propose a method for recovering original images using EBMA(Extended Block Matching Algorithm) and a region compensation method. To use it in original image recovery, the method extracts a priori knowledge such as information about scene changes, camera motion and caption regions. The method decides the direction of recovery using the extracted caption information(the start and end frames of a caption) and scene change information. According to the direction of recovery, the recovery is performed in units of character components using EBMA and the region compensation method. Experimental results show that EBMA results in good recovery regardless of the speed of moving object and complexity of background in video. The region compensation method recovered original images successfully, when there is no information about the original image to refer to.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.649-652
• /
• 2007

이 논문에서는 영화, CF 같은 영상물 제작 시 CG/실사 합성을 위해 배경기하정보를 추출하는 알고리즘을 제안한다. Metric Reconstruction 은 카메라 자동 보정을 통해 이루어지며 이는 오랫동안 연구되어 온 분야이다. 접근방법은 영상의 특징점 추적 정보와 카메라 내부변수 가정으로부터 유도되는 자기 보정 방식과 공간상에서 미리 기하 정보를 알고 있는 보정틀을 사용하는 방식으로 크게 분류될 수 있다. CG/실사 합성의 작업 효율성을 위해서는 배경 영상에 보정틀이 보이지 않는 것이 좋은데 자연 특징점(Natural Feature)에만 의존하는 자기 보정 방식의 경우 2K 급 영상에서 CG 객체를 합성했을 때 떨림이 느껴지지 않을 만큼 정확한 결과를 얻기 힘들다. 이 논문에서는 Polleyfeys[2]가 제안하였던 영상 시퀀스를 입력으로 하는 자기 보정 시스템을 바탕으로 마야 작업 환경에서의 핀홀 카메라 모델에 맞도록 카메라 내부변수의 비선형 최적화를 수행하는 방법과 사용자 개입을 통한 카메라 변수 정확도 향상방법을 제안한다.

• Journal of Broadcast Engineering
• /
• v.5 no.1
• /
• pp.113-122
• /
• 2000

It is sometimes necessary to remove the captions and recover original images from video images already broadcast, When the number of images requiring such recovery is small, manual processing is possible, but as the number grows it would be very difficult to do it manually. Therefore, a method for recovering original image for the caption areas in needed. Traditional research on image restoration has focused on restoring blurred images to sharp images using frequency filtering or video coding for transferring video images. This paper proposes a method for automatically recovering original image using BMA(Block Matching Algorithm). We extract information on caption regions and scene change that is used as a prior-knowledge for recovering original image. From the result of caption information detection, we know the start and end frames of captions in video and the character areas in the caption regions. The direction for the recovery is decided using information on the scene change and caption region(the start and end frame for captions). According to the direction, we recover the original image by performing block matching for character components in extracted caption region. Experimental results show that the case of stationary images with little camera or object motion is well recovered. We see that the case of images with motion in complex background is also recovered.

• The KIPS Transactions:PartB
• /
• v.10B no.2
• /
• pp.135-142
• /
• 2003

Robust extraction of 3D object's features, shape and global motion information from 2D image sequence is described. The object's 21 feature points on the pyramid type synthetic object are extracted automatically using color transform technique. The extracted features are used to recover the 3D shape and global motion of the object using stereo paraperspective camera model and sequential SVD(Singuiar Value Decomposition) factorization method. An inherent error of depth recovery due to the paraperspective camera model was removed by using the stereo image analysis. A 30 synthetic object with 21 features reflecting various position was designed and tested to show the performance of proposed algorithm by comparing the recovered shape and motion data with the measured values.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2002.11b
• /
• pp.323-326
• /
• 2002

압축된 영상에서 관심 영역은 다른 영역보다 중요하다. 여러 응용에서 관심영역은 높은 압축율을 요구할 뿐만 아니라 고화질도 요구되고 있다. JPEG2000에서 제안하고 있는 Maxshift 방법과 Scaling based 방법은 각각 비트율이 증가하는 것과 별도의 복호기를 필요로 하는 등의 문제가 있다. 이러한 점을 개선하기 위해서 JPEG2000 Part 1의 Maxshift 방법에 기반한 관심영역 스케일링 방법을 제안한다. 제안한 방법에 의하여 관심영역이 무손실 복원되기 전에 일정량의 배경정보를 복원할 수 있는 기능이 JPEG2000 복호기에서 수행될 수 있음을 알 수 있었다.