• Title/Summary/Keyword: visual frame

Search Result 420, Processing Time 0.03 seconds

Fast Ray Reordering and Approximate Sibson Interpolation for Foveated Rendering on GPU

  • Kwon, Oh-Seok;park, Keon-kuk;Yoon, Joseph;Kim, Young-Bong
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.2
    • /
    • pp.311-321
    • /
    • 2019
  • Virtual reality applications in Head-Mounted Displays require high frame rates and low latency rendering techniques. Ray tracing offers many benefits, such as high-quality image generation, but has not been utilized due to lower performance than rasterization. But that can obtain good result combined with gaze-tracking technology and human visual system's operation principle. In this paper, we propose a method to optimize the foveated sampling map and to maintain the visual quality through the fast voronoi nearest interpolation. The proposed method further reduces the computational cost that has been improved by the previous foveated sampling. It also smoothes the voronoi boundary using adaptive sibson interpolation, which was not possible in real-time. As a result, the proposed method can render real-time high-quality images with low visual difference.

An Improved Cast Shadow Removal in Object Detection (객체검출에서의 개선된 투영 그림자 제거)

  • Nguyen, Thanh Binh;Chung, Sun-Tae;Kim, Yu-Sung;Kim, Jae-Min
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.889-894
    • /
    • 2009
  • Accompanied by the rapid development of Computer Vision, Visual surveillance has achieved great evolution with more and more complicated processing. However there are still many problems to be resolved for robust and reliable visual surveillance, and the cast shadow occurring in motion detection process is one of them. Shadow pixels are often misclassified as object pixels so that they cause errors in localization, segmentation, tracking and classification of objects. This paper proposes a novel cast shadow removal method. As opposed to previous conventional methods, which considers pixel properties like intensity properties, color distortion, HSV color system, and etc., the proposed method utilizes observations about edge patterns in the shadow region in the current frame and the corresponding region in the background scene, and applies Laplacian edge detector to the blob regions in the current frame and the background scene. Then, the product of the outcomes of application determines whether the blob pixels in the foreground mask comes from object blob regions or shadow regions. The proposed method is simple but turns out practically very effective for Gaussian Mixture Model, which is verified through experiments.

  • PDF

A Theory of Intermediality and its Application in Peter Greenaway's (상호매체성의 이론과 그 적용 - 피터 그리너웨이의 <프로스페로의 서재>를 중심으로)

  • PARK, Ki-Hyun
    • Cross-Cultural Studies
    • /
    • v.19
    • /
    • pp.39-77
    • /
    • 2010
  • The cinema of Peter Greenaway has consistently engaged questions of the relationship between the arts and particularly the relations of image and writing to cinema. When different types of images are correlated and merged with each other on the borders of painting, photography, film, video and computer animation, the interrelationships of the distinct elements cause a shift in the notion of the whole image. This analysis proposes to articulate the complex relationship between the 'interartial' dimension and the 'intermedial' dimension in Peter Greenaway's film, (1991). If the interartiality is interested in the interaction between various arts, including the transition from one to another, the intermediality articulates the same type of relationship between two or more media. The interactional relationship is the same on both sides; on the contrary, the relationship between art and media does not show the same symmetry. All art is based on one or more media - the media is a condition existence of art - but no art can't be reduced to the status of media. This suggests that if the interartiality always involves the intermediality, this proposal may not be reversed. First, we analyse a self-conscious investigation into digital art and technology. Prosospero's Books can be read as a daring visual essay that self-consciously investigates the technical and philosophical functions of letters, books, images, animated paintings, digital arts, and the other magical illusions, which have been modern or will be post-modern media to represent the world. Greenaway uses both conventional film techniques and the resources of high-definition television to layer image upon image, superimposing a second or third frame within his frame. Greenaway uses the frame-within-frame as the cinematic equivalent of Shakespeare's paly-within-play : it offer him the possibility to analyse the work of art/artist/spectator relationship. Secondly, we analyse the relationship between the written word, oral word and the books. Like the written word, the oral word changes into a visual image: The linguistic richness and nuances of Shakeaspeare's characters turn into the powerful and authoritative, but monotone, voices of Gielgud-Prospero, who speaks the Shakespearean lines aloud, shaping the characters so powerfully through his worlds that they are conjured before us. Specially each book is placed over the frame of the play's action, only partially covering the image, so that it gives virtually every frame at least two space-time orientations. Thirdly, we try to show how Peter Greenaway uses pictorial references in order to illustrate the context of the Renaissance as well as pictorial techniques and language in order to question the nature of artistic representation. For exemple, The storm is visualised through reference to Botticelli's : the storm of papers swirling around the library is constructed to look like a facsimili copy of Michelangelo's Laurentiana Library in Florence. Greenaway's modern mannerism consists in imposing his own aesthetic vision and his questioning of art beyond the play's meta-theatricality: in other words, Shakespeare''s text has been adapted without being betrayed.

Robust Object Tracking based on Kernelized Correlation Filter with multiple scale scheme (다중 스케일 커널화 상관 필터를 이용한 견실한 객체 추적)

  • Yoon, Jun Han;Kim, Jin Heon
    • Journal of IKEEE
    • /
    • v.22 no.3
    • /
    • pp.810-815
    • /
    • 2018
  • The kernelized correlation filter algorithm yielded meaningful results in accuracy for object tracking. However, because of the use of a fixed size template, we could not cope with the scale change of the tracking object. In this paper, we propose a method to track objects by finding the best scale for each frame using correlation filtering response values in multi-scale using nearest neighbor interpolation and Gaussian normalization. The scale values of the next frame are updated using the optimal scale value of the previous frame and the optimal scale value of the next frame is found again. For the accuracy comparison, the validity of the proposed method is verified by using the VOT2014 data used in the existing kernelized correlation filter algorithm.

Low-light Image Enhancement Based on Frame Difference and Tone Mapping (프레임 차와 톤 매핑을 이용한 저조도 영상 향상)

  • Jeong, Yunju;Lee, Yeonghak;Shim, Jaechang;Jung, Soon Ki
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.9
    • /
    • pp.1044-1051
    • /
    • 2018
  • In this paper, we propose a new method to improve low light image. In order to improve the image quality of a night image with a moving object as much as the quality of a daytime image, the following tasks were performed. Firstly, we reduce the noisy of the input night image and improve the night image by the tone mapping method. Secondly, we segment the input night image into a foreground with motion and a background without motion. The motion is detected using both the difference between the current frame and the previous frame and the difference between the current frame and the night background image. The background region of the night image takes pixels from corresponding positions in the daytime image. The foreground regions of the night image take the pixels from the corresponding positions of the image which is improved by the tone mapping method. Experimental results show that the proposed method can improve the visual quality more clearly than the existing methods.

High-frame-rate Video Denoising for Ultra-low Illumination

  • Tan, Xin;Liu, Yu;Zhang, Zheng;Zhang, Maojun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.11
    • /
    • pp.4170-4188
    • /
    • 2014
  • In this study, we present a denoising algorithm for high-frame-rate videos in an ultra-low illumination environment on the basis of Kalman filtering model and a new motion segmentation scheme. The Kalman filter removes temporal noise from signals by propagating error covariance statistics. Regarded as the process noise for imaging, motion is important in Kalman filtering. We propose a new motion estimation scheme that is suitable for serious noise. This scheme employs the small motion vector characteristic of high-frame-rate videos. Small changing patches are intentionally neglected because distinguishing details from large-scale noise is difficult and unimportant. Finally, a spatial bilateral filter is used to improve denoising capability in the motion area. Experiments are performed on videos with both synthetic and real noises. Results show that the proposed algorithm outperforms other state-of-the-art methods in both peak signal-to-noise ratio objective evaluation and visual quality.

Adaptive Frame Rate Up-Conversion Algorithm using the Neighbouring Pixel Information and Bilateral Motion Estimation (이웃하는 블록 정보와 양방향 움직임 예측을 이용한 적응적 프레임 보간 기법)

  • Oh, Hyeong-Chul;Lee, Joo-Hyun;Min, Chang-Ki;Jeong, Je-Chang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.9C
    • /
    • pp.761-770
    • /
    • 2010
  • In this paper, we propose a new Frame Rate Up-Conversion (FRUC) scheme to increase the frame rate from a lower number into a higher one and enhance the decoded video quality at the decoder. The proposed algorithm utilizes the preliminary frames of forward and backward direction using bilateral prediction. In the process of the preliminary frames, an additional interpolation is performed for the occlusion area because if the calculated value of the block with reference frame if larger than the predetermine thresholdn the block is selected as the occlusion area. In order to interpolate the occlusion area, we perform re-search to obtain the osiomal block considerhe osiomnumber of available ne block consblock. The experimental results show that performance of the proposed algorithm has better PSNR and visual quality than the conventional methods.

Terminal Guidance Control for Underwater-Docking of an AUV Using Visual Guidance Device (광학식 유도장치를 이용한 자율 무인잠수정의 수중 도킹 종단 유도 제어)

  • Choi, Dong-Hyun;Jun, Bong-Huan;Park, Jin-Yeong;Lee, Pan-Mook;Kim, Sang-Hyun;Oh, Jun-Ho
    • Proceedings of the Korea Committee for Ocean Resources and Engineering Conference
    • /
    • 2006.11a
    • /
    • pp.335-338
    • /
    • 2006
  • The more deeply the researches make progress in ocean researches including the seabed resource investigation or the oceanic ecosystem investigation, the more important the role of UUV gets. In case of study on the deep sea, there are difficulties in telecommunications between AUV and ships, and in data communication and recharging. Therefore, docking is required. In AUV docking system, the AUV should identify the position of docking and make contact with a certain point of docking device. MOERI (Maritime & Ocean Engineering Research Institute), KORDI has conducted the docking testing on AUV ISIMI in KORDI Ocean Engineering Water Tank. As AUV ISIMI approachs the docking device, it is presented that attitude is unstable, because the lights Which is on Image Frame are disappeared. So we fix the rudder and stem, if the lights on Image Frame are reaching the specific area in the Image Frame. In this paper, we intend to solve the problems that were found in the testing, which, first, will be identified via simulation.

  • PDF

Scene Change Detection and Key Frame Selection Using Fast Feature Extraction in the MPEG-Compressed Domain (MPEG 압축 영상에서의 고속 특징 요소 추출을 이용한 장면 전환 검출과 키 프레임 선택)

  • 송병철;김명준;나종범
    • Journal of Broadcast Engineering
    • /
    • v.4 no.2
    • /
    • pp.155-163
    • /
    • 1999
  • In this paper, we propose novel scene change detection and key frame selection techniques, which use two feature images, i.e., DC and edge images, extracted directly from MPEG compressed video. For fast edge image extraction. we suggest to utilize 5 lower AC coefficients of each DCT. Based on this scheme, we present another edge image extraction technique using AC prediction. Although the former is superior to the latter in terms of visual quality, both methods all can extract important edge features well. Simulation results indicate that scene changes such as cut. fades, and dissolves can be correctly detected by using the edge energy diagram obtained from edge images and histograms from DC images. In addition. we find that our edge images are comparable to those obtained in the spatial domain while keeping much lower computational cost. And based on HVS, a key frame of each scene can also be selected. In comparison with an existing method using optical flow. our scheme can select semantic key frames because we only use the above edge and DC images.

  • PDF

A Study on Observation Characteristics by Sex shown in the process of Visual Appreciation of Space (공간의 시각적 이해과정에 나타난 성별 주시특성에 관한 연구)

  • Kim, Jong-Ha
    • Korean Institute of Interior Design Journal
    • /
    • v.22 no.5
    • /
    • pp.152-161
    • /
    • 2013
  • This study is about the visual appreciation by sex with the analysis of time range of observing data which was got through observation experiment with the space of lobby in hospitals. The observation data of the subjects who observed the space include the frequency and time, through which the process of visual appreciation could be evaluated with the definition of the frequency and the time of observation. First, the fact that men had higher frequency of observation than women means the former had more movement than the latter, and another fact of their fewer times can be understood as the time of their staying was shorter. That is, even though the men had more movements of sight, they showed the feature of staying shorter. Second, the rate high and low of observation frequency and times made it possible for observation characteristics to be defined as 'intensive search' 'active search' 'fixed concentration' and 'search wandering.' The definition of understanding this process of visual appreciation can be available for a frame of effective analysis of observation characteristics according to the passage of time. Third, the intense search is the case of 'high frequency' having the feature of high visual appreciation owing to the active visual actions for acquiring information. Men were found to have more intense search which decreased gradually as time passed, while women showed the feature of many times of intense search. Fourth, it was found that with many observation data in a certain range of time the subjects had fixed concentration, where women were found to have repetitive fixed concentration along with the change of observation time while men were seen to have more observation tendency for fixed concentration. Fifth, at the cross tabulation of frequency and times, men had the feature of dispersed visual appreciation while women had more distinction between fixation and movement, which revealed that there is surely the difference between men and women in the process of visual appreciation.