• Journal of Korea Multimedia Society
• /
• v.9 no.9
• /
• pp.1139-1149
• /
• 2006

This paper describes a novel and efficient algorithm, which extracts focused objects from still images with low depth-of-field (DOF). The algorithm unfolds into four modules. In the first module, a HOS map, in which the spatial distribution of the high-frequency components is represented, is obtained from an input low DOF image [1]. The second module finds OOI candidate by using characteristics of the HOS. Since it is possible to contain some holes in the region, the third module detects and fills them. In order to obtain an OOI, the last module gets rid of background pixels in the OOI candidate. The experimental results show that the proposed method is highly useful in various applications, such as image indexing for content-based retrieval from huge amounts of image database, image analysis for digital cameras, and video analysis for virtual reality, immersive video system, photo-realistic video scene generation and video indexing system.

• Journal of KIISE:Software and Applications
• /
• v.33 no.10
• /
• pp.851-861
• /
• 2006

The paper proposes a novel unsupervised video object segmentation algorithm for image sequences with low depth-of-field (DOF), which is a popular photographic technique enabling to represent the intention of photographer by giving a clear focus only on an object-of-interest (OOI). The proposed algorithm largely consists of two modules. The first module automatically extracts OOIs from the first frame by separating sharply focused OOIs from other out-of-focused foreground or background objects. The second module tracks OOIs for the rest of the video sequence, aimed at running the system in real-time, or at least, semi-real-time. The experimental results indicate that the proposed algorithm provides an effective tool, which can be a basis of applications, such as video analysis for virtual reality, immersive video system, photo-realistic video scene generation and video indexing systems.

• Journal of Broadcast Engineering
• /
• v.22 no.6
• /
• pp.808-816
• /
• 2017

360 VR video systems has become important to provide immersive effect for viewers. The system consists of stitching, projection, compression, inverse projection, viewport extraction. In this paper, an efficient luminance compensation technique for 360 VR video sequences, where feature extraction and histogram equalization algorithms are utilized. The proposed luminance compensation algorithm enhance the performance of stitching in 360 VR system. The simulation results showed that the proposed technique is useful to increase the quality of the displayed image.

• Proceedings of the Korean Information Science Society Conference
• /
• 2010.06b
• /
• pp.271-274
• /
• 2010

컴퓨터에서 생성된 시뮬레이션의 결과는 일련의 가시화(VIsualization)라는 과정을 거치면서 컴퓨터 그래픽스 기술이 적용됨으로써 인간이 해석하기 쉬운 형태로 변형되게 된다. 연구자가 직관적으로 이해하기 어려운 수치의 나열로 구성돼 있던 시뮬레이션 데이터가 보다 쉽게 이해하고 분석할 수 있게 되는 것이다. 그런데, 최근에는 고성능 컴퓨터(HPC)의 발달로 인해 시뮬레이션 데이터의 크기가 점점 더 증가하는 추세에 있으며, 데이터의 크기가 기가바이트를 넘어 테라바이트에 이르는 경우도 흔해지고 있다. 기존의 가시화 시스템에서 복잡해진 가시화 데이터를 면밀하게 해석하기에는 많은 제약이 따르며, 그로 인해 고해상도 디스플레이 장치나 몰입형 가상현실 장치의 도입은 필연적일 수밖에 없다. 특히 현 시점에서 클러스터 시스템을 이용한 고해상도의 디스플레이 장치에서 사용자와 상호작용할 수 있는 인터페이스를 제공하는 방법은 가상현실 환경을 적절히 활용하는 것이 거의 유일하다 할 수 있겠다. 본 논문에서는 시뮬레이션 데이터, 특히 로터 동역학 분야의 시뮬레이션 데이터를 가상현실 환경에서 가시화하고 제어하는데 필요한 프레임워크와 인터페이스를 소개할 것이다. 이 프레임워크는 가상현실 환경에서 로터 동역학 분야의 시뮬레이션 데이터와의 실시간 상호작용을 통한 해석을 수행하는데 필요한 기반환경을 제공할 것이다.

• Journal of the Korea Society of Computer and Information
• /
• v.24 no.1
• /
• pp.93-100
• /
• 2019

One of critical issues in dealing with 360-degree realistic contents is the performance degradation in searching and recognition process since they support up to 4K UHD quality and have all image angles including the front, back, left, right, top, and bottom parts of a screen. To solve this problem, in this paper, we propose an efficient search and comparison method for 360-degree realistic contents. The proposed method first corrects the distortion at the less distorted regions such as front, left and right parts of the image excluding severely distorted regions such as upper and lower parts, and then it extracts feature points at the corrected region and selects the representative images through sequence classification. When the query image is inputted, the search results are provided through feature points comparison. The experimental results of the proposed method shows that it can solve the problem of performance deterioration when 360-degree realistic contents are recognized comparing with traditional 2D contents.

• Journal of Korea Multimedia Society
• /
• v.25 no.6
• /
• pp.852-865
• /
• 2022

During the COVID-19 pandemic, games played an important role in people's lives. Numerous online users flocked to the game platform, and brand companies started using online games to promote their products. Medical institutions have also implemented policies for healthy physical activity through online games. In order to attract more global game users, research on immersion in games is also very important to prevent users from leaving the platform. Therefore, it is necessary to analyze the common immersion elements of popular games by country and study them from the perspective of changing devices. In this paper, representative popular games of Korea, China, and Japan, which are recently called the dark horse of the game industry, are classified by devices of mobile, online PCs, and VR games and analyzed using immersion analysis tools proposed by researcher. Next, the representative metaverse games of the Web 3.0 era were analyzed, and their characteristics were compared with the results of the immersion analysis between Korea, China, and Japan, and proposed as game immersion elements suitable for metabus games.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2022.06a
• /
• pp.1241-1244
• /
• 2022

최근 K-Pop 을 위시한 예술공연 콘텐츠에 몰입형 미디어를 접목한 온택트 (Ontact) 미디어 스트리밍 서비스가 주목받고 있는 가운데, 본 논문은 일반적으로 사용되는 2D 디스플레이 또는 HMD (Head-Mounted Display) 기반 VR (Virtual Reality, VR) 서비스에서 탈피하여, 대형 가상현실 공연장을 위한 360 도 VR 비디오 스트리밍 시스템을 제안한다. 제안된 시스템은 Phase 1, 2, 3 의 연구개발 단계를 밟아 6DoF (Degrees of Freedom) 시점 자유도를 지원하는 360 도 VR 비디오 스트리밍 시스템을 개발하는 것을 최종목표로 하고 있으며, 현재는 Phase 1: 대형 가상현실 공연장을 위한 3DoF 360 도 VR 비디오 스트리밍 시스템 프로토타입의 개발까지 완료되었다. 구현된 스트리밍 시스템 프로토타입은 서브픽처 기반 Viewport-dependent 스트리밍 기술이 적용되어 있으며, 기존 방식과 비교하였을 때 약 80%의 비트율 감소, 약 543%의 영상 디코딩 속도 향상을 확인하였다. 또한, 단순 구현 및 성능평가에서 그치지 않고, 실제 미국 UCSB 에 위치한 대형 가상현실 공연장 AlloSphere 에서의 시범방송을 수행하여, 향후 Phase 2, 3 연구단계를 위한 연구적 기반을 마련하였다.

• International journal of advanced smart convergence
• /
• v.12 no.4
• /
• pp.142-146
• /
• 2023

We present a method for generating 3D structures and rendering objects by combining VAE (Variational Autoencoder) and GAN (Generative Adversarial Network). This approach focuses on generating and rendering 3D models with improved quality using residual learning as the learning method for the encoder. We deep stack the encoder layers to accurately reflect the features of the image and apply residual blocks to solve the problems of deep layers to improve the encoder performance. This solves the problems of gradient vanishing and exploding, which are problems when constructing a deep neural network, and creates a 3D model of improved quality. To accurately extract image features, we construct deep layers of the encoder model and apply the residual function to learning to model with more detailed information. The generated model has more detailed voxels for more accurate representation, is rendered by adding materials and lighting, and is finally converted into a mesh model. 3D models have excellent visual quality and accuracy, making them useful in various fields such as virtual reality, game development, and metaverse.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.80-85
• /
• 2024

The concept of single-modal digital art originated in the 20th century and has evolved through three key stages. Over time, digital art has transformed into multi-modal interaction, representing a new era in art forms. Based on multi-modal theory, this paper aims to explore the characteristics of interactive digital art in innovative art forms and its impact on user experience. Through an analysis of practical application of multi-modal interactive digital art, this study summarises the impact of creative models of digital art on the physical and mental aspects of user experience. In creating audio-visual-based art, multi-modal digital art should seamlessly incorporate sensory elements and leverage computer image processing technology. Focusing on user perception, emotional expression, and cultural communication, it strives to establish an immersive environment with user experience at its core. Future research, particularly with emerging technologies like Artificial Intelligence(AR) and Virtual Reality(VR), should not merely prioritize technology but aim for meaningful interaction. Through multi-modal interaction, digital art is poised to continually innovate, offering new possibilities and expanding the realm of interactive digital art.

• Journal of the Korea Society of Computer and Information
• /
• v.16 no.3
• /
• pp.109-119
• /
• 2011

The virtual reality (VR) technology has been used as the application of architectural presentation or simulation tool in the field of industry. The high immersion and intuitive visual information are the great merits of design evaluation or environmental simulation when we are using the virtual environments. But the distortion of distance perception in VR is still a big problem when the accuracy of distance presentation is strictly required. For example, distance estimation is especially important when the virtual environments are applied to the presentational tool for evaluation the space design or planning in the field of architecture. If there are some perception error between the built space in real and represented space in virtual, the accurate design evaluation or modification of design is hard to be carried out during the design development stage. In this paper, we have carried out some experiments about distance estimation in the immersive virtual environments to verify the factors and their influence. We made a hypothesis that the lack of the information for the user in VR causes the different distance estimation from the real world because users are usually comfortable with moving fast and long distance in VR environments compared with moving slow and short distance in real space. So, we carried out basic experiment to prove our hypothesis that the lack of information makes subjects estimate the distance of walking in VR shorter compared with the same distance in real. Also, among the factors that probably affect the distance estimation in VR, we have verified the influence of the image resolution. The influence of resolution degradation of image on the distance estimation was verified with the condition of static and dynamic images. The results showed that the resolution has deep relation with the distance estimation. For example, the subject underestimated the distance at the lower resolution condition. We also found the methods of the making the lower resolution image could affect on the visual perception of subjects.