• Journal of Broadcast Engineering
• /
• v.27 no.1
• /
• pp.20-30
• /
• 2022

Recently, as VR (Virtual Reality) technology has been in the spotlight, 360° panoramic images that can view lively VR contents are attracting a lot of attention. Image stitching technology is a major technology for producing 360° panorama images, and many studies are being actively conducted. Typical stitching algorithms are based on feature point-based image stitching. However, conventional feature point-based image stitching methods have a problem that stitching results are intensely affected by feature points. To solve this problem, deep learning-based image stitching technologies have recently been studied, but there are still many problems when there are few overlapping areas between images or large parallax. In addition, there is a limit to complete supervised learning because labeled ground-truth panorama images cannot be obtained in a real environment. Therefore, we produced three fisheye images with different camera centers and corresponding ground truth image through carla simulator that is widely used in the autonomous driving field. We propose image stitching model that creates a 360° panorama image with the produced fisheye image. The final experimental results are virtual datasets configured similar to the actual environment, verifying stitching results that are strong against various environments and large parallax.

• Journal of Korea Multimedia Society
• /
• v.24 no.4
• /
• pp.538-549
• /
• 2021

In this paper, we introduce a technique for 360-degree panoramic video streaming with multiple virtual cameras in real-time. The proposed technique consists of generating 360-degree panoramic video data by ORB feature point detection, texture transformation, panoramic video data compression, and RTSP-based video streaming transmission. Especially, the generating process of 360-degree panoramic video data and texture transformation are accelerated by CUDA for complex processing such as camera calibration, stitching, blending, encoding. Our experiment evaluated the frames per second (fps) of the transmitted 360-degree panoramic video. Experimental results verified that our technique takes at least 30fps at 4K output resolution, which indicates that it can both generates and transmits 360-degree panoramic video data in real time.

• Journal of Korea Society of Industrial Information Systems
• /
• v.22 no.3
• /
• pp.27-38
• /
• 2017

This Paper Presents a Method for Stitching a Large Number of Images Recorded by a Large Number of Individual Users Through a Cellular Phone Camera at a Venue. In Contrast to 360 Camera Solutions that Use Existing Fixed Rigs, these Conditions must Address New Challenges Such as Time Synchronization, Repeated Transformation Matrix Calculations, and Camera Sensor Mismatch Correction. In this Paper, we Solve this Problem by Updating the Transformation Matrix Using Time Synchronization Method Using Audio, Sensor Mismatch Removal by Color Transfer Method, and Global Operation Stabilization Algorithm. Experimental Results Show that the Proposed Algorithm Shows better Performance in Terms of Computation Speed and Subjective Image Quality than that of Screen Stitching.

• 한국HCI학회:학술대회논문집
• /
• 2006.02b
• /
• pp.518-523
• /
• 2006

As digital broadcasting process and information compressing technologies developed, digital technologies have been used extensively in many visual media such as movies and TV programs, and it is required to develop a new process for 3 dimensional digital programs. The study attempts to develop a new digital video-producing process through pre-simulation using a digital storytelling method, in order to increase the quality of broadcasting, reducing the producing time and improve efficiency. This system, supposed to be used to produce actual broadcasting, includes all tools needed for broadcasting in the program, so users can select an appropriate set among the pre-made library, which saves time for making sets. Also, it offers a storyboard making function by perfectly representing the functions of a virtual camera, and enables users to make the better storyboard, checking the real time movies. In addition, it recognizes objects though avatars, organizes the appropriate set for these avatars to act, and embodies a variety of avatar movements through which it reaffirms the camera's position and organization, minimizing errors and saving time and budget.

• Journal of Broadcast Engineering
• /
• v.7 no.1
• /
• pp.2-9
• /
• 2002

Recently. VR( Virtual Reality) applications such as virtual studio and virtual character are wifely used In TV programs. and AR( Augmented Reality) applications are also belong taken an interest increasingly. This paper introduces a virtual screen system. which Is a new AR application for broadcasting. The virtual screen system is a real-time video augmentation system by tracking a chroma-patterned moving panel. We haute recently developed a virtual screen system.'K-vision'. Our system enables the user to hold and morse a simple panel on which live video, pictures of 3D graphics images can appear. All the Images seen on the panel change In the correct perspective, according to movements of the camera and the user holding the panel, in real-time. For the purpose of tracking janet. we use some computer vision techniques such as blob analysis and feature tracking. K-vision can work well with any type of camera. requiring no special add-ons. And no need for sensor attachments to the panel. no calibration procedures required. We are using K-vision in some TV programs such as election. documentary and entertainment.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.7 no.7
• /
• pp.1456-1461
• /
• 2003

Recently, the quantity of using information go on increasing geometric-progression. At the same time, the management of information is effected on the most organization's effective operation so that many user call for the powerful equipment which expound. access more information. As information searching technology is concentrated about the object of information based on a letter mainly, an effective searching technology for the object of multimedia such as a still image, a video and a sound must be studied. As a monitor of computer is 2-D, it difficult for one to grasp the whole aspect at a look glance like a library. Accordingly, some condition is necessary. First, it acquired the virtual video, turning a camera around by 30 degrees with a camera of 15mm lens, giving a warping and distortion. Second, it improved the books for user to search easily, adding to the video in existing books information system. The original text suggests some way which can embody the video searching technology under the base of personal computer.

• KIEAE Journal
• /
• v.9 no.2
• /
• pp.81-90
• /
• 2009

Relating to grasping sequential landscape characteristics in consideration of the behavioral characteristics of the subject experiencing visual perception, this study was made on the subject of main walking line section for visitors of three treasures of Buddhist temples. Especially, as a method of obtaining data for grasping sequential visual perception landscape, the researcher employed [momentum sequential viewpoint setup] according to [the interval of pointers arbitrarily] and fisheye-lens-camera photography using the obtained omni-directional angle visual perception information. As a result, in terms of viewpoint selection, factors like approach road form, change in circulation axis, change in the ground surface level, appearance of objects, etc. were verified to make effect, and among these, approach road form and circulation axis change turned out to be the greatest influences. In addition, as a result of reviewing the effectiveness via the subjects, for the sake of qualitative evaluation of landscape components using the VR picture image obtained in the process of acquiring omni-directional angle visual perception information, a positive result over certain values was earned in terms of panoramic vision, scene reproduction, three-dimensional perspective, etc. This convinces us of the possibility to activate the qualitative evaluation of omni-directional angle picture information and the study of landscape through it henceforth.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.33-39
• /
• 2006

Home modification has come to be recognized as an important intervention strategy to manage health care conditions, maintain or improve functioning, ensure safety, and reduce the wheelchair user's dependency on others. However, the availability of skilled professionals with experience in home modifications for accessibility is limited. A system that enables accurate remote assessments would be an important tool to improve our ability to perform home assessments more easily and at decreased cost. A Remote Wheelchair Accessibility Assessment System (RWAAS) using Virtualized Reality(VR) technology was developed that enabled clinicians to assess the wheelchair accessibility of users' built environments from a remote location. Characteristics of the camera and 3D reconstruction program chosen for the system significantly affect its overall reliability. In this study, we performed two reliability analyses on the hardware and software components: 1) Verification that commercial software can construct sufficiently accurate 3D models by analyzing the accuracy of dimensional measurements in a virtualized environment; 2) comparison of dimensional measurements with four camera settings. Based on these two analyses, we were able to specify a consumer level digital camera and the Photomodeler Pro software for this system. And we then tested the feasibility of the selected software and hardware in an actual environment. Lastly, A field evaluation was performed to test whether this new system is comparable to the traditional method of accessibility assessment to evaluate its ability to assess the accessibility of a wheelchair user's typical built environment. The results of field trials showed high congruence between the assessments by two methods. Findings suggested that the RWAAS assessments have the potential to enable specialists to assess potential accessibility problems in built environments regardless of the location of the client, home, or specialist.

• Journal of the Korean Society for Railway
• /
• v.13 no.1
• /
• pp.23-30
• /
• 2010

In the construction phase, the existing schedule management system by 4D CAD has been difficult to check for a status and progress of construction product in real-time because it simulates only VR (virtual reality) object based on a planned schedule. This study suggests a construction schedule management system by telepresence technique that can visualize progress status in real-time by using 4D CAD system based on remote monitoring. The telepresence methodology and system were developed in the study and they were verified for a railway construction project. The developed system can examine the status and progress of construction because it can compare 4D simulation based on planned schedule with real-time site images through web-camera.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.1073-1075
• /
• 2019

최근 VR/AR, 자율주행차 등 다양한 응용분야가 주목 받으며 Time of Flight (ToF) 카메라와 같은 사물과 카메라 간의 거리를 측정할 수 있는 3D 카메라를 활용한 연구가 활발히 진행되고 있다. 정확한 영상 정보를 획득하기 위해, ToF 카메라 센서에 의해 발생할 수 있는 노이즈를 모델링하는 것은 필수적이다. 본 논문에서 우리는 ToF 카메라 센서에 의해 발생하는 노이즈를 모델링하기 위해 Skellam 분포를 도입한다. 연속하는 거리 영상의 픽셀 차에 대한 분포를 분석함으로써 Skellam 분포 적용의 타당성을 제시한다. ToF 카메라의 노이즈 모델링을 통해 ToF 카메라 센서에 발생하는 노이즈를 제거하고 출력 영상의 품질을 향상시킬 것으로 기대한다.