• Journal of IKEEE
• /
• v.15 no.1
• /
• pp.10-14
• /
• 2011

In this paper, we present an efficient hardware architecture of unrolling image mapper of catadioptric omnidirectional imaging systems. The catadioptric omnidirectional imaging systems generate images of 360 degrees of view and need to be transformed into panorama images in rectangular coordinate. In most application, it has to perform the panorama unrolling in real-time and at low-cost, especially for high-resolution images. The proposed hardware architecture adopts a software/hardware cooperative structure and employs several optimization schemes using look-up-table(LUT) of coordinate conversion. To avoid the on-line division operation caused by the coordinate transformation algorithm, the proposed architecture has the LUT which has pre-computed division factors. And then, the amount of memory used by the LUT is reduced to 1/4 by using symmetrical characteristic compared with the conventional architecture. Experimental results show that the proposed hardware architecture achieves an effective real-time performance and lower implementation cost, and it can be applied to other kinds of catadioptric omnidirectional imaging systems.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.311-314
• /
• 2020

본 논문에서는 효율적인 웹 파노라마(panorama) 콘텐츠의 효율적인 생성을 위한 에디터를 설계하고 구현한다. 이 에디터는 360° 카메라로 촬영한 파노라마 사진을 활용하여 제작하는 웹 콘텐츠의 주요소인 파노라마 관리, 핫스폿(hotspot) 지정, 추가 및 수정 관리, 파노라마 방향 보정 등의 기능을 구현 할 수 있게 마련하여 누구나 손쉽게 웹 파노라마 콘텐츠를 제작, 관리 할 수 있게 한다. 또한, 파노라마 에디터에 대한 라이브러리와 자료구조를 마련하여 콘텐츠를 개발하고자 하는 초보자나 전문 지식을 가지고 있는 개발자에게도 생산성 향상을 기대할 수 있을 것이다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.11 no.8
• /
• pp.767-772
• /
• 2016

The purpose of this paper is to develop a gimbal system installed in the UFV(unmanned flight vehicles) for 360 degree VR video. In particular, even if the UFV rotated any direction the camera position is fiexd to minimize the shaking using the gyro sensor and the camera system is stable for taking $360^{\circ}$ panorama VR images.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.65-75
• /
• 2017

As a 360-degree image carries information of all directions, it often has too much information. Moreover, in order to investigate a 360-degree image on a 2D display, a user has to either click and drag the image with a mouse, or project it to a 2D panorama image, which inevitably introduces severe distortions. In consequence, investigating a 360-degree image and finding an object of interest in such a 360-degree image could be a tedious task. To resolve this issue, this paper proposes a method to find a region of interest and produces a 2D naturally looking image from a given 360-degree image that best matches a description given by a user in a natural language sentence. Our method also considers photo composition so that the resulting image is aesthetically pleasing. Our method first converts a 360-degree image to a 2D cubemap. As objects in a 360-degree image may appear distorted or split into multiple pieces in a typical cubemap, leading to failure of detection of such objects, we introduce a modified cubemap. Then our method applies a Long Short Term Memory (LSTM) network based object detection method to find a region of interest with a given natural language sentence. Finally, our method produces an image that contains the detected region, and also has aesthetically pleasing composition.

• Journal of the Korea Computer Graphics Society
• /
• v.26 no.3
• /
• pp.133-142
• /
• 2020

In this research, we describe the method of implementing a 360-degree panorama using one projector, in terms of hardware and in the production of projected pre-distortion images. We propose a method of installing a projector and a reflector on the central ceiling of the space to minimize the shadows generated based on the position of the spectators. We used a virtual camera and virtual space where the projector and hemisphere positions were set to the same as in the exhibition space in Unity. After the image projected on the screen was mapped on the wall of the virtual space, the pre-distortion image was created by the method of capturing from the virtual camera using the ray tracing technique. When the produced pre-distortion image is hemispherical reflected and projected by the projector installed at the same position as the virtual camera, the image is reflected and projected 360 degrees on the panoramic screen.

• Journal of Korea Multimedia Society
• /
• v.5 no.6
• /
• pp.655-664
• /
• 2002

In this paper, we implemented a web-based 3D virtual pottery gallery Using VR authoring tools. With this system, we expect to cause learning motives and Provide more realistic and interactive learning space. Out system was implemented by making panorama images and 3D object modules using Photo Vista. Object Modeler and Reality Studio. Users can connect to this web site(http://artstory.x-y.net), rotate a pottery panoramically, and zoom it in or out. We designed this virtual gallery can have beneficial influence on students' aesthetic aspects through realistic work appreciations in their art education processes.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.317-318
• /
• 2019

가상/증강현실로 대표되는 공간정보 기반 실감형 콘텐츠에 대한 관심이 증대되면서 객체인식 등의 지능형 공간인지 기술에 대한 연구가 활발히 진행되고 있다. 특히 HMD등의 영상 시각화 장치의 발달 및 5G 통신기술의 출현으로 인해 실시간 대용량 영상정보의 송, 수신 및 가시화 처리 기술의 기반이 구축됨에 따라, $360^{\circ}$ 스트리밍 영상정보 처리와 같은 고자유도 콘텐츠를 위한 관련 연구의 필요성이 증대되고 있다. 하지만 지능형 영상정보 처리의 대표적 연구인 딥 러닝(Deep Learning) 기반 객체 인식 기술의 경우 대부분 일반적인 평면 영상(Planar Image)에 대한 처리를 다루고 있고, 파노라마 영상(Panorama Image) 특히, $360^{\circ}$ 스트리밍 영상 처리를 위한 연구는 미비한 상황이다. 본 논문에서는 딥 러닝을 이용하여 $360^{\circ}$ 스트리밍 영상에서의 객체인식 연구 방법에 대해 서술한다. 이를 위해 $360^{\circ}$ 카메라 영상에서 딥 러닝을 위한 학습 데이터를 획득하고, 실시간 객체 인식이 가능한 YOLO(You Only Look Once)기법을 이용하여 학습을 한다. 실험 결과에서는 학습 데이터를 이용하여 $360^{\circ}$영상에서 객체 인식 결과와, 학습 횟수에 따른 객체 인식에 대한 결과를 보여준다.

• Journal of Digital Convergence
• /
• v.15 no.11
• /
• pp.463-470
• /
• 2017

Currently, virtual reality contents using VR images are spotlighted since they can be easily created and utilized. But because VR images are in a state of lack of interaction, there are limitations in their applications and usability.In order to overcome this problem, we propose a new method in which 360 degree panorama image and game engine are utilized to develop a high resolution of interactive VR service in real time. In particular, since the background image, which is represented by a form of panorama image, is pre-generated through a heavy rendering computation, it can be used to provide a immersive VR service with a relatively small amount of computation in run time on a low performance device. In order to show the effectiveness of our proposed method, an interactive game of a virtual zoo environment was implemented and illustrated showing that it can improve user interaction and immersion experience in a pretty good way.

• Proceedings of the Korea Contents Association Conference
• /
• 2018.05a
• /
• pp.39-40
• /
• 2018

현재의 게임 영상 작품 중에서 파괴 특수효과는 그 강렬한 충격과 놀라움으로 광범위하게 사용된다. 360도 파노라마 영상이 가져다 주는 몰입감과 공간 감각은 파괴 특수효과의 시각 충격력을 더 강화시킨다. 본 논문의 핵심은 Houdini의 RBDSolver를 통해서 연서 소재를 모의하여 사실적인 파괴 특수효과를 제작에 있으며 또한 실질적인 제작의 방식으로 작업 흐름을 표현하고 분석하는데 있다. 따라서 Houdini이 제작한 파괴 특수효과와 360도 파노라마 영상을 결합하고 거기에다 Youtube를 사용하여 표현하는 것이 이번 연구의 새로운 포인트가 된다.

• Journal of Korea Multimedia Society
• /
• v.19 no.8
• /
• pp.1329-1336
• /
• 2016

This paper develops a 360 degree video system using multiple off-the-shelf webcams and a set of embedded boards. Existing 360 degree cameras have shortcomings that they do not support real-time video generation since recorded videos should be copied to computers or smartphones which then provide stitching. Another shortcoming is that wide FoV(Field of View) cameras are not able to provide sufficiently high resolution. Moreover, resulting images are visually distorted bending straight lines. By employing an array of 65 degree FoV webcams, we were able to generate videos on the spot and achieve over 6K resolution with much less distortion. We describe the configuration and algorithms of the proposed system. The performance evaluation results of our early stage prototype system are presented.