• Title/Summary/Keyword: multi-view system

Search Result 458, Processing Time 0.028 seconds

Frontal Face Generation Algorithm from Multi-view Images Based on Generative Adversarial Network

  • Heo, Young- Jin;Kim, Byung-Gyu;Roy, Partha Pratim
    • Journal of Multimedia Information System
    • /
    • v.8 no.2
    • /
    • pp.85-92
    • /
    • 2021
  • In a face, there is much information of person's identity. Because of this property, various tasks such as expression recognition, identity recognition and deepfake have been actively conducted. Most of them use the exact frontal view of the given face. However, various directions of the face can be observed rather than the exact frontal image in real situation. The profile (side view) lacks information when comparing with the frontal view image. Therefore, if we can generate the frontal face from other directions, we can obtain more information on the given face. In this paper, we propose a combined style model based the conditional generative adversarial network (cGAN) for generating the frontal face from multi-view images that consist of characteristics that not only includes the style around the face (hair and beard) but also detailed areas (eye, nose, and mouth).

Face Tracking for Multi-view Display System (다시점 영상 시스템을 위한 얼굴 추적)

  • Han, Chung-Shin;Jang, Se-Hoon;Bae, Jin-Woo;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.2C
    • /
    • pp.16-24
    • /
    • 2005
  • In this paper, we proposed a face tracking algorithm for a viewpoint adaptive multi-view synthesis system. The original scene captured by a depth camera contains a texture image and 8 bit gray-scale depth map. From this original image, multi-view images can be synthesized which correspond to viewer's position by using geometrical transformation such as a rotation and a translation. The proposed face tracking technique gives a motion parallax cue by different viewpoints and view angles. In the proposed algorithm, tracking of viewer's dominant face initially established from camera by using statistical characteristics of face colors and deformable templates is done. As a result, we can provide motion parallax cue by detecting viewer's dominant face area and tracking it even under a heterogeneous background and can successfully display the synthesized sequences.

Multi-View Color Video and Depth Map Coding based on HEVC (HEVC 기반 다시점 컬러 영상 및 깊이 정보 맵 부호화 방법)

  • Yoo, Sun-Mi;Nam, Jung-Hak;Lim, Woong;Sim, Dong-Gyu;Cheong, Won-Sik;Hur, Nam-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.49 no.2
    • /
    • pp.83-93
    • /
    • 2012
  • This paper proposes a method to efficiently encode multi-view color videos and depth maps. The proposed coding method for multi-view color videos and depth maps can improve the coding efficiency by additional inter-view prediction, as well as inter-frame prediction. By means of the proposed method, we achieved the coding gain of approximately 55% for 2-view color videos and approximately 12% for 2-view depth maps. For 3-view case, we found that the proposed system yields 54% of coding gain from outer view color videos and 56% of coding gain from center view color videos, respectively. Moreover, for 3-view depth map case, approximately 11% of coding gain from outer view and 13% of coding gain from center view are obtained with the proposed coder, respectively.

Mixed Uses of Materialized View and Signature View-Index Mechanism for Efficient Query Processing on CORBA (CORBA 기반에서 효율적인 질의 처리를 위한 실체뷰와 시그니쳐 뷰인덱스의 혼용)

  • Lee, Seung-Yong;Kim, Myung-Hee;Joo, Su-Chong
    • The KIPS Transactions:PartD
    • /
    • v.11D no.1
    • /
    • pp.61-68
    • /
    • 2004
  • Now, the representative researching trends of view managements for improving the query processing in multi-database system are focused on the materialized view mechanism and the signature view index mechanism. But when we compare with both mechanisms, the former mechanism's access time is faster than one of the latter's, and needs large space. The latter mechanism needs small space and the access time is slower than one of the former. These mechanisms are trade-off each other. Therefore, in case of query process using the view management, we are to improve the system performance and to reduce the access cost of disk input and output by suggesting a new mechanism mixing both the materialized view mechanism and the signature view index mechanism. We suggested that the structure of metadata and the algorithm about the new mired mechanism.

3D Coordinates Acquisition by using Multi-view X-ray Images (다시점 X선 영상을 이용한 3차원 좌표 획득)

  • Yi, Sooyeong;Rhi, Jaeyoung;Kim, Soonchul;Lee, Jeonggyu
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.10
    • /
    • pp.886-890
    • /
    • 2013
  • In this paper, a 3D coordinates acquisition method for a mechanical assembly is developed by using multiview X-ray images. The multi-view X-ray images of an object are obtained by a rotary table. From the rotation transformation, it is possible to obtain the 3D coordinates of corresponding edge points on multi-view X-ray images by triangulation. The edge detection algorithm in this paper is based on the attenuation characteristic of the X-ray. The 3D coordinates of the object points are represented on a graphic display, which is used for the inspection of a mechanical assembly.

A Survey for 3D Object Detection Algorithms from Images

  • Lee, Han-Lim;Kim, Ye-ji;Kim, Byung-Gyu
    • Journal of Multimedia Information System
    • /
    • v.9 no.3
    • /
    • pp.183-190
    • /
    • 2022
  • Image-based 3D object detection is one of the important and difficult problems in autonomous driving and robotics, and aims to find and represent the location, dimension and orientation of the object of interest. It generates three dimensional (3D) bounding boxes with only 2D images obtained from cameras, so there is no need for devices that provide accurate depth information such as LiDAR or Radar. Image-based methods can be divided into three main categories: monocular, stereo, and multi-view 3D object detection. In this paper, we investigate the recent state-of-the-art models of the above three categories. In the multi-view 3D object detection, which appeared together with the release of the new benchmark datasets, NuScenes and Waymo, we discuss the differences from the existing monocular and stereo methods. Also, we analyze their performance and discuss the advantages and disadvantages of them. Finally, we conclude the remaining challenges and a future direction in this field.

Implementing 3DoF+ 360 Video Compression System for Immersive Media (실감형 미디어를 위한 3DoF+ 360 비디오 압축 시스템 구현)

  • Jeong, Jong-Beom;Lee, Soonbin;Jang, Dongmin;Lee, Sangsoon;Ryu, Eun-Seok
    • Journal of Broadcast Engineering
    • /
    • v.24 no.5
    • /
    • pp.743-754
    • /
    • 2019
  • System for three degrees of freedom plus (3DoF+) and 6DoF requires multi-view high resolution 360 video transmission to provide user viewport adaptive 360 video streaming. In this paper, we implement 3DoF+ 360 video compression system which removes the redundancy between multi-view videos and merges the residual into one video to provide high quality 360 video corresponding to an user's head movement efficiently. Implementations about 3D warping based redundancy removal method between 3DoF+ 360 videos and residual extraction and merger are explained in this paper. With the proposed system, 20.14% of BD-rate reduction in maximum is shown compared to traditional high-efficiency video coding (HEVC) based system.

Super multi-view 3-D display system based on focused light Array using reflective vibrating scanner array (ViSA)

  • Ho-In Jeon;Nak-Hee Jung;Jin-San Choi;Young Jung;Young Huh
    • Broadcasting and Media Magazine
    • /
    • v.6 no.2
    • /
    • pp.84-101
    • /
    • 2001
  • In this paper, we present a primitive system design of a super multi-view(SMV) 3-D display system based on a focused light array(FLA) concept using reflective vibrating scanner array(ViSA). The parallel beam scanning using a vibrating scanner array is performed by moving left and right an array of curvature-compensated mirrors or diamond-ruled reflective grating attached to a vibrating membrane. The parallel laser beam scanner array can replace the polygon mirror scanner which has been used in the SMV 3-D display system based on the focused light array(FLA) concept proposed by Kajiki at TAO(Telecommunications) Advancement Organization). The proposed system has great advantages in the sense that it requires neither huge imaging optics nor mechanical scanning pals. Some mathematical analyses and fundamental limitations of the proposed system are presented. The proposed vibrating scanner array, after some modifications and refinements, may replace polygon mirror-based scanners in the near future.

  • PDF

Multi-robot Formation based on Object Tracking Method using Fisheye Images (어안 영상을 이용한 물체 추적 기반의 한 멀티로봇의 대형 제어)

  • Choi, Yun Won;Kim, Jong Uk;Choi, Jeong Won;Lee, Suk Gyu
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.6
    • /
    • pp.547-554
    • /
    • 2013
  • This paper proposes a novel formation algorithm of identical robots based on object tracking method using omni-directional images obtained through fisheye lenses which are mounted on the robots. Conventional formation methods of multi-robots often use stereo vision system or vision system with reflector instead of general purpose camera which has small angle of view to enlarge view angle of camera. In addition, to make up the lack of image information on the environment, robots share the information on their positions through communication. The proposed system estimates the region of robots using SURF in fisheye images that have $360^{\circ}$ of image information without merging images. The whole system controls formation of robots based on moving directions and velocities of robots which can be obtained by applying Lucas-Kanade Optical Flow Estimation for the estimated region of robots. We confirmed the reliability of the proposed formation control strategy for multi-robots through both simulation and experiment.

Organizing Mechanisms and Technological Innovation in Diversified Corporations : A Perspective of Knowledge-based Theory of the Firm (다각화된 기업의 기술혁신과 조직화 방식 : 지식기반이론 관점을 중심으로)

  • Kim, Hicheon;Bae, Jongseok;Huh, Moon Goo
    • Knowledge Management Research
    • /
    • v.10 no.4
    • /
    • pp.93-114
    • /
    • 2009
  • This paper presents a knowledge-based view of the multi-business firm. The multi-business firm has advantages in technological innovation and knowledge creation to the extent that it embodies various ideas and resources, and recombines them more effectively and efficiently than market contracts. The purpose of this paper is to identify how to organize the multidivisional form (M-form) structure to realize such advantages. We first differentiate within-division innovation and cross-division innovation, and explain why cross-division innovation, despite its higher performance potential, would be more difficult to achieve, compared to within-division innovation. Then, we offer the propositions about how to promote cross-division innovation with references to resource capability and coordination capability that is, in turn, composed of structural and control system, social capital, and human resource management system. We conclude by discussing theoretical and practical implications.

  • PDF