• Proceedings of the Korea Contents Association Conference
• /
• 2008.05a
• /
• pp.15-18
• /
• 2008

This paper proposes a method to reconstruct the 3-D face using structured light image. First of all, we suppose that each sight vector of a projector and camera are parallel. We project the structured light in the shape of lattice on the background to acquire the reference-structured light image. This image is used to calibrate the projector and camera. Since then, we acquire the face-structured light image which is projected the same structured light on the face. These two structured light images are used to reconstruct the 3-D face through the variation which is measured from the positional difference of feature vectors. In our experiment result, we could reconstruct the 3-D face image as recognize through these simple devices.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.6A
• /
• pp.497-502
• /
• 2012

In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. The proposed system synthesizes the gaze corrected images using the depth estimation and the virtual view synthesis algorithms as one of the most important techniques of 3D video system. The conventional processes, however, causes several problems, especially temporal inconsistency of a depth video. This problem leads to flickering artifacts discomforting viewers. Therefore, in order to reduce the temporal inconsistency problem, we exploit the joint bilateral filter which is extended to the temporal domain. In addition, we apply an outlier reduction operation in the temporal domain. From experimental results, we have verified that the proposed system is sufficient to generate the natural gaze-corrected image and realize immersive videoconferencing.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.20 no.2
• /
• pp.149-155
• /
• 2020

The Korea Highway Traffic Authority provides statistics that analyze the causes of traffic accidents that occurred since 2015 using the Traffic Accident Analysis System (TAAS). it was reported Through TAAS that the driver's forward carelessness was the main cause of traffic accidents in 2018. As statistics on the cause of traffic accidents, 51.2 percent used mobile phones and watched DMB while driving, 14 percent did not secure safe distance, and 3.6 percent violated their duty to protect pedestrians, representing a total of 68.8 percent. In this paper, we propose a system that has improved the advanced driver assistance system ADAS (Advanced Driver Assistance Systems) by utilizing CNN (Convolutional Neural Network) among the algorithms of Deep Learning. The proposed system learns a model that classifies the movement of the driver's face and eyes using Conv2D techniques which are mainly used for Image processing, while recognizing and detecting objects around the vehicle with cameras attached to the front of the vehicle to recognize the driving environment. Then, using the learned visual steering model and driving environment data, the hazard is classified and detected in three stages, depending on the driver's view and driving environment to assist the driver with the forward and blind spots.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.6
• /
• pp.88-95
• /
• 2011

An embedded mobile device mostly has lower computation power than a general purpose computer because of its relatively lower system specifications. Consequently, conventional face tracking and face detection methods, requiring complex algorithms for higher recognition rates, are unsuitable in a mobile environment aiming for real time detection. On the other hand, by applying a real-time tracking and detecting algorithm, we would be able to provide a two-way interactive multimedia service between an user and a mobile device thus providing a far better quality of service in comparison to a one-way service. Therefore it is necessary to develop a real-time face and eye tracking technique optimized to a mobile environment. For this reason, in this paper, we proposes a method of tracking horizontal face position of a user on a T-DMB device for enhancing the quality of 3D DMB content. The proposed method uses the orientation of edges to estimate the left and right boundary of the face, and by the color edge information, the horizontal position and size of face is determined finally to decide the horizontal face. The sobel gradient vector is projected vertically and candidates of face boundaries are selected, and we proposed a smoothing method and a peak-detection method for the precise decision. Because general face detection algorithms use multi-scale feature vectors, the detection time is too long on a mobile environment. However the proposed algorithm which uses the single-scale detection method can detect the face more faster than conventional face detection methods.

• Journal of Digital Convergence
• /
• v.18 no.6
• /
• pp.93-98
• /
• 2020

In this paper, we proposed a technique in which subtitles are followed according to changes in the user's viewpoint in 360 VR. Create a Sphere object in Unity's Scene and insert a 360-degree image on the surface of the Sphere object. At this time, the ReverseNormals script is used to convert the viewpoint to the inside. The SightOrbitproved script is used to modify the camera view. Use this script to set the environment in which subtitles can move depending on the viewpoint. Next, add the 3D text (subtitle) that the user wants to the lower layer of the main camera and build a 360 VR object. The 3D text subtitles implemented through this study were compared according to the change of the user's viewpoint. As a result, as the viewpoint changes, normal subtitles flow out of line of sight according to the user's point of view, but 3D Text subtitles move according to the user's point of view, and it can be seen that the user can always view the subtitles.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1536-1539
• /
• 2013

3차원 물체는 카메라의 시선 방향에 따라 다른 영상을 생성하므로 2차원 영상만으로 3차원 물체를 인식하는 것은 쉬운 일이 아니다. 특히 영상생성 시 강한 perspective transformation 이 발생할 경우 2차원 국소 특징을 이용하는 SIFT(Scale-Invariant Feature Transform) 알고리즘은 매칭에 활용하기 어렵다. 본 논문에서는 3차원 물체를 하나의 특정 축 중심으로 회전시키면서 얻은 복수의 영상을 학습 데이터로 활용하여 SIFT 알고리즘을 개선한 물체인식 방법을 제안한다. 이 방법은 복수 영상의 특징점들을 하나의 특징 공간으로 합성하고 그 특징점들 간의 기하학적인 제약조건을 확인하여 3차원 물체를 인식하는 방법이다. 실험에서는 알고리즘의 유용성을 먼저 확인하기 위해 조명조건과 카메라의 위치를 일정하게 유지하였다. 이 방법에 의해 SIFT 알고리즘만으로 인식이 힘들었던 3차원 물체의 다양한 외관(appearance) 인식이 가능하게 되었다.

• Journal of Broadcast Engineering
• /
• v.11 no.1 s.30
• /
• pp.80-90
• /
• 2006

A simple 2D gaze tracking method using single camera and Purkinje image is proposed. This method employs single camera with infrared filter to capture one eye and two infrared light sources to make reflection points for estimating corresponding gaze point on the screen from user's eyes. Single camera, infrared light sources and user's head can be slightly moved. Thus, it renders simple and flexible system without using any inconvenient fixed equipments or assuming fixed head. The system also includes a simple and accurate personal calibration procedure. Before using the system, each user only has to stare at two target points for a few seconds so that the system can initiate user's individual factors of estimating algorithm. The proposed system has been developed to work in real-time providing over 10 frames per second with XGA $(1024{\times}768)$ resolution. The test results of nine objects of three subjects show that the system is achieving an average estimation error less than I degree.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.426-432
• /
• 2008

We introduce a method of rendering a scene lying 3D objects which is like that artist draw on a canvas by brushing. Painting is the art area presenting something created by color and line on 2D plane. We are brushing on billboards on screen space for the 2D brushing effect according to the definition of "Painting". Brushing orientation is haven to rotate for preventing the orientation in the first scene in the case that object or camera are moving. If the brushing isn't rotated, shower-door effect is watched on the scene as undesirable result We present a brushing rotating method for keeping the orientation changing the direction of view and object rigid animation. The brushing direction is computed with Horn's 2D similarity transform by least-square solution. We watched the changing brushing to track the motion of object and view.

• KIPS Transactions on Software and Data Engineering
• /
• v.3 no.2
• /
• pp.93-100
• /
• 2014

3D object recognition using only 2D images is a difficult work because each images are generated different to according to the view direction of cameras. Because SIFT algorithm defines the local features of the projected images, recognition result is particularly limited in case of input images with strong perspective transformation. In this paper, we propose the object recognition method that improves SIFT algorithm by using several sequential images captured from rotating 3D object around a rotation axis. We use the geometric relationship between adjacent images and merge several images into a generated feature space during recognizing object. To clarify effectiveness of the proposed algorithm, we keep constantly the camera position and illumination conditions. This method can recognize the appearance of 3D objects that previous approach can not recognize with usually SIFT algorithm.

• Journal of Sensor Science and Technology
• /
• v.8 no.1
• /
• pp.80-88
• /
• 1999

This paper deals with the position determination problem of stereo camera systems used as a sensor for 3D robotic manipulation. Stereo cameras having parallel rays of sight and been set up on the same baseline are assumed. The distance between the sensor and the space measured is determined so as to get insensitive parameters to the uncertainty of control points used for calibration and to satisfy the error condition set by considering the repeatability of the robot. The baseline width is determined by minimizing the mutual effect of 3D positional error and stereo image coordinate error. Unlike existing techniques, the technique proposed here is developed without complicated constraints and modelling process of the object to be observed. Thus, the technique of this paper is more general and its effectiveness is proved by simulation.