• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제15권8호
• /
• pp.3011-3024
• /
• 2021

Pose estimation of the sensor is important issue in many applications such as robotics, navigation, tracking, and Augmented Reality. This paper proposes visual-inertial integration system appropriate for dynamically moving condition of the sensor. The orientation estimated from Inertial Measurement Unit (IMU) sensor is used to calculate the essential matrix based on the intrinsic parameters of the camera. Using the epipolar geometry, the outliers of the feature point matching are eliminated in the image sequences. The pose of the sensor can be obtained from the feature point matching. The use of IMU sensor can help initially eliminate erroneous point matches in the image of dynamic scene. After the outliers are removed from the feature points, these selected feature points matching relations are used to calculate the precise fundamental matrix. Finally, with the feature point matching relation, the pose of the sensor is estimated. The proposed procedure was implemented and tested, comparing with the existing methods. Experimental results have shown the effectiveness of the technique proposed in this paper.

• Journal of Information Processing Systems
• /
• 제17권2호
• /
• pp.399-410
• /
• 2021

Aiming at the problem that complex external variables in natural scenes have a greater impact on facial expression recognition results, a facial expression recognition method based on two-stream convolutional neural network is proposed. The model introduces exponentially enhanced shared input weights before each level of convolution input, and uses soft attention mechanism modules on the space-time features of the combination of static and dynamic streams. This enables the network to autonomously find areas that are more relevant to the expression category and pay more attention to these areas. Through these means, the information of irrelevant interference areas is suppressed. In order to solve the problem of poor local robustness caused by lighting and expression changes, this paper also performs lighting preprocessing with the lighting preprocessing chain algorithm to eliminate most of the lighting effects. Experimental results on AFEW6.0 and Multi-PIE datasets show that the recognition rates of this method are 95.05% and 61.40%, respectively, which are better than other comparison methods.

• 한국멀티미디어학회논문지
• /
• 제24권8호
• /
• pp.1059-1067
• /
• 2021

In this paper, a HDR algorithm for a single image is proposed using the exposure fusion, that adaptively calculates gamma correction coefficients according to the image distribution. Since typical HDR methods should use at least three images with different exposure values at the same scene, the main problem was that they could not be applied at the single shot image. Thus, HDR enhancements based on a single image using tone mapping and histogram modifications were recently presented, but these created some location-specific noises due to improper corrections. Therefore, the proposed algorithm calculates proper gamma coefficients according to the distribution of the input image and generates different exposure images which are corrected by the dark and the bright region stretching. A HDR image reproduction controlling exposure fusion weights among the gamma corrected and the original pixels is presented. As the result, the proposed algorithm can reduce certain noises at both the flat and the edge areas and obtain subjectively superior image quality to that of conventional methods.

• 한국컴퓨터그래픽스학회논문지
• /
• 제20권1호
• /
• pp.13-19
• /
• 2014

본 논문에서는 현실감 있는 렌더링을 위하여 최근 널리 사용되고 있는 영상 기반 조명(image-based lighting)과정을 실시간으로 처리하기위한 기술을 다룬다. 기존의 영상을 광원으로 사용하는 실시간 렌더링 기법에서는 주로 난반사(diffuse reflection)와 거울 면 정반사(mirror-like specular reflection)을 다루는 반면, 본 논문에서는 기존에 컴퓨터 그래픽스 분야에서 널리 사용하던 퐁 반사 모델(Phong reflection model)을 실시간으로 렌더링 하기 위한 방법을 제안한다. 특히 새로운 방법론 보다는 기존의 방법들을 확장하여 게임이나 실시간 미리보기 등의 응용에서 전통적인 방법으로 제작된 표면 속성을 가지는 기하객체를 보다 사실적으로 렌더링하기 위한 실용적인 방법을 제안한다. 난반사의 경우에는 기존의 방법과 유사하게 전처리 과정에서 원본 광원 영상으로부터 난반사를 실시간으로 계산하기 위한 영상을 생성하는 방법을 사용한다. 정반사의 경우에도 유사하게 전처리 과정에서 광택도(shininess)에 따른 반사 맵을 미리 생성하고 이를 물체의 광택도(shininess)에 따라서 보간하는 방법을 사용한다. 이와 같은 방법으로 실시간에 비교적 매우 적은 양의 계산과 적은 텍스처 참조를 통하여 영상 기반 조명을 근사할 수 있다.

• 방송공학회논문지
• /
• 제21권4호
• /
• pp.515-524
• /
• 2016

근적외선은 눈에 보이는 가시광선 파장 대역을 벗어난 빛으로 일반적인 디지털 카메라에서는 핫미러 필터에 의하여 차단된다. 하지만 근적외선으로부터 얻어지는 정보들은 영상의 전체적인 가시성을 향상시킬 수 있다고 알려져 있기 때문에 영상의 질 개선에 유용한 정보가 될 수 있다. 예를 들어 영상에 안개가 낀 경우, 근적외선은 가시광선보다 안개 입자에 대한 침투성이 더 강하다는 성질을 가지고 있기 때문에 근적외선 카메라로 영상을 촬영하면 일반적인 카메라 영상보다 더 선명한 영상을 얻을 수 있다. 본 논문은 실외 영상의 질을 높이기 위해 컬러 영상과 근적외선 영상을 융합하는 알고리즘을 제안한다. 첫 번째로, 본 논문은 컬러 영상과 근적외선 영상의 대비를 비교하여 가중치 맵을 구한다. 그 후, 이 가중치 맵을 이용하여 두 영상을 융합하는 과정을 거치게 된다. 본 논문은 실험 결과들을 통해서 제안하는 알고리즘이 효과적으로 영상의 질을 높이고, 또한 안개를 제거하는 것을 보여준다.

• 한국컴퓨터정보학회논문지
• /
• 제17권7호
• /
• pp.67-76
• /
• 2012

본 논문에서는 보행자에 장착된 카메라로부터 입력된 자연영상에서 외부 환경 변화에 강인한 적응적인 보도 경계선 검출 기법을 제안한다. 제안하는 방법은 두 단계로 구성되어 안정적으로 보도 영역을 분할한다. 첫 번째 단계에서는 복잡한 외부 환경에 강인하도록 적응적인 임계치를 이용하는 에지 검출 방법을 통해 소실선과 소실점을 추출한다. 두 번째 단계에서는 소실점에 기반하는 VRay를 이용한 방사형 영역 분할법을 통해 보도의 경계선을 검출한다. 성능평가를 위해서는제안된 에지 검출 방법과 케니 에지 검출기와의 비교를통해 제안된 방법이 외부 환경의 조명조건 변화에 강건함을 확인하였으며, VRay의 가상 광선의 길이 변화에 따른 영역분할 결과를 비교하여 방사형 영역 분할법의 타당성을 입증하였다.

• 비교문화연구
• /
• 제36권
• /
• pp.123-147
• /
• 2014

The purpose of this essay is three-fold: to trace the genealogy of the Korean musical, which ever since its inception in the 1960s has been seeking to modernize Korean theater with Broadway as a constant role model; to investigate how the national and the global conflict and are conflated in the form of the Korean musical in the process of its (dis)identification with Broadway; and to examine how its intercultural translations reveal and reflect the dilemma and ambivalence posed by globalization in our era. Drawing on Richard Dyer's signature article Entertainment and Utopia, I analyze how the Korean musical manifests and conduits competing utopian impulses of Korean/Global audiences. I also attempt to problematize the formulaic notion of Broadway musicalsthe Superior Other!which implies a global hegemony that does not, in fact, exist because the boundary between the global and the local as well as the power dynamics of global culture are not fixed but constantly moving and changing. Today's musical scene in Korea shows interesting reversals from the 1990s, when Korean producers were eager to debut on Broadway and impress American audiences. Korean producers no longer look up to Broadway as a final destination; instead they want to make Seoul a new Broadway. They import Broadway musicals and turn them into Korean shows. The glamor of Broadway is no longer the main attraction of musicals in Korea. What young audiences look for most is the glamor of K-pop idols and utopian feelings of abundance, energy, intensity, transparency and community, which they can experience live in the musical with their favorite stars right in front of their eyes. In conclusion, I delve into the complex dynamics of recent Korean musicals with Thomas Friedman's theory of Globalization 3.0 as reference. The binary formula of Global/America versus Local/Korea cannot be applied to the dynamic and intercultural musical scene of today. Globalization is not a uniform phenomenon but rather a twofold (multifold) process of global domination and dissemination, in which the global and the local conflict and are conflated constantly. As this study tries to illuminate, the Korean musical has evolved in a huge net of interdependences between the global and the local with a range of sources, powers and influences.

• International Journal of Internet, Broadcasting and Communication
• /
• 제16권1호
• /
• pp.106-123
• /
• 2024

This article takes the talk show "Beast Town" as an example to introduce the overall technical solution, technical difficulties and countermeasures for the combination of cartoon virtual characters and virtual studio technology, providing reference and experience for the multi-scenario application of digital humans. Compared with the live broadcast that combines reality and reality, we have further upgraded our virtual production technology and digital human-driven technology, adopted industry-leading real-time virtual production technology and monocular camera driving technology, and launched a virtual cartoon character talk show - "Beast Town" to achieve real Perfectly combined with virtuality, it further enhances program immersion and audio-visual experience, and expands infinite boundaries for virtual manufacturing. In the talk show, motion capture shooting technology is used for final picture synthesis. The virtual scene needs to present dynamic effects, and at the same time realize the driving of the digital human and the movement with the push, pull and pan of the overall picture. This puts forward very high requirements for multi-party data synchronization, real-time driving of digital people, and synthetic picture rendering. We focus on issues such as virtual and real data docking and monocular camera motion capture effects. We combine camera outward tracking, multi-scene picture perspective, multi-machine rendering and other solutions to effectively solve picture linkage and rendering quality problems in a deeply immersive space environment. , presenting users with visual effects of linkage between digital people and live guests.

• 정보과학회 논문지
• /
• 제44권6호
• /
• pp.573-580
• /
• 2017

최근 모바일 기기성능의 비약적인 향상에도 불구하고 아직 발열과 배터리의 한계로 인하여 PC 플랫폼에 비해 성능이 제한적이다. 따라서 고화질의 렌더링을 위하여 모바일 광선 추적 기술을 적용하는데 있어, 주 광선 계산은 래스터화 기반의 OpenGL ES 렌더링으로 대치한 후 이차 광선만을 추적하는 방법을 고려할 수 있다. 이 경우 전체 렌더링 과정에서 이차 광선의 추적 비용이 대부분의 시간을 차지하게 되는데, 본 논문에서는 이러한 문제를 해결하고자 동적인 장면 렌더링 시 응집성이 떨어지는 이차 광선의 탐색 성능을 개선하는 볼륨 격자 구조 방법을 제안한다. 이를 위해 가능한 모든 이차 광선을 정해진 적은 수의 샘플링 광선으로 모델링하여, 균일 격자 구조의 단점인 광선 추적 경로상의 모든 셀을 방문해야하는 문제를 완화하는 방법으로 격자 탐색의 성능을 향상시켰다. 또한 전체 렌더링 성능을 향상시키기 위하여 모바일 기기의 CPU와 GPU를 효과적으로 활용할 수 있는 하이브리드 렌더링 파이프라인을 제안한다.

• 대한원격탐사학회:학술대회논문집
• /
• 대한원격탐사학회 2007년도 Proceedings of ISRS 2007
• /
• pp.540-543
• /
• 2007

The modulation transfer function (MTF) in a camera system is a measurement of how well the system will faithfully reproduce the original scene. The electro-optical camera system consists of optics, an array of pixels, and an electronics which is related to the image signal chain. The system MTF can be cascaded with each element's MTF in the frequency domain. That is to say, the electronics MTF including the detector MTF can be recalculated easily by the acquired system MTF if the well-known test optics is used in the measuring process. A Time-Delay and Integration (TDI) detector can make a signal increase by taking multiple exposures of the same object and adding them. It can be considered the various methods to measure the MTF of the TDI camera system. This paper shows the actual and practical MTF measuring methods for the detector and electronics in the TDI camera. The several methods are described according to the scan direction as well as the TDI stages such as the single line mode and the multiple-lines mode. The measuring is performed in the in the static condition or dynamic condition to get the point spread function (PSF) or the line spread function (LSF). Especially, the dynamic test bench is used to simulate on track velocity to synchronize with TDI read out frequency for the dynamic movement.