• Title/Summary/Keyword: realistic scenes

Search Result 70, Processing Time 0.038 seconds

A 3D Audio-Visual Animated Agent for Expressive Conversational Question Answering

  • Martin, J.C.;Jacquemin, C.;Pointal, L.;Katz, B.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.53-56
    • /
    • 2008
  • This paper reports on the ACQA(Animated agent for Conversational Question Answering) project conducted at LIMSI. The aim is to design an expressive animated conversational agent(ACA) for conducting research along two main lines: 1/ perceptual experiments(eg perception of expressivity and 3D movements in both audio and visual channels): 2/ design of human-computer interfaces requiring head models at different resolutions and the integration of the talking head in virtual scenes. The target application of this expressive ACA is a real-time question and answer speech based system developed at LIMSI(RITEL). The architecture of the system is based on distributed modules exchanging messages through a network protocol. The main components of the system are: RITEL a question and answer system searching raw text, which is able to produce a text(the answer) and attitudinal information; this attitudinal information is then processed for delivering expressive tags; the text is converted into phoneme, viseme, and prosodic descriptions. Audio speech is generated by the LIMSI selection-concatenation text-to-speech engine. Visual speech is using MPEG4 keypoint-based animation, and is rendered in real-time by Virtual Choreographer (VirChor), a GPU-based 3D engine. Finally, visual and audio speech is played in a 3D audio and visual scene. The project also puts a lot of effort for realistic visual and audio 3D rendering. A new model of phoneme-dependant human radiation patterns is included in the speech synthesis system, so that the ACA can move in the virtual scene with realistic 3D visual and audio rendering.

  • PDF

Voting based Cue Integration for Visual Servoing

  • Cho, Che-Seung;Chung, Byeong-Mook
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.798-802
    • /
    • 2003
  • The robustness and reliability of vision algorithms is the key issue in robotic research and industrial applications. In this paper, the robust real time visual tracking in complex scene is considered. A common approach to increase robustness of a tracking system is to use different models (CAD model etc.) known a priori. Also fusion of multiple features facilitates robust detection and tracking of objects in scenes of realistic complexity. Because voting is a very simple or no model is needed for fusion, voting-based fusion of cues is applied. The approach for this algorithm is tested in a 3D Cartesian robot which tracks a toy vehicle moving along 3D rail, and the Kalman filter is used to estimate the motion parameters, namely the system state vector of moving object with unknown dynamics. Experimental results show that fusion of cues and motion estimation in a tracking system has a robust performance.

  • PDF

Implementation of Background Scene in the Virtual Reality Ship Simulator (가상현실 선박 시뮬레이터의 배경 구현)

  • 임정빈
    • Journal of the Korean Society of Marine Environment & Safety
    • /
    • v.6 no.1
    • /
    • pp.11-22
    • /
    • 2000
  • The paper describes creation methods of background scenes to implement realistic virtual environments in the VRSS (Virtual Reality Ship Simulator). VRSS is next-generation system constructed with virtual tools in a virtual space. Thus, it could have many benefits compared to conventional ship simulators composed with heavy bridge mock-up system and wide visual presentations. In this work, we developed effective 3D object modeling techniques, and constructed virtual harbor scene by using 3D-Webmaster authoring tool. The virtual harbor was built with object-oriented 3D objects modeled to interact with user's action. With the immersion-type VR system, we created virtual harbor environments in a virtual space, and discussed on the naturalness of the scene with test results of SDMPA (Semantic Differential Method for Psychophysical Assessment) by 10 subjects. As the results of subject assessment, all of the participants could felt natural-like harbor. Therefore, we found that the proposed creation methods and procedures of background scene are enabling to fit to the full mission VRSS construction.

  • PDF

Robust Visual Tracking for 3-D Moving Object using Kalman Filter (칼만필터를 이용한 3-D 이동물체의 강건한 시각추적)

  • 조지승;정병묵
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2003.06a
    • /
    • pp.1055-1058
    • /
    • 2003
  • The robustness and reliability of vision algorithms is the key issue in robotic research and industrial applications. In this paper robust real time visual tracking in complex scene is considered. A common approach to increase robustness of a tracking system is the use of different model (CAD model etc.) known a priori. Also fusion or multiple features facilitates robust detection and tracking of objects in scenes of realistic complexity. Voting-based fusion of cues is adapted. In voting. a very simple or no model is used for fusion. The approach for this algorithm is tested in a 3D Cartesian robot which tracks a toy vehicle moving along 3D rail, and the Kalman filter is used to estimate the motion parameters. namely the system state vector of moving object with unknown dynamics. Experimental results show that fusion of cues and motion estimation in a tracking system has a robust performance.

  • PDF

Development of a Real-time Vehicle Driving Simulator

  • Kim, Hyun-Ju;Park, Min-Kyu;Lee, Min-Cheoul;You, Wan-Suk
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.51.2-51
    • /
    • 2001
  • A vehicle driving simulator is a virtual reality device which makes a human being feel as if the one drives a vehicle actually. The driving simulator is effectively used for studying interaction of a driver-vehicle and developing the vehicle system of new concepts. The driving simulator consists of a motion platform, a motion controller, a visual and audio system, a vehicle dynamic analysis system, a vehicle operation system and etc. The vehicle dynamic analysis system supervises overall operation of the simulator and also simulates dynamic motion of a multi-body vehicle model in real-time. In this paper, the main procedures to develop the driving simulator are classified by 4 parts. First, a vehicle motion platform and a motion controller, which generates realistic motion using a six degree of freedom Stewart platform driven hydraulically. Secondly, a visual system generates high fidelity visual scenes which are displayed on a screen ...

  • PDF

Development of Simulator with Cluster System for Towing Fisheries

  • Park Myeong-Chul;Ha Seok-Wun
    • Journal of information and communication convergence engineering
    • /
    • v.3 no.2
    • /
    • pp.84-89
    • /
    • 2005
  • Goal of this study is to implement 3-dimensional underwater appearance graphical display, fishery measured information display, sonar data representation and display, and 3-dimensional underwater appearance animation based on coefficient data of chaos behavior and fishing modeling of fishing gears from PC cluster system. In order to accomplish the goals of this study, it is essential to compose user interfacing and realistic description of image scenes in the towing-net fishery simulator, and techniques to describe sand cloud effects under water using particle systems are necessary. In this study, we implemented graphical representations and animations of the simulator by using OpenGL together with C routines.

A Study on the Visual Effects of Non-Photorealistic Rendering Animation focusing on 'Paperman,' a Short Animation (넌-포토리얼리스틱(Non-Photorealistic) 렌더링 애니메이션의 시각 효과 기법 - 단편 애니메이션 Paperman을 중심으로)

  • Park, Sung-Won
    • Cartoon and Animation Studies
    • /
    • s.40
    • /
    • pp.139-155
    • /
    • 2015
  • Animation is completed in accordance with the original planning of visual direction in the process of post-production. Especially, a variety of visualization skills to meet the planning idea are directed in editing and compositing processes such as rendering and shading in the production of 3D animation. Therefore, the studies how to implement these visual effects have been conducted since the emergence of the animation. The rendering method which appears in the recent animations so often is the effect of 2D animation style although it is applied by 3D technique. 3D animation can be classified as two types including photo realistic and non-photo realistic renderings. The former is to render the images realistically while the latter is to highlight the formative effect with analogue style free from the realism of the photographs. Visual effect of 2D animation is non-realistic, that is, non-photo realistic rendering. The animations produced by this method have the depth of 3D animation expression in terms of space and animating, and can direct the viewer-friendly analogue style visuals, which are widely used as a post-production effect. Hence in this study, we selected a short animation, 'Paperman,' one of Disney's animations, produced by cartoon rendering method which belongs to the class of non-photo rendering technique in 3D graphics, as our subject. We analyzed their techniques and visual effects of the scenes expressed by cartoon rendering method so as to understand whether they meet the original direction idea with the composition work. In addition, we expect further developments of post-production methods, exceeding the limit of graphic expression in alignment with the trend that has become more various in the types and genres of non-photo rendering.

Prediction Based Dynamic Level of Detail in Flight Simulator (항공시뮬레이터에서 예측 기반의 동적 LOD 적용방안)

  • Kim, DongJin;Lim, Juho;Kim, Ki-Il
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.7
    • /
    • pp.1363-1368
    • /
    • 2016
  • Fast rendering speed is one of key functions to provide realistic scenes in flight simulator. However, since flight simulator mostly operates with high volume terrain data, rendering speed is reduced and changed very rapidly when it handles file containing too much vertexs. So, previous schemes make use of Level of Details (LOD) scheme to prevent this problem. But, since LOD is applied after the large number of vertexs are detected, transition between scenes is not completely smooth. To solve this problem, in this paper, we propose a new dynamic LOD scheme which controls LOD level in advance through prediction of vertex overload. To verify the proposed scheme, we implement the proposed scheme in our flight simulation through OpenSceneGraph(OSG) and identify the reduced number of vertexs and enhanced Frame Per Second (FPS) by comparing real data with predicted one.

Synthesis of Ocean Wave Models and Simulation Using GPU (바다물결 모형의 합성 및 GPU를 이용한 시뮬레이션)

  • Lee, Dong-Min;Lee, Sung-Kee
    • The KIPS Transactions:PartA
    • /
    • v.14A no.7
    • /
    • pp.421-434
    • /
    • 2007
  • Among many other CG generated natural scenes, the representation of ocean surfaces is one of the most complicated and time-consuming problem because of its large extent and complex surface movement. We present a hybrid method to represent and animate unbound deep-water ocean surfaces by utilizing graphics processor as both simulation and rendering core. Our technique is mainly based on spectral approaches that generate a high-detailed height field using Fourier transform on a 2D regular grid. Additionally, we incorporate Gerstner model and generate low-detailed height field on a 2D projected grid in order to represent large waves and main structure of ocean surface. There is no interruption between CPU and GPU, and no need to transfer simulation results from the system memory to graphics hardware because the entire simulation and rending processes are done on graphics processor. As a result we can synthesize and render realistic water surfaces in real-time. Proposed techniques are readily adoptable to real-time applications such as computer games that have heavy work load on CPU but still demand plausible natural scenes.

A Study on the Characteristics of Interior Design in Korean Classic Films - Focus on the housing of the expressionism film, 'Hanyeo' in 1960's - (한국 고전영화를 통해 본 실내 공간 특성에 관한 연구 - 표현주의 영화 하녀에 나타난 1960년대 주택공간을 중심으로 -)

  • Lee, Chul-Jae
    • Korean Institute of Interior Design Journal
    • /
    • v.21 no.2
    • /
    • pp.65-73
    • /
    • 2012
  • Interior design generally falls behind to architecture in its concept of conservational value as interior designs are more to the simple style or trend. Therefore, This study aims how the society and the major events in the 1960's and individual and group desires are portrayed in movies through the eyes of movie directors, and further how the concept of spaces and the features of the spaces are displayed. First, This paper analyzes the movies in the 1960's, especially the expressionism and psychological zeitgeist in "The Housemaid" directed by Kim Ki-Young that can be logically analyzed, following the signs in the movie. Secondly, It analyzes the images captured the scenes that best describe the underlying theme of the movie, revealing the features of the different spaces for different scenes. Moreover, It analyzes the correlation of the change in value, desire, and space of the time in the 1960's to see the feature of the spaces in the 1960 are represented in the movie. In conclusion, the realistic expressionism movie of Kim Ki-young's 'Housemaid' showing the everyday life of a family against the background of industrial capitalism reveals the intimate desire of the time with the director's perspective on the history. With Mise-en-Sc$\grave{e}$ne, we can understand the space structure of the time, the view on space structure and further the effect of modernization project on urban residential area.

  • PDF