• Title/Summary/Keyword: multi-sensory

Search Result 157, Processing Time 0.027 seconds

Avatar's Lip Synchronization in Talking Involved Virtual Reality (대화형 가상 현실에서 아바타의 립싱크)

  • Lee, Jae Hyun;Park, Kyoungju
    • Journal of the Korea Computer Graphics Society
    • /
    • v.26 no.4
    • /
    • pp.9-15
    • /
    • 2020
  • Having a virtual talking face along with a virtual body increases immersion in VR applications. As virtual reality (VR) techniques develop, various applications are increasing including multi-user social networking and education applications that involve talking avatars. Due to a lack of sensory information for full face and body motion capture in consumer-grade VR, most VR applications do not show a synced talking face and body. We propose a novel method, targeted for VR applications, for talking face synced with audio with an upper-body inverse kinematics. Our system presents a mirrored avatar of a user himself in single-user applications. We implement the mirroring in a single user environment and by visualizing a synced conversational partner in multi-user environment. We found that a realistic talking face avatar is more influential than an un-synced talking avatar or an invisible avatar.

The Research on Online Game Hedonic Experience - Focusing on Moderate Effect of Perceived Complexity - (온라인 게임에서의 쾌락적 경험에 관한 연구 - 지각된 복잡성의 조절효과를 중심으로 -)

  • Lee, Jong-Ho;Jung, Yun-Hee
    • Journal of Global Scholars of Marketing Science
    • /
    • v.18 no.2
    • /
    • pp.147-187
    • /
    • 2008
  • Online game researchers focus on the flow and factors influencing flow. Flow is conceptualized as an optimal experience state and useful explaining game experience in online. Many game studies focused on the customer loyalty and flow in playing online game, In showing specific game experience, however, it doesn't examine multidimensional experience process. Flow is not construct which show absorbing process, but construct which show absorbing result. Hence, Flow is not adequate to examine multidimensional experience of games. Online game is included in hedonic consumption. Hedonic consumption is a relatively new field of study in consumer research and it explores the consumption experience as a experiential view(Hirschman and Holbrook 1982). Hedonic consumption explores the consumption experience not as an information processing event but from a phenomenological of experiential view, which is a primarily subjective state. It includes various playful leisure activities, sensory pleasures, daydreams, esthetic enjoyment, and emotional responses. In online game experience, therefore, it is right to access through a experiential view of hedonic consumption. The objective of this paper was to make up for lacks in our understanding of online game experience by developing a framework for better insight into the hedonic experience of online game. We developed this framework by integrating and extending existing research in marketing, online game and hedonic responses. We then discussed several expectations for this framework. We concluded by discussing the results of this study, providing general recommendation and directions for future research. In hedonic response research, Lacher's research(1994)and Jongho lee and Yunhee Jung' research (2005;2006) has served as a fundamental starting point of our research. A common element in this extended research is the repeated identification of the four hedonic responses: sensory response, imaginal response, emotional response, analytic response. The validity of these four constructs finds in research of music(Lacher 1994) and movie(Jongho lee and Yunhee Jung' research 2005;2006). But, previous research on hedonic response didn't show that constructs of hedonic response have cause-effect relation. Also, although hedonic response enable to different by stimulus properties. effects of stimulus properties is not showed. To fill this gap, while largely based on Lacher(1994)' research and Jongho Lee and Yunhee Jung(2005, 2006)' research, we made several important adaptation with the primary goal of bringing the model into online game and compensating lacks of previous research. We maintained the same construct proposed by Lacher et al.(1994), with four constructs of hedonic response:sensory response, imaginal response, emotional response, analytical response. In this study, the sensory response is typified by some physical movement(Yingling 1962), the imaginal response is typified by images, memories, or situations that game evokes(Myers 1914), and the emotional response represents the feelings one experiences when playing game, such as pleasure, arousal, dominance, finally, the analytical response is that game player engaged in cognition seeking while playing game(Myers 1912). However, this paper has several important differences. We attempted to suggest multi-dimensional experience process in online game and cause-effect relation among hedonic responses. Also, We investigated moderate effects of perceived complexity. Previous studies about hedonic responses didn't show influences of stimulus properties. According to Berlyne's theory(1960, 1974) of aesthetic response, perceived complexity is a important construct because it effects pleasure. Pleasure in response to an object will increase with increased complexity, to an optimal level. After that, with increased complexity, pleasure begins with a linearly increasing line for complexity. Therefore, We expected this perceived complexity will influence hedonic response in game experience. We discussed the rationale for these suggested changes, the assumptions of the resulting framework, and developed some expectations based on its application in Online game context. In the first stage of methodology, questions were developed to measure the constructs. We constructed a survey measuring our theoretical constructs based on a combination of sources, including Yingling(1962), Hargreaves(1962), Lacher (1994), Jongho Lee and Yunhee Jung(2005, 2006), Mehrabian and Russell(1974), Pucely et al(1987). Based on comments received in the pretest, we made several revisions to arrive at our final survey. We investigated the proposed framework through a convenience sample, where participation in a self-report survey was solicited from various respondents having different knowledges. All respondents participated to different degrees, in these habitually practiced activities and received no compensation for their participation. Questionnaires were distributed to graduates and we used 381 completed questionnaires to analysis. The sample consisted of more men(n=225) than women(n=156). In measure, the study used multi-item scales based previous study. We analyze the data using structural equation modeling(LISREL-VIII; Joreskog and Sorbom 1993). First, we used the entire sample(n=381) to refine the measures and test their convergent and discriminant validity. The evidence from both the factor analysis and the analysis of reliability provides support that the scales exhibit internal consistency and construct validity. Second, we test the hypothesized structural model. And, we divided the sample into two different complexity group and analyze the hypothesized structural model of each group. The analysis suggest that hedonic response plays different roles from hypothesized in our study. The results indicate that hedonic response-sensory response, imaginal response, emotional response, analytical response- are related positively to respondents' level of game satisfaction. And game satisfaction is related to higher levels of game loyalty. Additionally, we found that perceived complexity is important to online game experience. Our results suggest that importance of each hedonic response different by perceived game complexity. Understanding the role of perceived complexity in hedonic response enables to have a better understanding of underlying mechanisms at game experience. If game has high complexity, analytical response become important response. So game producers or marketers have to consider more cognitive stimulus. Controversy, if game has low complexity, sensorial response respectively become important. Finally, we discussed several limitations of our study and suggested directions for future research. we concluded with a discussion of managerial implications. Our study provides managers with a basis for game strategies.

  • PDF

Effects of Snoezelen Room on Agitated Behavior of People with Dementia (스노잘렌 공간이 치매노인 동요행동에 미치는 영향)

  • Lee, Sook-Young;Alan, Dilani
    • Journal of the Korean housing association
    • /
    • v.19 no.4
    • /
    • pp.79-87
    • /
    • 2008
  • Snoezelen, multi-sensory stimulation, provides stimulation through the visual, aural, tactile, olfactory, gustatory and proprioceptive senses. Its aim is to be a relaxing, feeling of safety, novelty and stimulation with no expectations for performance. Agitated behavior of people with dementia causes significant problems and distress for cares. The objective of this research study was to test the effects of Snoezelen room on physical and verbal agitated behaviors of people with dementia. Four patients participated five sessions in Snoezelen room of 'F' dementia care facility in Sweden. Assessment instrument was basically used Cohen-Mansfield Agitation Inventory-Short Form to be rated by caregivers on a 5-point frequency scale. Pre-trial and post-trial assessments were carried out during $27^{th}$ Aug.-$27^{th}$ Sept. 2007. Result shows that Snoezelen room has some short-term positive effect on agitated behavior even though there was a considerable variation individuals responded. This result adds to the increasing evidence that Snoezelen could be a therapeutic environment for the elderly with dementia. Further research study, with larger number of participation, and a control group is required to establish more scientific evidence of Snoezelen effects on health outcome.

Relationship characteristics of intermedia and fashion show in the Chanel collection (샤넬 컬렉션에 나타난 인터미디어와 패션쇼의 관계적 특성)

  • Lee, Seulah;Lee, Younhee
    • The Research Journal of the Costume Culture
    • /
    • v.24 no.3
    • /
    • pp.367-384
    • /
    • 2016
  • The aim of this paper is to examine relationship characteristics and the relevance there of in the context of the Chanel collection, between the contemporary fashion show viewed from the artistic side and intermedia on interaction. This study analyzed the relationship characteristics between intermedia and fashion shows by focusing on Chanel fashion shows from 2010 S/S to 2016 F/W as actual case. The results are as follow: First, participational accessibility indicates the experience of a designer and audience in active participation changing into passive participation. Second, audience immersion is represented by the perception of being involved by the audience in the place and acting. Third, conceptual symbolism is sending of messages through the designer's concept manifesting in the specific features of the design. Finally, expandability of media explains trans-boundaries in experimental attempts. It concludes that fashion show is a space where the audience can have visual as well as new knowledge and experience through multi-sensory channels. The Chanel collection which is considered a huge art project at the fashion show, showed a relationship between philosophy and the direction through season concepts and brands. The Chanel collection has brought a new experience through the convergence of communications and cultural media, such as music and art according to traditional brand image.

Dependence on Brand by Product type in Online Environment (온라인(Online) 상에서의 제품유형에 따른 소비자의 브랜드 의존성)

  • 최인혁;박주영;이철선
    • Journal of Distribution Research
    • /
    • v.6 no.2
    • /
    • pp.109-133
    • /
    • 2002
  • This article examines how consumers in online environments depend on brand in making purchase decisions by product types. Previous research explains that the characteristics of online environments decrease the dependence on brand due to inexpensive search costs and affluent information quantity. But it is likely that in online environment, the dependence on brand will be differentiated by product types. We found that in search product, the availability of information decreased consumer's uncertainty, which, in turn, increased the dependence of brand. However, in experience products, the weakness of multi-sensory increased consumer's uncertainty, which resulted in the increase of the dependence of brand.

  • PDF

Kinematic Access For Generation of Realistic Behavior of Artificial Fish in Virtual Merine World (가상해저공간에서 Artificial Fish의 사실적인 행동 생성을 위한 운동학적 접근)

  • Kim, Chong-Han;Jung, Seung-Moon;Shin, Min-Woo;Kang, Im-Chul
    • The Journal of the Korea Contents Association
    • /
    • v.8 no.1
    • /
    • pp.308-317
    • /
    • 2008
  • The objects real time rendered in the 3D cyber space can interact with each others according to the events which are happened when satisfying some conditions. But to representing the behaviors with these interactions, too many event conditions are considered because each behavior pattern and event must be corresponded in a one-to-one ratio. It leads to problems which increase the system complexity. So, in this paper, we try to physical method based on elasticity force for representing more realistic behaviors of AI fish and apply to the deformable multi-detection sensor, so we suggest the new method which can create the various behavior patterns responding to one evasion event.

An Affective 3D Facial Makeup Simulation Using a Multi-sensory Interaction (다중 감각 인터랙션을 이용한 감성적 3차원 얼굴 메이크업 시뮬레이션)

  • Kim, Jeong-Sik;Kim, Hyeon-Joong;Choi, Soo-Mi
    • 한국HCI학회:학술대회논문집
    • /
    • 2007.02a
    • /
    • pp.500-506
    • /
    • 2007
  • 얼굴에 대한 시각적 인지는 오랫동안 인간에게 중요한 문제로 인식되어 왔다. 수 세기 동안 이루어져 왔던 미용 화장과 성형, 치아 교정 등의 다양한 연구는 사람의 얼굴을 감성적 측면에서 어떻게 하면 아름답게 만들 수 있는 가에 초점을 두었다. 본 논문에서는 휴먼 입출력 인터페이스로서 햅틱 장치와 스테레오 디스플레이를 혼합한 다중 감각 인터랙션 기반의 감성적인 3차원 얼굴 메이크업 시뮬레이션 프레임워크를 개발한다. 본 연구는 3차원 스캐너 장비로부터 사용자의 얼굴 모델을 추출하고, 그 데이터를 이용하여 자연스럽고 직관적인 얼굴 메이크업 시뮬레이션을 수행하는 것을 목표로 하고 있다. 이를 위하여 본 연구에서는 surface elements 표현 기반의 3차원 얼굴 필터링 방법과 얼굴 메이크업을 지원하는 페인팅 방법을 개발한다. 우선 사용자의 얼굴 모델을 3차원 스캐너로 획득한 후, 전처리 얼굴 필터링을 수행하여 조명, 그리고 사용자 얼굴 피부 상태에 기인하는 에러 및 속성들을 보정하고 피부 톤을 사용자가 선호하는 색으로 변경한다. 최종적으로 사용자는 햅틱 및 스테레오 디스플레이 장치를 이용하여 두 개의 레이어로 구성된 페인팅 표면 모델에 메이크업을 수행한다. 본 연구에서 적용한 surface elements 표현 기반의 그래픽 렌더링은 일반적인 메쉬 기반 페인팅의 문제점인 텍스쳐 왜곡 현상을 완화하고, 3차원 스캐너 장치에 기인하는 표면 에러를 보정한다. 그리고 전처리 얼굴 필터링과 메이크업 페인팅 방법은 사용자 중심의 감성적인 3차원 얼굴을 재구성하도록 한다. 결과적으로 본 연구에서 개발한 이러한 기술들이 다중 감각 인터페이스 기반의 메이크업 시뮬레이터의 기본 프레임워크가 되어, 차후 메이크업이나 코디네이션 분야 등의 디지털 콘텐츠 산업에서 활용될 수 있음을 확인하였다.

  • PDF

Sensibility Ergonomics : Needs, Concepts, Methods and Applications (감성공학의 개념과 연구 및 응용 방법)

  • Lee, Gu-Hyeong
    • Journal of the Ergonomics Society of Korea
    • /
    • v.17 no.1
    • /
    • pp.91-102
    • /
    • 1998
  • History of the Sensibility Ergonomics is explained. Concepts, definition, and research methods on the human sensibility are proposed for systematic applications of human sensibility studies to product and environment developments. Sensibility Ergonomics was born in socio-technological environments where consumers required aesthetic and satisfactory products in addition to useful and usable ones, and manufactures were trying to develop consumer-oriented, user-friendly products. Sensibility Ergonomics is defined as "multi-disciplinary and inter-disciplinary processes for developing products and environment as usable, comfortable and satisfactory with the information on human sensibility." Human sensibility is functionally defined as "feelings generated when perceived sensory and information stimuli are reflected from memory which has been accumulated through personal experiences." Human sensibility is affected by at least three factors: personal, social, and cultural. Consumers evaluate products in three aspects : functional, sensorial, and cultural sensibilities. Human sensibility is personal, dynamic, and ambiguous. It is generated reflectively and intuitively against external stimuli. No Physiological responses are accompanied, and one cannot control his/her sensibility. However, the sensibility affects the decision making or behavior of the person. To understand the human sensibility many inter-disciplinary methods should be used instead of one-variable approach. Micro-scopic studies such as Questionnaire, interview, behavioral analysis, and psychophysiological experiments can be performed. In addition, social and cultural studies are essential to understand an individual's sensibility. Results of sensibility studies can be applied to setup new interactions between human and machine through sensible(or affective) human-machine (computer) interfaces. Human-oriented and user-friendly products can be made with the information on human sensibility.

  • PDF

Estimation of Heart Rate Variability with an Android Smart Phone Platform (안드로이드 기반 스마트폰 연동 심박변이도 추정)

  • Kim, Jeong-Hwan;Shin, Seung-Won;Kim, Hyun-Tae;Yoon, Tae-Ho;Kim, Kyeong-Seop;Lee, Jeong-Whan;Eom, Gwang-Moon
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.61 no.6
    • /
    • pp.865-871
    • /
    • 2012
  • In this study, ambulatory electrocardiogram(ECG) signal and the rhythms of heart beats are visualized in terms of R-R intervals and Heart Rate Variability(HRV) in the environment of an android plaform. With this aim, Graphical User Interface(GUI) is implemented by executing multi-thread Java programming modules including ECG, heart-beats, tachogram and visualization unit. ECG signals are acquired in an android device by receiving the data from ambulatory ECG sensory system. Finite Impulse Response(FIR) filters are implemented to eliminate the baseline wandering noises contained in the ambulatory signals and DC-offset level in R-R interval data. With simulating the normal or stress emotional state of a subject, we can find the fact that HRV can be successfully estimated and visualized in an android smart phone platform.

Development of UAV Teleoperation Virtual Environment Based-on GSM Networks and Real Weather Effects

  • AbdElHamid, Amr;Zong, Peng
    • International Journal of Aeronautical and Space Sciences
    • /
    • v.16 no.3
    • /
    • pp.463-474
    • /
    • 2015
  • Future Ground Control Stations (GCSs) for Unmanned Aerial Vehicles (UAVs) teleoperation targets better situational awareness by providing extra motion cues to stimulate the vestibular system. This paper proposes a new virtual environment for long range Unmanned Aerial Vehicle (UAV) control via Non-Line-of-Sight (NLoS) communications, which is based on motion platforms. It generates motion cues for the teleoperator for extra sensory stimulation to enhance the guidance performance. The proposed environment employs the distributed component simulation over GSM network as a simulation platform. GSM communications are utilized as a multi-hop communication network, which is similar to global satellite communications. It considers a UAV mathematical model and wind turbulence effects to simulate a realistic UAV dynamics. Moreover, the proposed virtual environment simulates a Multiple Axis Rotating Device (MARD) as Human Machine Interface (HMI) device to provide a complete delay analysis. The demonstrated measurements cover Graphical User Interface (GUI) capabilities, NLoS GSM communications delay, MARD performance, and different software workload. The proposed virtual environment succeeded to provide visual and vestibular feedbacks for teleoperators via GSM networks. The overall system performance is acceptable relative to other Line-of-Sight (LoS) systems, which promises a good potential for future long range, medium altitude UAV teleoperation researches.