• Title/Summary/Keyword: Virtual and augmented reality

Search Result 601, Processing Time 0.029 seconds

Robust Dynamic Projection Mapping onto Deforming Flexible Moving Surface-like Objects (유연한 동적 변형물체에 대한 견고한 다이내믹 프로젝션맵핑)

  • Kim, Hyo-Jung;Park, Jinho
    • Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
    • /
    • v.7 no.6
    • /
    • pp.897-906
    • /
    • 2017
  • Projection Mapping, also known as Spatial Augmented Reality(SAR) has attracted much attention recently and used for many division, which can augment physical objects with projected various virtual replications. However, conventional approaches towards projection mapping have faced some limitations. Target objects' geometric transformation property does not considered, and movements of flexible objects-like paper are hard to handle, such as folding and bending as natural interaction. Also, precise registration and tracking has been a cumbersome process in the past. While there have been many researches on Projection Mapping on static objects, dynamic projection mapping that can keep tracking of a moving flexible target and aligning the projection at interactive level is still a challenge. Therefore, this paper propose a new method using Unity3D and ARToolkit for high-speed robust tracking and dynamic projection mapping onto non-rigid deforming objects rapidly and interactively. The method consists of four stages, forming cubic bezier surface, process of rendering transformation values, multiple marker recognition and tracking, and webcam real time-lapse imaging. Users can fold, curve, bend and twist to make interaction. This method can achieve three high-quality results. First, the system can detect the strong deformation of objects. Second, it reduces the occlusion error which reduces the misalignment between the target object and the projected video. Lastly, the accuracy and the robustness of this method can make result values to be projected exactly onto the target object in real-time with high-speed and precise transformation tracking.

Design and Implementation of Sandcastle Play Guide Application using Artificial Intelligence and Augmented Reality (인공지능과 증강현실 기술을 이용한 모래성 놀이 가이드 애플리케이션 설계 및 구현)

  • Ryu, Jeeseung;Jang, Seungwoo;Mun, Yujeong;Lee, Jungjin
    • Journal of the Korea Computer Graphics Society
    • /
    • v.28 no.3
    • /
    • pp.79-89
    • /
    • 2022
  • With the popularity and the advanced graphics hardware technology of mobile devices, various mobile applications that help children with physical activities have been studied. This paper presents SandUp, a mobile application that guides the play of building sand castles using artificial intelligence and augmented reality(AR) technology. In the process of building the sandcastle, children can interactively explore the target virtual sandcastle through the smartphone display using AR technology. In addition, to help children complete the sandcastle, SandUp informs the sand shape and task required step by step and provides visual and auditory feedback while recognizing progress in real-time using the phone's camera and deep learning classification. We prototyped our SandUp app using Flutter and TensorFlow Lite. To evaluate the usability and effectiveness of the proposed SandUp, we conducted a questionnaire survey on 50 adults and a user study on 20 children aged 4~7 years. The survey results showed that SandUp effectively helps build the sandcastle with proper interactive guidance. Based on the results from the user study on children and feedback from their parents, we also derived usability issues that can be further improved and suggested future research directions.

Multisensory based AR System for Education of Cultural Heritage

  • Jeong, Eunsol;Oh, Jeong-eun;Won, Haeyeon;Yu, Jeongmin
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.11
    • /
    • pp.61-69
    • /
    • 2019
  • In this paper, we propose a multisensory(i.e., visual-auditory-tactile) based AR system for the education of cultural heritage. The proposed system provides a multisensory interaction by designing a user to experience with a 3D printed artifact which is mapped by a virtual 3D content of digital heritage. Compared with the existing systems of cultural heritage education based on augmented reality(AR) technology, this system focused on not only providing learning experience via a sense of visual and auditory, but also a sense of tactile. Furthermore, since this systems mainly provided the direct interactions using a 3D printed model, it gives a higher degree of realism than existing system that use touch or click motions on a 2D display of mobile phones and tablets. According to a result of user testing, we concluded that the proposed system delivered the excellent presence and learning flow to users. Particularly, from the usability evaluation, a 3D printed target artifact which is similar in shape to original heritage artifact, achieved the highest scores among the various tested targets.

A Study on Technology Trend of VR Experience Contents (VR 체험 콘텐츠 기술 동향에 관한 연구)

  • Choi, Kyoung-Ho
    • Journal of Korea Entertainment Industry Association
    • /
    • v.14 no.8
    • /
    • pp.513-523
    • /
    • 2020
  • This study has derived the patents of the technology that have been filed and registered so far to investigate the trends of virtual reality(VR) experience contents technology, and analyzed them focusing on core patent technologies. The patents of Korea, USA, Japan, Europe and PCT, which were released until June 2020, were targeted, and patent search was conducted using WISDOMAIN search DB. The keywords for patent search were related to experience technology using VR, and a total of 1,013 data were obtained after creating a search formula by combining the derived keywords. Among them, a total of 65 data were extracted from the result of selecting valid patents, and a political analysis was conducted on them. Looking at the overall application trend, most of Korean patent applications accounted for, and noise patents are system-related devices to implement VR technology. The United States and Europe are focused on developing augmented reality(AR) technology, the study found. The technology of VR experience has increased rapidly since 2017, and the technology growth stage is the period from the beginning to the growth stage. As a result of examining the valid patents related to VR experience, technology was searched in various fields such as rural tour, exhibition, education, and performance, and patents for contents writing and general virtual experience related technology were also searched. If we predict the possibility of development of VR industry in the future, it is necessary to respond to preemption of intellectual property rights by proceeding technology development and patent application for more diverse fields.

The Analysis of the Characteristic Types of Fashion Brand Application - Concentrating on Korean Application cases - (패션 브랜드 어플리케이션의 특징적 유형 분석 - 한국 계정 어플리케이션 사례를 중심으로 -)

  • Park, Min-A;Ko, Hyun-Zin
    • Journal of the Korean Society of Costume
    • /
    • v.64 no.1
    • /
    • pp.136-151
    • /
    • 2014
  • This study systematically analyzed types of fashion brand application focusing on accounts created in Korea. While referring to 'Chanel' which has developed a fashion brand app for the first time in August of 2008, not only for App store by Apple Inc. of the greatest market share but also for Android market, the one and only competitor of App store, the study examined cases of fashion brand app in Korea and foreign countries which have been in service till August of 2013 since the year of 2008. To achieve the research goal, the study conducted a literature research and a case review, categorizing the app by their distinctive functions which were Basic Information, SNS, AR, LBS, Entertainment, Mobile Shopping and Live Streaming. As for the first function, Basic Information, it was considered to provide information on a brand such as prices, sizes and colors of products which should be the most fundamental function of a fashion brand. The function would include look book, catalogues, photographs and others of products, helping users of the app with their understanding on images and concepts of the brand. Second, SNS function was considered useful for its mobility and communication and with the help of theirs, the users share fashion information with each other. Third, AR function as in a filed of virtual reality would edit virtual objects to look real in an actual environment. This would eventually offer the users a chance to try for clothes virtually. The fourth function, LBS, would work with GPS to find a store closest from a present location. This would be a help when the users try to find stores holding promotion events or trails while hiking in mountains. The fifth Entertainment function would include all sorts of games and chances for the users to listen to music and keep fashion diaries. The sixth function, Mobile Shopping, would help the users purchase items online via the app as they would not visit a store in person. The seventh function, Live Streaming, would give the users chances to actually see fashion collections in real time, held all over the world in every season. Because of this function, not only fashion experts but also regular people have become able to enjoy the fashion shows. The distinctive characteristics of the fashion brand application discussed in the study will be a useful reference when any relevant fields try to design other new fashion brand application.

Wearable Computers

  • Cho, Gil-Soo;Barfield, Woodrow;Baird, Kevin
    • Fiber Technology and Industry
    • /
    • v.2 no.4
    • /
    • pp.490-508
    • /
    • 1998
  • One of the latest fields of research in the area of output devices is tactual display devices [13,31]. These tactual or haptic devices allow the user to receive haptic feedback output from a variety of sources. This allows the user to actually feel virtual objects and manipulate them by touch. This is an emerging technology and will be instrumental in enhancing the realism of wearable augmented environments for certain applications. Tactual displays have previously been used for scientific visualization in virtual environments by chemists and engineers to improve perception and understanding of force fields and of world models populated with the impenetrable. In addition to tactual displays, the use of wearable audio displays that allow sound to be spatialized are being developed. With wearable computers, designers will soon be able to pair spatialized sound to virtual representations of objects when appropriate to make the wearable computer experience even more realistic to the user. Furthermore, as the number and complexity of wearable computing applications continues to grow, there will be increasing needs for systems that are faster, lighter, and have higher resolution displays. Better networking technology will also need to be developed to allow all users of wearable computers to have high bandwidth connections for real time information gathering and collaboration. In addition to the technology advances that make users need to wear computers in everyday life, there is also the desire to have users want to wear their computers. In order to do this, wearable computing needs to be unobtrusive and socially acceptable. By making wearables smaller and lighter, or actually embedding them in clothing, users can conceal them easily and wear them comfortably. The military is currently working on the development of the Personal Information Carrier (PIC) or digital dog tag. The PIC is a small electronic storage device containing medical information about the wearer. While old military dog tags contained only 5 lines of information, the digital tags may contain volumes of multi-media information including medical history, X-rays, and cardiograms. Using hand held devices in the field, medics would be able to call this information up in real time for better treatment. A fully functional transmittable device is still years off, but this technology once developed in the military, could be adapted tp civilian users and provide ant information, medical or otherwise, in a portable, not obstructive, and fashionable way. Another future device that could increase safety and well being of its users is the nose on-a-chip developed by the Oak Ridge National Lab in Tennessee. This tiny digital silicon chip about the size of a dime, is capable of 'smelling' natural gas leaks in stoves, heaters, and other appliances. It can also detect dangerous levels of carbon monoxide. This device can also be configured to notify the fire department when a leak is detected. This nose chip should be commercially available within 2 years, and is inexpensive, requires low power, and is very sensitive. Along with gas detection capabilities, this device may someday also be configured to detect smoke and other harmful gases. By embedding this chip into workers uniforms, name tags, etc., this could be a lifesaving computational accessory. In addition to the future safety technology soon to be available as accessories are devices that are for entertainment and security. The LCI computer group is developing a Smartpen, that electronically verifies a user's signature. With the increase in credit card use and the rise in forgeries, is the need for commercial industries to constantly verify signatures. This Smartpen writes like a normal pen but uses sensors to detect the motion of the pen as the user signs their name to authenticate the signature. This computational accessory should be available in 1999, and would bring increased peace of mind to consumers and vendors alike. In the entertainment domain, Panasonic is creating the first portable hand-held DVD player. This device weight less than 3 pounds and has a screen about 6' across. The color LCD has the same 16:9 aspect ratio of a cinema screen and supports a high resolution of 280,000 pixels and stereo sound. The player can play standard DVD movies and has a hour battery life for mobile use. To summarize, in this paper we presented concepts related to the design and use of wearable computers with extensions to smart spaces. For some time, researchers in telerobotics have used computer graphics to enhance remote scenes. Recent advances in augmented reality displays make it possible to enhance the user's local environment with 'information'. As shown in this paper, there are many application areas for this technology such as medicine, manufacturing, training, and recreation. Wearable computers allow a much closer association of information with the user. By embedding sensors in the wearable to allow it to see what the user sees, hear what the user hears, sense the user's physical state, and analyze what the user is typing, an intelligent agent may be able to analyze what the user is doing and try to predict the resources he will need next or in the near future. Using this information, the agent may download files, reserve communications bandwidth, post reminders, or automatically send updates to colleagues to help facilitate the user's daily interactions. This intelligent wearable computer would be able to act as a personal assistant, who is always around, knows the user's personal preferences and tastes, and tries to streamline interactions with the rest of the world.

  • PDF

A Study on Marketing Revitalization Plan of Performing Arts Theatre Using Realistic Contents (실감콘텐츠를 활용한 공연장 마케팅 방안 연구)

  • Lim, Young-June;Lee, Young-Suk
    • Journal of Digital Contents Society
    • /
    • v.19 no.2
    • /
    • pp.309-318
    • /
    • 2018
  • We proposed a marketing plan for the performing arts venue using realistic contents(VR, AR, and MR). The venue is a place where the audience can experience the performance directly. The marketing plan of the performance venue is as follows. Firstly, it is a marketing strategy that utilizes an arrangement of venue seats. It is possible to predict for watching a performance at angle and sight in performance venue seats that audience want through VR. This allows the theatre seats to be experienced in advance with the VR contents inducing the reservation of the seats with a high sense of immersion. Secondly, it is a marketing using PR and AD of performing arts through MR in the space with a large transient population. It is possible to promote dynamic promotion utilizing the sense of the presence of performing arts compared with existing static promotion means. Thirdly, it is a marketing strategy that utilizes actor characters in performance. The audience could be interested in the performing arts in advance via a preview of the AR contents of the pamphlet. Fourthly, it is a way to communicate with customers directly by establishing a VR social network to manage venue members. This will help attract an audience to revitalize the theatre venue.

Experience Expansion of Interface through Meta-Thinking in Digital Media -Focused on Augmented Things and Media Art Cases- (디지털 미디어에서 메타적 사고를 통한 인터페이스의 경험 확장 -증강된 사물, 미디어 아트 사례를 중심으로-)

  • Seo, Hyun-Seok;Song, Sang-Min;Han, Ki-Eun
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.1009-1014
    • /
    • 2009
  • Meta-thinking is a kind of thinking beyond certain scope or border, which sees objects as an expanded definition exceeding its essence. It can be experienced when people come into contact with new things. As for digital media, experience acquired from computer screen makes users' thinking be changed continuously and help their thinking to be expanded. Today, studies on development of digital technology regarding virtual reality (VR) and experience obtained from digital media become a topic of conversation, however, this experience depends on the sense of sight through screen. Actually, transparent experiences in digital media are not the same with those in real world, therefore, this study investigated experience expansion through interaction with real things which are much closer to daily lives than virtual experiences. It can be found in media art which induces positive participation of audiences and shows them a new meaning through delight and amusement experienced in the process of interaction. Visual expression in digital media should be more than spectacular which is only full of excessive images. In addition, interface should not be remained as an expression from technological attempts, instead, it is necessary to find humans aspiration with meta-thinking which accepts things expansively and visualize their experiences.

  • PDF

Efficient Label Placement using Overlap-free Region and Background Analysis (중첩 자유 영역과 배경 분석을 이용한 효율적인 라벨 배치)

  • Lee, San-Won;Jeong, Seung-Do;Choi, Byung-Uk
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.43 no.6 s.312
    • /
    • pp.85-96
    • /
    • 2006
  • This paper deal with a method for efficient placing 2 dimensional virtual labels on the view plane. The proposed method has suitable computational costs for realtime processing and it overcomes the local minima problem which is not solved in previous automatic label placement algorithms, and also it enhances readability by placing labels in less congestion area on the view plane. Background analysis must be considered for label placement. However previous works do not concern with this problem seriously. And furthermore, automatic label placement algorithm and background analysis algorithm have been studied separately in their own field. This paper proposed the background analysis method using background color and texture component to enhance readability, and it is the first research about analyzing the background of color image and applying it in automatic label placement field. This paper shown improved placement performance through combining automatic label placement algorithm and background analysis algorithm organically, and various experiments verified it.

Concept and Characteristics of Intelligent Science Lab (지능형 과학실의 개념과 특징)

  • Hong, Oksu;Kim, Kyoung Mi;Lee, Jae Young;Kim, Yool
    • Journal of The Korean Association For Science Education
    • /
    • v.42 no.2
    • /
    • pp.177-184
    • /
    • 2022
  • This article aims to explain the concept and characteristics of the 'Intelligent Science Lab', which is being promoted nationwide in Korea since 2021. The Korean Ministry of Education creates a master plan containing a vision for science education every five years. The most recently announced '4th Master plan for science education (2020-2024)' emphasizes the policy of setting up an 'intelligent science lab' in all elementary and secondary schools as an online and offline space for scientific inquiry using advanced technologies, such as Internet of Things and Augmented and Virtual Reality. The 'Intelligent Science Lab' project is being pursued in two main directions: (1) developing an online platform named 'Intelligent Science Lab-ON' that supports science inquiry classes, and (2) building a science lab space in schools that encourages active student participation while utilizing the online platform. This article presents the key features of the 'Intelligent Science Lab-ON' and the characteristics of intelligent science lab spaces newly built in schools. Furthermore, it introduces inquiry-based science learning programs developed for intelligent science labs. These programs include scientific inquiry activities in which students generate and collect data ('data generation' type), utilize datasets provided by the online platform ('data utilization' type), or utilize open and public data sources ('open data source' type). The Intelligent Science Lab project is expected to not only encourage students to engage in scientific inquiry that solves individual and social problems based on real data, but also contribute to presenting a model of online and offline linked scientific inquiry lessons required in the post-COVID-19 era.