• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.80-85
• /
• 2024

The concept of single-modal digital art originated in the 20th century and has evolved through three key stages. Over time, digital art has transformed into multi-modal interaction, representing a new era in art forms. Based on multi-modal theory, this paper aims to explore the characteristics of interactive digital art in innovative art forms and its impact on user experience. Through an analysis of practical application of multi-modal interactive digital art, this study summarises the impact of creative models of digital art on the physical and mental aspects of user experience. In creating audio-visual-based art, multi-modal digital art should seamlessly incorporate sensory elements and leverage computer image processing technology. Focusing on user perception, emotional expression, and cultural communication, it strives to establish an immersive environment with user experience at its core. Future research, particularly with emerging technologies like Artificial Intelligence(AR) and Virtual Reality(VR), should not merely prioritize technology but aim for meaningful interaction. Through multi-modal interaction, digital art is poised to continually innovate, offering new possibilities and expanding the realm of interactive digital art.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.7
• /
• pp.315-324
• /
• 2023

A simple and accurate whole body rehabilitation interaction technology using immersive digital content is needed for elderly patients with steadily increasing age-related diseases. In this study, we introduce whole-body interaction technology using HoloLens and Kinect for this purpose. To achieve this, we propose three coordinate transformation methods: mesh feature point-based transformation, AR marker-based transformation, and body recognition-based transformation. The mesh feature point-based transformation aligns the coordinate system by designating three feature points on the spatial mesh and using a transform matrix. This method requires manual work and has lower usability, but has relatively high accuracy of 8.5mm. The AR marker-based method uses AR and QR markers recognized by HoloLens and Kinect simultaneously to achieve a compliant accuracy of 11.2mm. The body recognition-based transformation aligns the coordinate system by using the position of the head or HMD recognized by both devices and the position of both hands or controllers. This method has lower accuracy, but does not require additional tools or manual work, making it more user-friendly. Additionally, we reduced the error by more than 10% using RANSAC as a post-processing technique. These three methods can be selectively applied depending on the usability and accuracy required for the content. In this study, we validated this technology by applying it to the "Thunder Punch" and rehabilitation therapy content.

• Journal of Korea Game Society
• /
• v.4 no.3
• /
• pp.11-20
• /
• 2004

Virtual reality that we have seen from the movies in 80's and 90's is hawing near based on the rapid progress of science together with a computer technology. Various virtual reality system developments (such as VRML, HMD FishTank, Wall Type, CAVE Type, and so on) and the advancement of those systems make for the embodiment of virtual reality that gives more sense of the real. Virtual reality is so immersive that makes people feel like they are in that environment and enable them to manipulate without experiencing the environment at first hand that is hard to experience in reality. Virtual reality can be applied to the spheres, such as education, high-level programming, remote control, surface exploration of the remote satellite, analysis of exploration data, scientific visualization, and so on. For some connote examples, there are training of a tank and an aeroplane operation, fumiture layout design, surgical operation practice, game, and so on. In these virtual reality systems, the actual operation of the human participant and virtual workspace are connected each other to the hardware that stimulates the five senses adequately to lend the sense of the immersion. There are still long way to go, however, before long it will be possible to have the same feeling in the virtual reality as human being can have by further study and effort. In this thesis, the basic definition, the general idea, and the kind of virtual reality were discussed. Especially, CAVE typed in reality that is highly immersive was analyzed in definition, and then the method of VR programming and modeling in the virtual reality system were suggested by showing the restoration process of Kyongbok Palace (as the content of the original form of the culture) that was made by KISTI(Korea Institute of Science and Technology Information) in 2003 through design process in virtual reality system. Through these processes, utilization of the immersive virtual reality system was discussed and how to take advantage of this CAVE typed virtual reality system at the moment was studied. In closing the problems that had been exposed in the process of the restoration of the cultural property were described and the utilization plan of the virtual reality system was suggested.

• Cartoon and Animation Studies
• /
• s.50
• /
• pp.101-130
• /
• 2018

Since the advent of the Smart Devices, the smartphone has become a popular tool to view Webtoon. This phenomenon has caused the convergence of cutting-edge technologies and Webtoons in diverse forms, creating unique versions of Webtoons including, but not limited to Smart-toon, Effect-toon, Cut-toon, Dubbing-toon, Moving-toon, AR-toon, VR-toon, and Interaction-toon. By comparison to these rich diversities of Webtoons in the online industry, there is a lack of academic research on this topic. There are some papers which talk about the different types of multimedia technology conversion and its case presentation or the effectiveness and problems of visual effect, but the effects of these convergence technologies on comic readers' concentration and reading effectiveness have never been investigated so far. Therefore, this paper will discuss the unique method of immersive storytelling that is often used in comics and analyze each aspects of immersive method in technology-converged Webtoons along with its problems. Furthermore, this paper will analyze different aspects of "immersion" and interaction elements that can be found in the popular Interaction-toon, (Encountered). Through this, this paper discusses the positive influence of the interaction elements on comic readers' immersion level and its limitation. To classify the technology-converged Webtoons in terms of the immersion level, the Effect-toon sometimes interferes viewer's flow by using excessive use of multimedia effect, creating information overload. The Smart-toon which applied motions to each frame under horizontal mode of smartphones was a good try, but it hindered the readers' activeness and made it hard for the readers to be fully absorbed in the story. The VR-toon, which utilizes virtual reality gadgets to allow viewers to explore the world of Webtoon was also a nice try to overcome the limitation of vertical screens. However, it often caused dispersion of user's attention and reduced the users' immersion level. The Moving-toon which only emphasized the reading convenience also invaded readers' activeness and disturb users' concentration. On the other hand, the cartoonist Il-Kwon Ha applied high technologies such as face recognition technology, augmented reality techniques, 360-degree panorama technology, and haptic technology to his cartoon (Encountered). This allowed the readers to form a sense of closeness towards the cartoon characters which let the readers to identify themselves with the characters and interact with them. By this way, the readers can be fully immersed in the story. However, technology abuse, impractical production and hackneyed storylining often showed later in the story remains as its limitations.

• Journal of the Korea Computer Graphics Society
• /
• v.21 no.1
• /
• pp.1-11
• /
• 2015

Researchers have developed virtual reality environments to provide audience with more visually immersive experiences than previously possible. One of the most popular solutions to build the immersive VR space is a multi-projection technique. However, utilization of multiple projectors requires large spaces, expensive cost, and accurate geometry calibration among projectors. This paper presents a novel omnidirectional projection system with a single projector and a single spherical mirror.We newly designed the simple and intuitive calibration system to define the shape of environment and the relative position of mirror/projector. For successful image projection, our optimized omnidirectional image generation step solves image distortion produced by the spherical mirror and a calibration problem produced by unknown parameters such as the shape of environment and the relative position between the mirror and the projector. Additionally, the focus correction is performed to improve the quality of the projection. The experiment results show that our method can generate the optimized image given a normal panoramic image for omnidirectional projection in a rectangular space.

• Journal of Broadcast Engineering
• /
• v.27 no.4
• /
• pp.548-560
• /
• 2022

Video based Point Cloud Compression (V-PCC) is one of the compression methods for compressing point clouds, and shows high efficiency in dynamic point cloud compression with movement due to the feature of compressing point cloud data using an existing video codec. Accordingly, V-PCC is drawing attention as a core technology for immersive content services such as AR/VR. In order to effectively service these V-PCC contents through a media streaming platform, it is necessary to encapsulate them in the existing media file format, ISO based Media File Format (ISOBMFF). However, in order to service through an adaptive streaming platform such as Dynamic Adaptive Streaming over HTTP (DASH), it is necessary to encode V-PCC contents of various qualities and store them in the server. Due to the size of the 2D media, it causes a great burden on the encoder and the server compared to the existing 2D media. As a method to solve such a problem, it may be considered to configure a streaming platform based on content obtained through V-PCC content encoding based on SHVC. Therefore, this paper encapsulates the SHVC-based V-PCC bitstream into ISOBMFF suitable for DASH service and proposes a configuration method to service it. In addition, in this paper, we propose ISOBMFF encapsulation and DASH configuration method to effectively service SHVC-based V-PCC contents, and confirm them through verification experiments.

• Journal of Intelligence and Information Systems
• /
• v.29 no.1
• /
• pp.175-201
• /
• 2023

In the midst of going through a non-face-to-face society, most of human activities narrowed down to the platform, restrictions on external activities are bringing the internal scalability of digital technology. Metaverse is virtually shifting reality and increasing the possibility of utilization in various areas. However, researches linked to the educational effects of metaverse, especially students with disabilities, are still an unknown area that lacks exploration. This paper focuses on the fact that metaverse-education is widening educational fields that meets the various needs of disabled students to realize social good and inclusive education, and communication effects such as resolving barriers to interaction are prominent. As a research method, examining literature research papers linked to AR/VR, metaverse with communication skills, interviews, articles, and columns by experts, and policy suggestions and implications for the special education was conducted. Although the limitations of research are confirmed, significant results are found on inclusive education, which provides educational maximizing effects and realizing human rights through direct immersive experience reflecting the Cone of Experience Theory. Hopefully follow-up studies on meta-edu for disabled students will be carried out in the future, and various interdisciplinary discussions are needed to carefully observe inclusive policies and benefits so that the socially vulnerable are not excluded from technologies in ICT society.

• Trans-
• /
• v.15
• /
• pp.1-24
• /
• 2023

This study examines the application of data visualization technology using a clustered data algorithm called 'Tamed Cloud' to virtual spaces and seeks the possibility of implementing it in various types of realistic exhibition contents. To this end, we first attempt to classify virtual reality (VR) exhibition contents starting with COVID-19, and summarize technologies applied. Also, various realistic exhibition contents provide visitors with an opportunity to appreciate the artworks through online and virtual exhibitions. In this trend, virtual reality and augmented reality (AR) technologies have been introduced, allowing visitors to enjoy the artwork more immersively, and the possibility of realistic exhibition content with interaction between the artwork and the user is also being demonstrated. Based on this background, this study examines the history of exhibition contents by dividing them before and after the advent of virtual reality technology, and examines how the clustered algorithm technology called Tamed Cloud was applied to virtual space and implemented as a realistic exhibition content in <70mK> project. By synthesizing all of this, we propose a convergence method of data visualization, virtual reality, and realistic content, and propose it as a new alternative to realistic exhibition content in virtual space.

• International Journal of Advanced Culture Technology
• /
• v.8 no.2
• /
• pp.116-128
• /
• 2020

In this study, we introduce a multi-modal mixed reality (MR) application for advertising the main touristic landmarks on Jeju Island, and evaluate its effectiveness based on the Technology Acceptance Model (TAM) with a focus on the user's involvement in Korean culture (K-Culture). Specifically, we deployed several stimuli to enable users to retrieve information, visualize a variety of heritage content such as text, images, videos, virtual artifacts, and immerse in a VR environment to experience the heritage locations. The results of the online survey with 436 participants showed that for consumers with low K-Culture involvement, Perceived Usefulness and Perceived Ease-of-Use did not affect their Intention to Visit the island. Still, it had a significant impact on their Intention to Use the application. On the other hand, for the group with high K-Culture involvement, Perceived Usefulness had no effect on the Intention to Use and Intention to Visit. However, Perceived Ease-of-Use had a significant impact on their Intention to Use the application and Intention to Visit Jeju Island. Therefore, when user involvement in K-Culture is high, convenience of use has played a significant role in sensory media usage and the intention to visit, regardless of the usefulness of the mixed reality content. In contrast, users with low K-Culture involvement primarily focused on the functional aspects of the application. These findings open the path for follow-up studies on K-Culture involvement and immersive media tourism marketing, which will benefit digital tourism marketing and Korea's tourism industry.

• Journal of Broadcast Engineering
• /
• v.24 no.1
• /
• pp.25-31
• /
• 2019

360 video is attracting attention as immersive media, and is also considered in VVC (Versatile Video Coding), which is being developed in JVET (Joint Video Expert Team) as a new video coding standard of post-HEVC. A 2D image projected from 360 video for its compression may has discontinuities between the projected faces and inactive regions, and they may cause the visual artifacts in the reconstructed video as well as decrease of coding efficiency. In this paper, we propose a method of efficient geometric padding to reduce these discontinuities and inactive regions in the projection format of SSP (Segmented Sphere Projection). Experimental results show that the proposed method improves subjective quality compared to the existing padding of SSP that uses copy padding with minor loss of coding gain.