• MALSORI
• /
• no.58
• /
• pp.101-117
• /
• 2006

The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

• Journal of the Korean Chemical Society
• /
• v.61 no.4
• /
• pp.211-217
• /
• 2017

The purpose of this study was to examine UK students' use of multimodal representations in science. Students were asked to explain their understandings of the scientific concept and presentation of the multimodal representations in a science Assessing Pupils' Progress (APP) task. Participants of this study were fifty-four Year 7 students taught by the same teacher. Students from one class (27 students) were assigned to the experimental group, and then they received instruction encouraging the using of multimodal representations as evidences to support students' claims. One class (27 students) was assigned to the control group and they received instruction with traditional teaching methods. Both groups performed an APP task for assessment. The samples of APP assessments produced by students both from the experimental and control groups were analyzed using an analysis framework of multimodal representations, embeddedness in evidence and understanding of scientific concepts. Data analysis indicated that the students in the experimental group performed better than that of the control group on embeddedness of multimodal representations in the APP task. In addition, there was a significant difference between the two groups in the evaluation of understand of the scientific concepts.

• Journal of the Korean Society of Industry Convergence
• /
• v.9 no.4
• /
• pp.263-268
• /
• 2006

This paper presents a real-time verification system by extracting a features of multimodal biometrics using hybrid method, which is combined the moment balance and the independent component analysis(ICA). The moment balance is applied to reduce the computation loads by extracting the validity signal due to exclude the needless backgrounds of multimodal biometrics. ICA is also applied to increase the verification performance by removing the overlapping signals due to extract the statistically independent basis of signals. Multimodal biometrics are used both the faces and the fingerprints which are acquired by Web camera and acquisition device, respectively. The proposed system has been applied to the fusion problems of 48 faces and 48 fingerprints(24 persons * 2 scenes) of 320*240 pixels, respectively. The experimental results show that the proposed system has a superior verification performances(speed, rate).

• Korean Journal of Child Studies
• /
• v.34 no.4
• /
• pp.163-177
• /
• 2013

Digital technology has advanced rapidly and it is anticipated that multimodal ways of meaning-making will become increasingly important. Consequently, teaching multimodal literacies is becoming a major issue in education. This study focuses on the use of picture diaries as a means of teaching multimodal literacies. Picture diaries are one of the basic and unique multimodal texts used in lower elementary level classes in Korea. A further advantage is that it is a promising text model which can be taught in unplugged ways. In order to explore the educational implications of using such picture diaries, this study sought to analyze the ways in which twenty four $1_{st}$ graders in an elementary school constructed meaning with written language and pictures in composing picture diaries. 251 picture diaries composed during several months of their $1_{st}$ grade period were analyzed based on the constant comparative method. The results indicated that the students utilized both written language and pictures in diverse and creative ways to provide their audience with more comprehensive meaning. These results indicate that teachers need to consider their students as active multimodal meaning-makers and provide their students with more opportunities to practice multimodal meaning-making and share their experiences.

• Journal of the Korean Institute of Navigation
• /
• v.19 no.4
• /
• pp.41-61
• /
• 1995

The international trade is basically founded on the contract of international sale of goods and backed up by the contract of international carriage of goods and the contract of insurance in the goods carried. For the efficient development of international trade, it is essential to incorporate the above three fields closely together. Economic growth has developed international trade which has accelerated the development of international carriage of goods. As a result of rapid expansion of international carriage of goods, rationalization of transport was required, which has brought about the International Multimodal Transport System(herein after referred to as 'IMT') through containerization. International multimodal transport system has affected international trade a lot, especially the field of insurance a great deal. The aim of this paper is to analyze contents of Multimodal Transport Operator's(MTO's) liability system in the UN Convention on International Multimodal Transport of Goods, 1980 and FIATA Bill of Lading(FBL) as one of current Multimodal Transport Documents. The analysis of MTO's liability system will be a good introductory concept for the further study of insurance problems for the development of IMT.

• The Journal of Information Systems
• /
• v.32 no.3
• /
• pp.1-17
• /
• 2023

Purpose The proliferation of data on the internet has created a need for innovative methods to analyze user satisfaction data. Traditional survey methods are becoming inadequate in dealing with the increasing volume and diversity of data, and new methods using unstructured internet data are being explored. While numerous comment-based user satisfaction studies have been conducted, only a few have explored user satisfaction through video and audio data. Multimodal sentiment analysis, which integrates multiple modalities, has gained attention due to its high accuracy and broad applicability. Design/methodology/approach This study uses multimodal sentiment analysis to analyze user satisfaction of iPhone and Samsung products through online videos. The research reveals that the combination model integrating multiple data sources showed the most superior performance. Findings The findings also indicate that price is a crucial factor influencing user satisfaction, and users tend to exhibit more positive emotions when content with a product's price. The study highlights the importance of considering multiple factors when evaluating user satisfaction and provides valuable insights into the effectiveness of different data sources for sentiment analysis of product reviews.

• Journal of Animal Science and Technology
• /
• v.63 no.6
• /
• pp.1443-1452
• /
• 2021

This study aimed to investigate the effects of the multimodal group intervention that combined animal-assisted therapy (AAT) and integrated play therapy (IPT) on depression and self-esteem in undergraduate university students. The subjects were 40 students attending animal-related and social welfare departments of universities located in a metropolitan city. The multimodal intervention program was conducted for eight sessions (twice a week, 60 min each) in the experimental group. Data analysis was conducted using the independent sample t-test, ANCOVA, and paired sample t-test for pre- and post-test. Therefore, the multimodal intervention program applying AAT and IPT showed positive effects on depression and self-esteem in university students. Based on these results, this study proposed the operation of multidisciplinary education and practical and policy utilization methods to reduce depression among university students and help improve their self-esteem.

• International Journal of Highway Engineering
• /
• v.17 no.2
• /
• pp.123-134
• /
• 2015

PURPOSES : The key point of a multimodal LOS (level-of-service) evaluation system is that all of the modes are mutually associated to determine each mode's LOS. For example, the LOS of the bicycle mode is measured based on not only bicycle volumes, but also automobile volumes. However, the Korea Highway Capacity Manual (KHCM) still focuses on the automobile mode in evaluating the LOS of the roads. Additionally, the KHCM's LOS of the other modes, except for the automobile, is not consistent with actual road conditions. The KHCM, therefore, needs to develop and introduce a multimodal LOS system in order to evaluate the service conditions more accurately. METHODS: As a preliminary step to the introduction of multimodal LOS research, in this study the current problem of the KHCM's LOS system through a close review and comparison with other HCMs (highway capacity manuals) was identified. Secondly, a field survey and investigation of the urban streets to apply the HCM's multimodal LOS system was conducted. Finally, a comparison analysis of the results of the HCM and KHCM LOS was performed. RESULTS: In the study, it was found that the results of the LOS for the automobile mode did not show a significant difference between the HCM and KHCM. However, the LOS of the bicycle and pedestrian mode tended to be worse in the multimodal LOS system, which results from considering the effects of the automobile mode. Moreover, it was found that many cases have the potential to improve the overall LOS conditions, while reducing the automobile capacity. CONCLUSIONS: With the introduction of the multimodal LOS system, road diet and complete streets can be easily applied to ans actual road improvement project. Ultimately, the multimodal LOS system should be introduced into the KHCM, which can then be applied to traffic impact studies and other road improvement projects for more accurate evaluations.

• Journal of the Korean Chemical Society
• /
• v.56 no.4
• /
• pp.500-508
• /
• 2012

The purpose of this study was to investigate the impact of multimodal representation-based lesson on embeddedness of multimodal representation in high school students' writing. The participants in this study were two groups of second-year science-track students (74 students) at an academic high school in a metropolitan city. One group (41 students) was assigned to the experimental group, the other group (33 students) was assigned to the comparative group. Data analysis showed that the students of the experimental group were better at utilizing and embedding multimodal representations. Thus, the conclusion was drawn that multimodal representation-based lesson had an effect on high school students' embeddedness of multimodal representation.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2004.04a
• /
• pp.421-426
• /
• 2004

Increasing of the multinational corporation brought into the international multimodal Increasing of the multinational corporation brought into the international multimodal transport on the logistics environment. In case of Europe which have a great infrastructure, they are tried to develope a second of the silk road constantly. This paper emphasized the importance of international multimodal transport and proposed the model for northeast multimodal transport. For this research, we analyzed the multimodal transport system in Europe and north corridor of TAR. We are expecting economic effect of the route is including republic of korea and developed a model for connecting with sea, air and road. Actually, this research can not be enough data of numerical value for proving this effectiveness. but we developed and proposed a specific route of multimodal transport that was never suggested. Consequently, we established basic ground for comparing each transport route in the future research.