• MALSORI
• /
• no.58
• /
• pp.101-117
• /
• 2006

The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

• Proceedings of the KSPS conference
• /
• 2007.05a
• /
• pp.41-44
• /
• 2007

In this paper, we introduce a system in which car navigation scenario is plugged multimodal interface based on multimodal middleware. In map-based system, the combination of speech and pen input/output modalities can offer users better expressive power. To be able to achieve multimodal task in car environments, we have chosen SCXML(State Chart XML), a multimodal authoring language of W3C standard, to control modality components as XHTML, VoiceXML and GPS. In Network Manager, GPS signals from navigation software are converted to EMMA meta language, sent to MultiModal Interaction Runtime Framework(MMI). Not only does MMI handles GPS signals and a user's multimodal I/Os but also it combines them with information of device, user preference and reasoned RDF to give the user intelligent or personalized services. The self-simulation test has shown that middleware accomplish a navigational multimodal task over multiple users in car environments.

• ETRI Journal
• /
• v.37 no.3
• /
• pp.626-636
• /
• 2015

This paper proposes an adaptive multimodal in-vehicle information system for safe driving. The proposed system filters input information based on both the priority assigned to the information and the given driving situation, to effectively manage input information and intelligently provide information to the driver. It then interacts with the driver using an adaptive multimodal interface by considering both the driving workload and the driver's cognitive reaction to the information it provides. It is shown experimentally that the proposed system can promote driver safety and enhance a driver's understanding of the information it provides by filtering the input information. In addition, the system can reduce a driver's workload by selecting an appropriate modality and corresponding level with which to communicate. An analysis of subjective questionnaires regarding the proposed system reveals that more than 85% of the respondents are satisfied with it. The proposed system is expected to provide prioritized information through an easily understood modality.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.5 no.2
• /
• pp.157-163
• /
• 2005

In this paper, we present the multimodal system based on the fusion of two user-friendly biometric modalities: Iris and Face. In order to reach robust identification and verification we are going to combine two different biometric features. we specifically apply 2-D discrete wavelet transform to extract the feature sets of low dimensionality from iris and face. And then to obtain Reduced Joint Feature Vector(RJFV) from these feature sets, Direct Linear Discriminant Analysis (DLDA) is used in our multimodal system. In addition, the Synergetic Neural Network(SNN) is used to obtain matching score of the preprocessed data. This system can operate in two modes: to identify a particular person or to verify a person's claimed identity. Our results for both cases show that the proposed method leads to a reliable person authentication system.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.46
• /
• pp.181-210
• /
• 2010

The continuing advance of multimodal transport with the importance for efficient and effective logistics management emphasizes the need for uniform legal approach to international multimodal transport. However, the current fragmented instrument regulating such transport is being an obstacle to development of multimodal transport as it aggravates confusion and uncertainty. The Rotterdam rules, which was adopted in December 2008 by UNCITRAL, expands its scope of application to door-to-door transport. However, the new rules has some problems in its application to multimodal transport operation as it has been conceived not to regulate general multimodal carriage but to regulate contract of carriage by sea that extends its services to the transport by other modes. This article examines conflict of conventions in the Rotterdam Rules. The applicability of the Rotterdam Rules in international multimodal transport contract and possibility of potential conflict with other transport conventions are analyzed with some hypothetical cases. Furthermore, problems arising from application of the Rotterdam Rules under international multimodal transport Contracts are indicated in the chapter IV.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.5
• /
• pp.162-172
• /
• 2008

In this paper, we propose a multimodal speaker verification method using teeth image and voice as biometric trait for personal verification in mobile terminal equipment. The proposed method obtains the biometric traits using image and sound input devices of smart-phone that is one of mobile terminal equipments, and performs verification with biometric traits. In addition, the proposed method consists the multimodal-fashion of combining two biometric authentication scores for totally performance enhancement, the fusion method is accompanied a weighted-summation method which has comparative simple structure and superior performance for considering limited resources of system. The performance evaluation of proposed multimodal speaker authentication system conducts using a database acquired in smart-phone for 40 subjects. The experimental result shows 8.59% of EER in case of teeth verification 11.73% in case of voice verification and the multimodal speaker authentication result presented the 4.05% of EER. In the experimental result, we obtain the enhanced performance more than each using teeth and voice by using the simple weight-summation method in the multimodal speaker verification system.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2004.04a
• /
• pp.421-426
• /
• 2004

Increasing of the multinational corporation brought into the international multimodal Increasing of the multinational corporation brought into the international multimodal transport on the logistics environment. In case of Europe which have a great infrastructure, they are tried to develope a second of the silk road constantly. This paper emphasized the importance of international multimodal transport and proposed the model for northeast multimodal transport. For this research, we analyzed the multimodal transport system in Europe and north corridor of TAR. We are expecting economic effect of the route is including republic of korea and developed a model for connecting with sea, air and road. Actually, this research can not be enough data of numerical value for proving this effectiveness. but we developed and proposed a specific route of multimodal transport that was never suggested. Consequently, we established basic ground for comparing each transport route in the future research.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.13
• /
• pp.257-281
• /
• 2000

The world economy is becoming increasingly globalized. The globalization has resulted in far reaching agreements to deepen trade liberalization and enlarge its scope to cover new areas in addition to strengthening its supporting institutional base. Economic growth has developed international trade which has accelerated the development of international carriage of goods in 21st century. The international trade is basically founded on the contract of international sale of goods and backed up by the contract of international carriage of goods and the insurance on the goods carried. It is essential to incorporate each other sections for the efficient development of international trade. As a result of rapid expansion of international carriage of goods, rationalization of transport was required, which has brought about the International Multimodal Transport System through containerization. The approach to liability system will be a right way to solve the insurance problems for the development and enlargement of world trade volume. International multimodal transport system has affected international trade a lot, especially the field of insurance a grate deal. This paper is to analyze contents of liability system on Multimodal Transport with in the UN Convention on International Multimodal Transport of goods.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.21 no.3
• /
• pp.253-258
• /
• 2015

The purpose of this study is to find suitable probability distribution function of complex distribution data like multimodal. Normal distribution is broadly used to assume probability distribution function. However, complex distribution data like multimodal are very hard to be estimated by using normal distribution function only, and there might be errors when other distribution functions including normal distribution function are used. In this study, we experimented to find fit probability distribution function in multimodal area, by using AIS(Automatic Identification System) observation data gathered in Mokpo port for a year of 2013. By using chi-squared statistic, gaussian mixture model(GMM) is the fittest model rather than other distribution functions, such as extreme value, generalized extreme value, logistic, and normal distribution. GMM was found to the fit model regard to multimodal data of maritime traffic flow distribution. Probability density function for collision probability and traffic flow distribution will be calculated much precisely in the future.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.757-758
• /
• 2008

This paper aims to propose an emergency recognition system using multimodal information extracted by an image processing module, a voice processing module, and a gravity sensor processing module. Each processing module detects predefined events such as moving, stopping, fainting, and transfer them to the multimodal integration module. Multimodal integration module recognizes emergency situation by using the transferred events and rechecks it by asking the user some question and recognizing the answer. The experiment was conducted for a faint motion in the living room and bathroom. The results of the experiment show that the proposed system is robust than previous methods and effectively recognizes emergency situations at various situations.