• MALSORI
• /
• no.51
• /
• pp.117-135
• /
• 2004

In this paper, we introduce the multimodal user interface technology, especially based on speech. We classify multimodal interface technologies into four classes: sequential, alternate, supplementary, and semantic multimodal interfaces. After introducing four types of multimodal interfaces, we explain standard activities currently being activated.

• MALSORI
• /
• no.67
• /
• pp.103-120
• /
• 2008

Basic components for multimodal interface, such as speech recognition, speech synthesis, gesture recognition, and multimodal fusion, have their own technological limitations. For example, the accuracy of speech recognition decreases for large vocabulary and in noisy environments. In spite of those technological limitations, there are lots of applications in which speech-oriented multimodal user interfaces are very helpful to users. However, in order to expand application areas for speech-oriented multimodal interfaces, we have to develop the interfaces focused on usability. In this paper, we introduce usability and user-centered design methodology in general. There has been much work for evaluating spoken dialogue systems. We give a summary for PARADISE (PARAdigm for Dialogue System Evaluation) and PROMISE (PROcedure for Multimodal Interactive System Evaluation) that are the generalized evaluation frameworks for voice and multimodal user interfaces. Then, we present usability components for speech-oriented multimodal user interfaces and usability testing guidelines that can be used in a user-centered multimodal interface design process.

• Journal of the Ergonomics Society of Korea
• /
• v.25 no.2
• /
• pp.135-146
• /
• 2006

Multimodal interfaces are recognition-based technologies that interpret and encode hand gestures, eye-gaze, movement pattern, speech, physical location and other natural human behaviors. Modality is the type of communication channel used for interaction. It also covers the way an idea is expressed or perceived, or the manner in which an action is performed. Multimodal Interfaces are the technologies that constitute multimodal interaction processes which occur consciously or unconsciously while communicating between human and computer. So input/output forms of multimodal interfaces assume different aspects from existing ones. Moreover, different people show different cognitive styles and individual preferences play a role in the selection of one input mode over another. Therefore to develop an effective design of multimodal user interfaces, input/output structure need to be formulated through the research of human cognition. This paper analyzes the characteristics of each human modality and suggests combination types of modalities, dual-coding for formulating multimodal interaction. Then it designs multimodal language and input synchronization method according to the granularity of input synchronization. To effectively guide the development of next-generation multimodal interfaces, substantially cognitive modeling will be needed to understand the temporal and semantic relations between different modalities, their joint functionality, and their overall potential for supporting computation in different forms. This paper is expected that it can show multimodal interface designers how to organize and integrate human input modalities while interacting with multimodal interfaces.

• MALSORI
• /
• no.58
• /
• pp.101-117
• /
• 2006

The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.77
• /
• pp.145-168
• /
• 2018

The purpose of this paper is to introduce the limitation of liabilities of multimodal transport operators(MTO) in Korea. Also, this paper reviews the revised draft of Korean Commercial Code in 2015. This paper analyzes Korean multimodal transport systemand the limitation of liabilities of MTO by analyzing articles, regulations and practices of Korean Commercial Code and it's the draft in 2015. The paper, also, studies multimodal transport rules by comparing specifically international treaty, rules, or practices. In Korea, Article 816 of Commercial Code treats multimodal transportation adopting the network liability regime. The Article describes only the case of the multimodal transportation where the maritime carriage is engaged. Korea proposed the draft of multimodal transport regulation of Commercial Code in 2015 because present law could not apply for the multimodal transportation involved in the air or land carriage. This paper support the draft of Korean Commercial Code in 2015 because it is necessary to make a predictable legal system of multimodal transport and the limitation of liability reflecting practices or customs.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.39 no.2
• /
• pp.147-154
• /
• 2002

In this paper, we propose an error estimation method based on the Bhattacharyya distance for multimodal data. First, we try to find the empirical relationship between the classification error and the Bhattacharyya distance. Then, we investigate the possibility to derive the error estimation equation based on the Bhattacharyya distance for multimodal data. We assume that the distribution of multimodal data can be approximated as a mixture of several Gaussian distributions. Experimental results with remotely sensed data showed that there exist strong relationships between the Bhattacharyya distance and the classification error and that it is possible to predict the classification error using the Bhattacharyya distance for multimodal data.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.46
• /
• pp.181-210
• /
• 2010

The continuing advance of multimodal transport with the importance for efficient and effective logistics management emphasizes the need for uniform legal approach to international multimodal transport. However, the current fragmented instrument regulating such transport is being an obstacle to development of multimodal transport as it aggravates confusion and uncertainty. The Rotterdam rules, which was adopted in December 2008 by UNCITRAL, expands its scope of application to door-to-door transport. However, the new rules has some problems in its application to multimodal transport operation as it has been conceived not to regulate general multimodal carriage but to regulate contract of carriage by sea that extends its services to the transport by other modes. This article examines conflict of conventions in the Rotterdam Rules. The applicability of the Rotterdam Rules in international multimodal transport contract and possibility of potential conflict with other transport conventions are analyzed with some hypothetical cases. Furthermore, problems arising from application of the Rotterdam Rules under international multimodal transport Contracts are indicated in the chapter IV.

• International Commerce and Information Review
• /
• v.7 no.4
• /
• pp.219-243
• /
• 2005

The Purpose of this Article is to analyze the examination criteria on the compliance of multimodal transport document in the ISBP. When the goods are taken in charge by the multimodal transport operator, he shall issue a multimodal transport document which, at the option of the consignor, shall be in either negotiable or non-negotiable form. The multimodal transport document shall be signed by the multimodal transport operator or by a person having authority from him. When the multimodal transport document is presented by the beneficiary to the bank in the letter of credit operations, the bank should examinate the bill of exchange and/or shipping documents, including multimodal transport document. There are two rules in connection with examination of the documents in the letter of credit operations. One is the "Uniform Customs and Practice for Documentary Credits(UCP 500)" approved by the Banking Commission in March 10, 1993, the other is the "International Standard Banking Practice for the Examination of Documents under Documentary Letters of Credits(ISBP)" approved by the ICC Banking Commission in October 2002. Therefore, this Article has studied the multimodal transport document presented under documentary credits on the basis of the UCP 500 and the ISBP it reflects.

• English Language & Literature Teaching
• /
• v.17 no.4
• /
• pp.229-250
• /
• 2011

Despite the social turn in literacy studies, few empirical studies have investigated the practical applications and learning experiences of multimodal composition pedagogy. Using a qualitative research approach, this study examines undergraduates' experiences in producing multimodal texts. Findings report that students' experiences in a multimodal composition class epitomize enjoyable learning. Students enjoyed their learning process because (a) the multimodal literacy curriculum filled the pedagogical gap between the conventional school-sponsored alphabetic literacy pedagogy and widespread out-of-school multimodal literacy practices and (b) the usefulness of the curriculum helped students enhance their intrinsic motivation to learn and compose. By questioning fundamental assumptions about what counts as knowledge in the current ecology of literacies, the authors argue for a dynamic view of literacy into practice.

• International Commerce and Information Review
• /
• v.9 no.2
• /
• pp.285-303
• /
• 2007

As the interest about smooth logistics increases lately, the importance of multimodal transport, which performs the key role of logistics emerges, Through there are many issues respecting multimodal transport, the issue of the efficiency of multimodal transport seems to be the most importance. This paper examine as to the problems & systems of the multimodal transport including transportation document and customs clearance for door to door services. I wish our country will use total logistics automation systems for encouraging multimodal transport chance and make a partial amendment of commercial code including the customs clearance regulation. This study will assist in the development of logistic and the enlargement of multimodal transport transaction.