• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.5
• /
• pp.465-472
• /
• 2009

This paper proposes a multimodal information transformation system that converts the image information to the voice information to provide the sight impaired people with walking area and obstacles, which are extracted by an acquired image from a single CCD camera. Using a chain-code line detection algorithm, the walking area is found from the vanishing point and boundary of a sidewalk on the edge image. And obstacles are detected by Gabor filter of extracting vertical lines on the walking area. The proposed system expresses the voice information of pre-defined sentences, consisting of template words which mean walking area and obstacles. The multi-modal information transformation system serves the useful voice information to the sight impaired that intend to reach their destination. The experiments of the proposed algorithm has been implemented on the indoor and outdoor environments, and verified its superiority to exactly provide walking parameters sentences.

• Journal of Digital Convergence
• /
• v.13 no.6
• /
• pp.151-156
• /
• 2015

In this paper, we have proposed personal multimodal biometric authentication system based on face detection, recognition and speaker verification for smart-phone environment. Proposed system detect the face with Modified Census Transform algorithm then find the eye position in the face by using gabor filter and k-means algorithm. Perform preprocessing on the detected face and eye position, then we recognize with Linear Discriminant Analysis algorithm. Afterward in speaker verification process, we extract the feature from the end point of the speech data and Mel Frequency Cepstral Coefficient. We verified the speaker through Dynamic Time Warping algorithm because the speech feature changes in real-time. The proposed multimodal biometric system is to fuse the face and speech feature (to optimize the internal operation by integer representation) for smart-phone based real-time face detection, recognition and speaker verification. As mentioned the multimodal biometric system could form the reliable system by estimating the reasonable performance.

• THE INTERNATIONAL COMMERCE & LAW REVIEW
• /
• v.13
• /
• pp.303-328
• /
• 2000

International Trade has led to the increase of the demand of international transport, and also the development of transport vehicles has been promoting the volumes of international trade. Therefore, the development of international transport not only incurs claims concerning transportation but also establishes various international rules to settle the claims between the shippers and the carriers in the course of transport. With a view to settling the claims successfully, the men who are concerned in the transport have to know the principle and scope of carrier's Liability. In this paper, I would like to find out the principle of Liability for the shippers. Therefore, I classify the Liability principle of the international transporter under the UNs Convention on International Multimodal Transport of Good(1980) and UNCTDAD/ICC Rules(1991) in three system - Network Liability System, Uniform Liability System and Modified Uniform Liability System.

• ETRI Journal
• /
• v.37 no.4
• /
• pp.793-803
• /
• 2015

We propose a novel HMI UI/UX for an in-vehicle infotainment system. Our proposed HMI UI comprises multimodal interfaces that allow a driver to safely and intuitively manipulate an infotainment system while driving. Our analysis of a touchscreen interface-based HMI UI/UX reveals that a driver's use of such an interface while driving can cause the driver to be seriously distracted. Our proposed HMI UI/UX is a novel manipulation mechanism for a vehicle infotainment service. It consists of several interfaces that incorporate a variety of modalities, such as speech recognition, a manipulating device, and hand gesture recognition. In addition, we provide an HMI UI framework designed to be manipulated using a simple method based on four directions and one selection motion. Extensive quantitative and qualitative in-vehicle experiments demonstrate that the proposed HMI UI/UX is an efficient mechanism through which to manipulate an infotainment system while driving.

• The Journal of Information Systems
• /
• v.32 no.3
• /
• pp.1-17
• /
• 2023

Purpose The proliferation of data on the internet has created a need for innovative methods to analyze user satisfaction data. Traditional survey methods are becoming inadequate in dealing with the increasing volume and diversity of data, and new methods using unstructured internet data are being explored. While numerous comment-based user satisfaction studies have been conducted, only a few have explored user satisfaction through video and audio data. Multimodal sentiment analysis, which integrates multiple modalities, has gained attention due to its high accuracy and broad applicability. Design/methodology/approach This study uses multimodal sentiment analysis to analyze user satisfaction of iPhone and Samsung products through online videos. The research reveals that the combination model integrating multiple data sources showed the most superior performance. Findings The findings also indicate that price is a crucial factor influencing user satisfaction, and users tend to exhibit more positive emotions when content with a product's price. The study highlights the importance of considering multiple factors when evaluating user satisfaction and provides valuable insights into the effectiveness of different data sources for sentiment analysis of product reviews.

• Journal of Navigation and Port Research
• /
• v.35 no.6
• /
• pp.523-531
• /
• 2011

The recent increase in international car-ferry lines between Korea and Japan as well as China brings needs for proper transportations of special cargo, such as machinery and luxury yacht, etc. International multimodal transport, especially international car ferry through truck-sea-truck system enables to fulfill shippers' needs for "Door to Door Service", of such special goods. However, this international multimodal transport of bulk cargo will cause a possible claim for concealed damages during such transportation. For this reason, this study aims to examine the liability system of the multimodal transport operator as well as to investigate liability for concealed damages theoretically and finally to seek proper measures for them. Futhermore, this paper intends to verify the claims for concealed damages to further the international multimodal transport by car ferries between Korea and Japan.

• Journal of the Korea Society of Computer and Information
• /
• v.14 no.2
• /
• pp.181-190
• /
• 2009

This paper presents a multimodal emergency recognition system based on visual information, audio information and gravity sensor information. It consists of video processing module, audio processing module, gravity sensor processing module and multimodal integration module. The video processing module and gravity sensor processing module respectively detects actions such as moving, stopping and fainting and transfer them to the multimodal integration module. The multimodal integration module detects emergency by fusing the transferred information and verifies it by asking a question and recognizing the answer via audio channel. The experiment results show that the recognition rate of video processing module only is 91.5% and that of gravity sensor processing module only is 94%, but when both information are combined the recognition result becomes 100%.

• Proceedings of the KSPS conference
• /
• 2006.11a
• /
• pp.120-123
• /
• 2006

The provision of personalized user interfaces for mobile devices is expected to be used for different devices with a wide variety of capabilities and interaction modalities. In this paper, we implemented a multimodal context-aware middleware incorporating XML-based languages such as XHTML, VoiceXML. SCXML uses parallel states to invoke both XHTML and VoiceXML contents as well as to gather composite multimodal inputs or synchronize inter-modalities through man-machine I/Os. We developed home networking service named "HomeN" based on our middleware framework. It demonstrates that users could maintain multimodal scenarios in a clear, concise and consistent manner under various user's interactions.

• ETRI Journal
• /
• v.44 no.2
• /
• pp.300-312
• /
• 2022

Recently, public safety services have attracted significant attention for their ability to protect people from crimes. Rapid detection of dangerous situations (that is, abnormal situations where someone may be harmed or killed) is required in public safety services to reduce the time required to respond to such situations. This study proposes a novel danger detection technology based on multimodal data, which includes data from multiple sensors (for example, accelerometer, gyroscope, heart rate, air pressure, and global positioning system sensors), and multilog data, which includes contextual logs of humans and places (for example, contextual logs of human activities and crime-ridden districts) over time. To recognize human activity (for example, walk, sit, and punch), the proposed technology uses multimodal data analysis with an attitude heading reference system and long short-term memory. The proposed technology also includes multilog data analysis for detecting whether recognized activities of humans are dangerous. The proposed danger detection technology will benefit public safety services by improving danger detection capabilities.

• East Asian Journal of Business Economics (EAJBE)
• /
• v.10 no.2
• /
• pp.55-69
• /
• 2022

Purpose - This study is a study to investigate the problem of the selection of means of transportation in international logistics by studying the basics of logistics activities, selection factors of transportation methods, and multimodal transportation. Research design, data, methodology - This study is composed of 5 chapters through literature study. Chapter 1 describes the functions and transportation system of international logistics, Chapter 2 selects transportation, Chapter 3 deals with maritime transportation and multimodal transportation, Chapter 4 describes multimodal transportation in terms of customer service, Chapter 5 addresses the implications and conclusions. Results - When looking at the problem of selecting a means of transportation, it is important that the parties involved in the transportation choose which means of transportation for their convenience and profit during the transportation process. Here, there will be factors to consider, including transportation cost, when selecting a means of transportation, and each means of transportation may have characteristics or advantages and disadvantages. Considering all these points, the adoption of multimodal transportation from a customer service point of view may be the answer. Conclusions - This study pays attention to the academic understanding related to the selection of means of transportation and to how usefully this thesis can be used in the selection of transportation related persons, especially shippers, from a practical level.