• International Journal of Computer Science & Network Security
• /
• v.23 no.3
• /
• pp.31-48
• /
• 2023

The popularization of smart devices and subsequent optimization of their sensing capacity has resulted in a novel mobile crowdsensing (MCS) pattern, which employs smart devices as sensing nodes by recruiting users to develop a sensing network for multiple-task performance. This technique has garnered much scholarly interest in terms of sensing range, cost, and integration. The MCS is prevalent in various fields, including environmental monitoring, noise monitoring, and road monitoring. A complete MCS life cycle entails task allocation, data collection, and data aggregation. Regardless, specific drawbacks remain unresolved in this study despite extensive research on this life cycle. This article mainly summarizes single-task, multi-task allocation, and space-time multi-task allocation at the task allocation stage. Meanwhile, the quality, safety, and efficiency of data collection are discussed at the data collection stage. Edge computing, which provides a novel development idea to derive data from the MCS system, is also highlighted. Furthermore, data aggregation security and quality are summarized at the data aggregation stage. The novel development of multi-modal data aggregation is also outlined following the diversity of data obtained from MCS. Overall, this article summarizes the three aspects of the MCS life cycle, analyzes the issues underlying this study, and offers developmental directions for future scholars' reference.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.5
• /
• pp.1413-1432
• /
• 2023

Recommender systems aim to recommend items to users by taking into account their probable interests. This study focuses on creating a model that utilizes multiple sources of information about users and items by employing a multimodality approach. The study addresses the task of how to gather information from different sources (modalities) and transform them into a uniform format, resulting in a multi-modal feature description for users and items. This work also aims to transform and represent the features extracted from different modalities so that the information is in a compatible format for integration and contains important, useful information for the prediction model. To achieve this goal, we propose a novel multi-modal recommendation model, which involves extracting latent features of users and items from a utility matrix using matrix factorization techniques. Various transformation techniques are utilized to extract features from other sources of information such as user reviews, item descriptions, and item categories. We also proposed the use of Principal Component Analysis (PCA) and Feature Selection techniques to reduce the data dimension and extract important features as well as remove noisy features to increase the accuracy of the model. We conducted several different experimental models based on different subsets of modalities on the MovieLens and Amazon sub-category datasets. According to the experimental results, the proposed model significantly enhances the accuracy of recommendations when compared to SVD, which is acknowledged as one of the most effective models for recommender systems. Specifically, the proposed model reduces the RMSE by a range of 4.8% to 21.43% and increases the Precision by a range of 2.07% to 26.49% for the Amazon datasets. Similarly, for the MovieLens dataset, the proposed model reduces the RMSE by 45.61% and increases the Precision by 14.06%. Additionally, the experimental results on both datasets demonstrate that combining information from multiple modalities in the proposed model leads to superior outcomes compared to relying on a single type of information.

• Journal of the Korea institute for structural maintenance and inspection
• /
• v.16 no.2
• /
• pp.87-94
• /
• 2012

A damage estimation method of wind turbine tower using natural frequency and mode shape is presented for effective condition monitoring. Dynamic analysis for a wind turbine was carried out to obtain the response of tower from which modal properties were identified. A neural network was learned based on training patterns generated by the changes of natural frequency and mode shape due to various damages. The changes of modal property were calculated using a program for modal parameter estimation. Damage locations and severities could be successfully estimated for 10 damage cases including multi-damage cases using the trained neural network. The damage severities for very small damages generally tends to be slightly under-estimated however, the identified damage locations agreed reasonably well with the accurate locations. Enhancement of the estimation result for very small damage and verification of the proposed method through experiment will be carried out by further study.

• Proceedings of the Korean Information Science Society Conference
• /
• 2004.10b
• /
• pp.64-66
• /
• 2004

최근 들어 통신 기술과 센서 기기의 발달로 센서 네트워크에 대한 연구가 활발히 진행되고있다. 특히 센서노드를 통해 데이터를 수집하고 처리하는 기술이 중요한 이슈로 떠오르고 있다. 그러나 기존의 논문에서는 한 종류의 노드에서만 정보를 수집하는 것을 가정하고 있다. 하지만 여러 종류의 센서 노드에서 정보를 수집해야 하는 경우도 발생할 수 있다. 그러므로 본 논문에서는 여러 종류의 센서 노드를 고려한 센서 네트워크 구조를 제안한다. 또한 제안한 네트워크 구조에서 이루어지는 다양한 질의 처리 방법을 제시한다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2019.10a
• /
• pp.1002-1003
• /
• 2019

Face recognition is an extensively researched area of computer vision. Visible, infrared, thermal, and 3D modalities have been used against various challenges of face recognition such as illumination, pose, expression, partial information, and disguise. In this paper we present a multi-modal approach to face recognition using convolutional neural networks. We use visible and thermal face images as two separate inputs to a multi-input deep learning network for face recognition. The experiments are performed on IRIS visible and thermal face database and high face verification rates are achieved.

• IMMUNE NETWORK
• /
• v.20 no.1
• /
• pp.7.1-7.11
• /
• 2020

Cancer immunotherapy, in the form of vaccination, adoptive cellular transfer, or immune checkpoint inhibitors, has emerged as a promising practice within the field of oncology. However, despite the developing field's potential to revolutionize cancer treatment, the presence of immunotherapeutic-resistant tumor cells in many patients present a challenge and limitation to these immunotherapies. These cells not only indicate immunotherapeutic resistance, but also show multi-modal resistance to conventional therapies, abnormal metabolism, stemness, and metastasis. How can immunotherapeutic-resistant tumor cells render multi-malignant phenotypes? We reasoned that the immune-refractory phenotype could be associated with multi-malignant phenotypes and that these phenotypes are linked together by a factor that acts as the master regulator. In this review, we discussed the role of the embryonic transcription factor NANOG as a crucial master regulator we named "common factor" in multi-malignant phenotypes and presented strategies to overcome multi-malignancy in immunotherapeutic-resistant cancer by restraining the NANOG-mediated multi-malignant signaling axis. Strategies that blunt the NANOG axis could improve the clinical management of therapy-refractory cancer.

• The Journal of Society for e-Business Studies
• /
• v.27 no.1
• /
• pp.15-28
• /
• 2022

Due to recent expansion of online market such as clothing, utilizing customer review has become a major marketing measure. User review has been used as a tool of analyzing sentiment of customers. Sentiment analysis can be largely classified with machine learning-based and lexicon-based method. Machine learning-based method is a learning classification model referring review and labels. As research of sentiment analysis has been developed, multi-modal models learned by images and video data in reviews has been studied. Characteristics of words in reviews are differentiated depending on products' and customers' categories. In this paper, sentiment is analyzed via considering review data and metadata of products and users. Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Self Attention-based Multi-head Attention models and Bidirectional Encoder Representation from Transformer (BERT) are used in this study. Same Multi-Layer Perceptron (MLP) model is used upon every products information. This paper suggests a multi-modal sentiment analysis model that simultaneously considers user reviews and product meta-information.

• Structural Engineering and Mechanics
• /
• v.37 no.6
• /
• pp.671-684
• /
• 2011

Deciding on an optimal sensor placement (OSP) is a common problem encountered in many engineering applications and is also a critical issue in the construction and implementation of an effective structural health monitoring (SHM) system. The present study focuses with techniques for selecting optimal sensor locations in a sensor network designed to monitor the health condition of Dalian World Trade Building which is the tallest in the northeast of China. Since the number of degree-of-freedom (DOF) of the building structure is too large, multi-modes should be selected to describe the dynamic behavior of a structural system with sufficient accuracy to allow its health state to be determined effectively. However, it's difficult to accurately distinguish the translational and rotational modes for the flexible structures with closely spaced modes by the modal participation mass ratios. In this paper, a new method of the OSP that computing the mode shape matrix in the weak axis of structure by the simplified multi-DOF system was presented based on the equivalent rigidity parameter identification method. The initial sensor assignment was obtained by the QR-factorization of the structural mode shape matrix. Taking the maximum off-diagonal element of the modal assurance criterion (MAC) matrix as a target function, one more sensor was added each time until the maximum off-diagonal element of the MAC reaches the threshold. Considering the economic factors, the final plan of sensor placement was determined. The numerical example demonstrated the feasibility and effectiveness of the proposed scheme.

• Smart Structures and Systems
• /
• v.6 no.5_6
• /
• pp.579-593
• /
• 2010

Low-power radio frequency (RF) chip transceiver technology and the associated structural health monitoring platforms have matured recently to enable high-rate, lossless transmission of measurement data across large-scale sensor networks. The intrinsic value of these advanced capabilities is the allowance for high-quality, rapid operational modal analysis of in-service structures using distributed accelerometers to experimentally characterize the dynamic response. From the analysis afforded through these dynamic data sets, structural identification techniques can then be utilized to develop a well calibrated finite element (FE) model of the structure for baseline development, extended analytical structural evaluation, and load response assessment. This paper presents a case study in which operational modal analysis is performed on a three-span prestressed reinforced concrete bridge using a wireless sensor network. The low-power wireless platform deployed supported a high-rate, lossless transmission protocol enabling real-time remote acquisition of the vibration response as recorded by twenty-nine accelerometers at a 256 Sps sampling rate. Several instrumentation layouts were utilized to assess the global multi-span response using a stationary sensor array as well as the spatially refined response of a single span using roving sensors and reference-based techniques. Subsequent structural identification using FE modeling and iterative updating through comparison with the experimental analysis is then documented to demonstrate the inherent value in dynamic response measurement across structural systems using high-rate wireless sensor networks.

• Smart Structures and Systems
• /
• v.6 no.5_6
• /
• pp.423-438
• /
• 2010

Wireless smart sensors enable new approaches to improve structural health monitoring (SHM) practices through the use of distributed data processing. Such an approach is scalable to the large number of sensor nodes required for high-fidelity modal analysis and damage detection. While much of the technology associated with smart sensors has been available for nearly a decade, there have been limited numbers of fulls-cale implementations due to the lack of critical hardware and software elements. This research develops a flexible wireless smart sensor framework for full-scale, autonomous SHM that integrates the necessary software and hardware while addressing key implementation requirements. The Imote2 smart sensor platform is employed, providing the computation and communication resources that support demanding sensor network applications such as SHM of civil infrastructure. A multi-metric Imote2 sensor board with onboard signal processing specifically designed for SHM applications has been designed and validated. The framework software is based on a service-oriented architecture that is modular, reusable and extensible, thus allowing engineers to more readily realize the potential of smart sensor technology. Flexible network management software combines a sleep/wake cycle for enhanced power efficiency with threshold detection for triggering network wide operations such as synchronized sensing or decentralized modal analysis. The framework developed in this research has been validated on a full-scale a cable-stayed bridge in South Korea.