• Title/Summary/Keyword: Multimodal model

Search Result 139, Processing Time 0.025 seconds

A Method of Comparing Risk Similarities Based on Multimodal Data (멀티모달 데이터 기반 위험 발생 유사성 비교 방법)

  • Kwon, Eun-Jung;Shin, WonJae;Lee, Yong-Tae;Lee, Kyu-Chul
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2019.05a
    • /
    • pp.510-512
    • /
    • 2019
  • Recently, there have been growing requirements in the public safety sector to ensure safety through detection of hazardous situations or preemptive predictions. It is noteworthy that various sensor data can be analyzed and utilized as a result of mobile device's dissemination, and many advantages can be used in terms of safety and security. An effective modeling technique is needed to combine sensor data generated by smart-phones and wearable devices to analyze users' moving patterns and behavioral patterns, and to ensure public safety by fusing location-based crime risk data provided.

  • PDF

SP-8356, a (1S)-(-)-Verbenone Derivative, Inhibits the Growth and Motility of Liver Cancer Cells by Regulating NF-κB and ERK Signaling

  • Kim, Dong Hwi;Yong, Hyo Jeong;Mander, Sunam;Nguyen, Huong Thi;Nguyen, Lan Phuong;Park, Hee-Kyung;Cha, Hyo Kyeong;Kim, Won-Ki;Hwang, Jong-Ik
    • Biomolecules & Therapeutics
    • /
    • v.29 no.3
    • /
    • pp.331-341
    • /
    • 2021
  • Liver cancer is a common tumor and currently the second leading cause of cancer-related mortality globally. Liver cancer is highly related to inflammation as more than 90% of liver cancer arises in the context of hepatic inflammation, such as hepatitis B virus and hepatitis C virus infection. Despite significant improvements in the therapeutic modalities for liver cancer, patient prognosis is not satisfactory due to the limited efficacy of current drug therapies in anti-metastatic activity. Therefore, developing new effective anti-cancer agents with anti-metastatic activity is important for the treatment of liver cancer. In this study, SP-8356, a verbenone derivative with anti-inflammatory activity, was investigated for its effect on the growth and migration of liver cancer cells. Our findings demonstrated that SP-8356 inhibits the proliferation of liver cancer cells by inducing apoptosis and suppressing the mobility and invasion ability of liver cancer cells. Functional studies revealed that SP-8356 inhibits the mitogen-activated protein kinase and nuclear factor-kappa B signaling pathways, which are related to cell proliferation and metastasis, resulting in the downregulation of metastasis-related genes. Moreover, using an orthotopic liver cancer model, tumor growth was significantly decreased following treatment with SP-8356. Thus, this study suggests that SP-8356 may be a potential agent for the treatment of liver cancer with multimodal regulation.

Multicontents Integrated Image Animation within Synthesis for Hiqh Quality Multimodal Video (고화질 멀티 모달 영상 합성을 통한 다중 콘텐츠 통합 애니메이션 방법)

  • Jae Seung Roh;Jinbeom Kang
    • Journal of Intelligence and Information Systems
    • /
    • v.29 no.4
    • /
    • pp.257-269
    • /
    • 2023
  • There is currently a burgeoning demand for image synthesis from photos and videos using deep learning models. Existing video synthesis models solely extract motion information from the provided video to generate animation effects on photos. However, these synthesis models encounter challenges in achieving accurate lip synchronization with the audio and maintaining the image quality of the synthesized output. To tackle these issues, this paper introduces a novel framework based on an image animation approach. Within this framework, upon receiving a photo, a video, and audio input, it produces an output that not only retains the unique characteristics of the individuals in the photo but also synchronizes their movements with the provided video, achieving lip synchronization with the audio. Furthermore, a super-resolution model is employed to enhance the quality and resolution of the synthesized output.

Multimodal Sentiment Analysis Using Review Data and Product Information (리뷰 데이터와 제품 정보를 이용한 멀티모달 감성분석)

  • Hwang, Hohyun;Lee, Kyeongchan;Yu, Jinyi;Lee, Younghoon
    • The Journal of Society for e-Business Studies
    • /
    • v.27 no.1
    • /
    • pp.15-28
    • /
    • 2022
  • Due to recent expansion of online market such as clothing, utilizing customer review has become a major marketing measure. User review has been used as a tool of analyzing sentiment of customers. Sentiment analysis can be largely classified with machine learning-based and lexicon-based method. Machine learning-based method is a learning classification model referring review and labels. As research of sentiment analysis has been developed, multi-modal models learned by images and video data in reviews has been studied. Characteristics of words in reviews are differentiated depending on products' and customers' categories. In this paper, sentiment is analyzed via considering review data and metadata of products and users. Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Self Attention-based Multi-head Attention models and Bidirectional Encoder Representation from Transformer (BERT) are used in this study. Same Multi-Layer Perceptron (MLP) model is used upon every products information. This paper suggests a multi-modal sentiment analysis model that simultaneously considers user reviews and product meta-information.

A Study on Success Strategies for Generative AI Services in Mobile Environments: Analyzing User Experience Using LDA Topic Modeling Approach (모바일 환경에서의 생성형 AI 서비스 성공 전략 연구: LDA 토픽모델링을 활용한 사용자 경험 분석)

  • Soyon Kim;Ji Yeon Cho;Sang-Yeol Park;Bong Gyou Lee
    • Journal of Internet Computing and Services
    • /
    • v.25 no.4
    • /
    • pp.109-119
    • /
    • 2024
  • This study aims to contribute to the initial research on on-device AI in an environment where generative AI-based services on mobile and other on-device platforms are increasing. To derive success strategies for generative AI-based chatbot services in a mobile environment, over 200,000 actual user experience review data collected from the Google Play Store were analyzed using the LDA topic modeling technique. Interpreting the derived topics based on the Information System Success Model (ISSM), the topics such as tutoring, limitation of response, and hallucination and outdated informaiton were linked to information quality; multimodal service, quality of response, and issues of device interoperability were linked to system quality; inter-device compatibility, utility of the service, quality of premium services, and challenges in account were linked to service quality; and finally, creative collaboration was linked to net benefits. Humanization of generative AI emerged as a new experience factor not explained by the existing model. By explaining specific positive and negative experience dimensions from the user's perspective based on theory, this study suggests directions for future related research and provides strategic insights for companies to improve and supplement their services for successful business operations.

A Feasibility Study of the K-LandBridge through a Linear Programming Model of Minimum Transport Costs (최소운송비용의 선형계획모형을 통한 K-LandBridge의 타당성 연구)

  • Koh, Yong Ki;Seo, Su Wan;Na, Jung Ho
    • Journal of Korea Port Economic Association
    • /
    • v.32 no.3
    • /
    • pp.95-108
    • /
    • 2016
  • China has recently advocated a national strategy called "One Belt One Road" and transferred to execution to refine it into detailed action plans and has continued to fix the complement. However, the Korean Peninsula, including the North Korea remains could not be included at all in the Chinese development policy and framework in terms of the International Logistics. Currently it is raised between Korea-China rail ferry system again and that is when we need to make effective policy development on international multimodal transport system in Northeast Asia. This paper introduces the K-LB (Korea LandBridge) as its execution plan and conducted a feasibility study on this. K-LB consists of a Korea-Russian train ferry system based in Pohang Yeongil New Port(light-wing) and a Korea-China train ferry system based in Saemangeum New Port(left-wing). These two wings are linked to the existing rail system in Korea. This study is convinced that the K-LB is an effective international logistics system in the current terms and conditions and also demonstrated that it is feasible to introduce th K-LB on the peninsula. More strictly speaking, through a linear programming under objective function that minimize the transport cost quantified prior to demonstrate the feasibility, the available ranges and conditions for the transportation costs that are ensured the effectiveness of the K-LB are presented as results. According to the results, if the transport cost of K-LB is cheaper about 34.5% than that of sea transport such as container transport, the object goods may be transported by K-LB on this route. It means that the K-LB system has a competitive advantage due to more rapid customs clearance as well as omitted loading and unloading procedures over container transportation system. It also noted that the threshold level may not be large. Therefore, K-LB has competitive enough to prove its introduction in the Northeast Asian logistics system.

Forecasting and Suggesting the Activation Strategies for Sea & Air Transportation between Korea and China (한·중 간 Sea & Air 물동량 전망 및 활성화 방안에 관한 연구)

  • Jung, Hyun-Jae;Jeon, Jun-Woo;Yeo, Gi-Tae;Yang, Chang-Ho
    • Journal of Navigation and Port Research
    • /
    • v.36 no.10
    • /
    • pp.905-910
    • /
    • 2012
  • In early 1990s, the Sea & Air Transport Cargoes (SATC) was increased annually with more than 50% rate due to the rising trade between Korea and China. However, after that, the increasing rate of the SATC was slowdown from the late 1990s, furthermore, recently it became sluggish and declined. This phenomenon is totally different compared to the skyrocketing trade volumes between two countries. In this respect, to forecast the SATC, draw out the factors for activation, and calculate the weight of priority of these factors are urgently needed. To achieve the research objectives, the ARIMA and Fuzzy-AHP were used as research methodology. The estimated volume of SATC using the data from year 2007 to 2012 on the ARIMA model, will be reached approximately 33,000 tons in year 2015. In the mean time, For drawing out and weighing the activation factors for SATC, the Fuzzy-AHP was adopted. As a result, 'Sea & Air transportation-related information system policies' is the most important factor among the principle criteria, and 'the construction of consolidation logistics center' is the most important factor among the 12 sub-principle criteria.

A Bayesian Approach to Gumbel Mixture Distribution for the Estimation of Parameter and its use to the Rainfall Frequency Analysis (Bayesian 기법을 이용한 혼합 Gumbel 분포 매개변수 추정 및 강우빈도해석 기법 개발)

  • Choi, Hong-Geun;Uranchimeg, Sumiya;Kim, Yong-Tak;Kwon, Hyun-Han
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.38 no.2
    • /
    • pp.249-259
    • /
    • 2018
  • More than half of annual rainfall occurs in summer season in Korea due to its climate condition and geographical location. A frequency analysis is mostly adopted for designing hydraulic structure under the such concentrated rainfall condition. Among the various distributions, univariate Gumbel distribution has been routinely used for rainfall frequency analysis in Korea. However, the distributional changes in extreme rainfall have been globally observed including Korea. More specifically, the univariate Gumbel distribution based rainfall frequency analysis is often fail to describe multimodal behaviors which are mainly influenced by distinct climate conditions during the wet season. In this context, we purposed a Gumbel mixture distribution based rainfall frequency analysis with a Bayesian framework, and further the results were compared to that of the univariate. It was found that the proposed model showed better performance in describing underlying distributions, leading to the lower Bayesian information criterion (BIC) values. The mixed Gumbel distribution was more robust for describing the upper tail of the distribution which playes a crucial role in estimating more reliable estimates of design rainfall uncertainty occurred by peak of upper tail than single Gumbel distribution. Therefore, it can be concluded that the mixed Gumbel distribution is more compatible for extreme frequency analysis rainfall data with two or more peaks on its distribution.

Artificial Intelligence for Assistance of Facial Expression Practice Using Emotion Classification (감정 분류를 이용한 표정 연습 보조 인공지능)

  • Dong-Kyu, Kim;So Hwa, Lee;Jae Hwan, Bong
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.6
    • /
    • pp.1137-1144
    • /
    • 2022
  • In this study, an artificial intelligence(AI) was developed to help with facial expression practice in order to express emotions. The developed AI used multimodal inputs consisting of sentences and facial images for deep neural networks (DNNs). The DNNs calculated similarities between the emotions predicted by the sentences and the emotions predicted by facial images. The user practiced facial expressions based on the situation given by sentences, and the AI provided the user with numerical feedback based on the similarity between the emotion predicted by sentence and the emotion predicted by facial expression. ResNet34 structure was trained on FER2013 public data to predict emotions from facial images. To predict emotions in sentences, KoBERT model was trained in transfer learning manner using the conversational speech dataset for emotion classification opened to the public by AIHub. The DNN that predicts emotions from the facial images demonstrated 65% accuracy, which is comparable to human emotional classification ability. The DNN that predicts emotions from the sentences achieved 90% accuracy. The performance of the developed AI was evaluated through experiments with changing facial expressions in which an ordinary person was participated.