• Title/Summary/Keyword: attention mechanism

Search Result 786, Processing Time 0.025 seconds

Study on investigative driving an evaluation model for Internet website (인터넷 웹사이트 평가모형 도출에 관한 탐색적 연구)

  • Kim Jung-Sun
    • Management & Information Systems Review
    • /
    • v.9
    • /
    • pp.117-137
    • /
    • 2002
  • As attention to the Internet from both companies and individuals is rapidly on the increase, hundreds of new websites are opening in a single day. Along with such a high attention to the Internet, to set up an effective website needs efficient evaluation and reliable evaluation criterions for the website. The existing homepage contests and evaluation models are limited to certain websites in a special field or to the systemic side and to the contents, which in fact weakened the development of detailed evaluation sections and items possibly measured. This study is designed to integrate and seek out methods and success factors that should be considered when a website is built up, discovering evaluation criterions and making evaluation models objectively possible to be measured. The study focused on investigation into a new measurement standard and model by considering the previous studies, in order to suggest the followings: Centering the 7 top evaluation sections by type of each website such as (1) Service, (2) Mechanism, (3) Structure & Navigation, (4) Usability, (5) Contents (6) Community, (7) Communication, the study suggests an objective and reasonable website evaluation model on a basis of common factors considered in an integral and optimum view.

  • PDF

Noise Prediction and Control for Onboard Ships (선박 소음 예측 및 제어 대책)

  • Joo, Won-Ho;Kim, Dong-Hae
    • Special Issue of the Society of Naval Architects of Korea
    • /
    • 2006.09a
    • /
    • pp.7-14
    • /
    • 2006
  • In recent years, shipboard noise control is attracting increasing attention to human environmental conditions and crew's opportunity for rest and recreation with work on board. In order to minimize the noise levels, careful attention have to be paid by the experts from initial design stage to the delivery. This paper describes the outlines of shipboard noise control including general characteristics of shipboard noise, measurement, evaluation, prediction, and control measures considering the noise transmission mechanism from source to receiver space.

  • PDF

Comparison and Analysis of the Attention Mechanism for Stock Prediction (주가 예측을 위한 어텐션 메커니즘의 비교분석)

  • Yu, Yeonguk;Cheon, Yongsang;Cho, Min-Hee;Kim, Yoon-Joong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2019.10a
    • /
    • pp.844-847
    • /
    • 2019
  • 주가 예측은 상업적인 매력 때문에 많은 이목이 끌리는 분야이지만, 주가의 불확실성과 변동성 때문에 주가 예측은 어려운 작업이다. 최근에는 주가 예측 모델에 어텐션 메커니즘을 사용하여 주가 예측에 많은 인자들이 사용되어 생기는 성능 하락 문제를 해결하여 좋은 성능을 보여주는 연구가 존재한다. 본 연구에서는 그 모델 중 하나인 Dual-Stage Attention-Based Recurrent Neural Network(DARNN)의 어텐션 메커니즘을 변경해가며 어떤 어텐션 메커니즘이 주가 예측에 적합한지를 알아본다. KOSPI100 지수의 예측실험을 통해 location 스코어함수를 사용한 어텐션 메커니즘이 가장 뛰어난 성능을 보여주는 것을 확인하였고, 이는 기존의 스코어함수를 사용한 DARNN에 비해 약 10% 향상된 성능으로 스코어 함수가 모델의 중요한 영향을 끼치는 것을 확인하였다.

High-Speed Transformer for Panoptic Segmentation

  • Baek, Jong-Hyeon;Kim, Dae-Hyun;Lee, Hee-Kyung;Choo, Hyon-Gon;Koh, Yeong Jun
    • Journal of Broadcast Engineering
    • /
    • v.27 no.7
    • /
    • pp.1011-1020
    • /
    • 2022
  • Recent high-performance panoptic segmentation models are based on transformer architectures. However, transformer-based panoptic segmentation methods are basically slower than convolution-based methods, since the attention mechanism in the transformer requires quadratic complexity w.r.t. image resolution. Also, sine and cosine computation for positional embedding in the transformer also yields a bottleneck for computation time. To address these problems, we adopt three modules to speed up the inference runtime of the transformer-based panoptic segmentation. First, we perform channel-level reduction using depth-wise separable convolution for inputs of the transformer decoder. Second, we replace sine and cosine-based positional encoding with convolution operations, called conv-embedding. We also apply a separable self-attention to the transformer encoder to lower quadratic complexity to linear one for numbers of image pixels. As result, the proposed model achieves 44% faster frame per second than baseline on ADE20K panoptic validation dataset, when we use all three modules.

Multi-task learning with contextual hierarchical attention for Korean coreference resolution

  • Cheoneum Park
    • ETRI Journal
    • /
    • v.45 no.1
    • /
    • pp.93-104
    • /
    • 2023
  • Coreference resolution is a task in discourse analysis that links several headwords used in any document object. We suggest pointer networks-based coreference resolution for Korean using multi-task learning (MTL) with an attention mechanism for a hierarchical structure. As Korean is a head-final language, the head can easily be found. Our model learns the distribution by referring to the same entity position and utilizes a pointer network to conduct coreference resolution depending on the input headword. As the input is a document, the input sequence is very long. Thus, the core idea is to learn the word- and sentence-level distributions in parallel with MTL, while using a shared representation to address the long sequence problem. The suggested technique is used to generate word representations for Korean based on contextual information using pre-trained language models for Korean. In the same experimental conditions, our model performed roughly 1.8% better on CoNLL F1 than previous research without hierarchical structure.

PATN: Polarized Attention based Transformer Network for Multi-focus image fusion

  • Pan Wu;Zhen Hua;Jinjiang Li
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.4
    • /
    • pp.1234-1257
    • /
    • 2023
  • In this paper, we propose a framework for multi-focus image fusion called PATN. In our approach, by aggregating deep features extracted based on the U-type Transformer mechanism and shallow features extracted using the PSA module, we make PATN feed both long-range image texture information and focus on local detail information of the image. Meanwhile, the edge-preserving information value of the fused image is enhanced using a dense residual block containing the Sobel gradient operator, and three loss functions are introduced to retain more source image texture information. PATN is compared with 17 more advanced MFIF methods on three datasets to verify the effectiveness and robustness of PATN.

Deep Subspace clustering with attention mechanism (데이터 표현 강조 기법을 활용한 부분 공간 군집화)

  • Baek, Sang Won;Yoon, Sang Min
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.721-723
    • /
    • 2020
  • 부분 공간 군집화는 고차원 데이터에서 의미 있는 특징들을 선별 및 추출하여 저차원의 부분 공간에서 군집화 하는 것이다. 그러나 최근 딥러닝 활용한 부분 공간 군집화 연구들은 AutoEncoder을 기반으로 의미있는 특징을 선별하는 것이 아닌 특징 맵의 크기를 증가시켜서 네트워크의 표현 능력에 중점을 둔 연구되고 있다. 본 논문에서는 AutoEncdoer 네트워크에 Channel Attention 모델을 활용하여 Encoder와 Decoder에서 부분 공간 군집화를 위한 특징을 강조하는 네트워크를 제안한다. 본 논문에서 제안하는 네트워크는 고차원의 이미지에서 부분 공간 군집화를 위해 강조된 특징 맵을 추출하고 이를 이용해서 보다 향상된 성능을 보여주었다.

  • PDF

Structural Determination of Oxidation Products of Flavonoids in Alcoholic Aqueous Solution with Reactive Oxygen Species

  • Hirose, Yuko;Kakita, Mitsuko;Washizu, Toshiyuki;Matsugo, Seiichi
    • Journal of Photoscience
    • /
    • v.9 no.2
    • /
    • pp.424-426
    • /
    • 2002
  • Recently, much attention has been paid to the physiological functions of flavonoids associated with their antioxidant properties. However, there was a lack of information on the molecular mechanism at which flavonoids play the antioxidative role. We have already studied on the oxidation of quercetin with hydrogen peroxide and sodium hypochlorite in alcoholic aqueous solution and determined the oxidation products. Through the structural analysis of the oxidation products, it was clarified that the hydroxyl group at C-3 in the C ring plays the important role in the antioxidative action of quercetin. Successively, rutin and (+)-catechin were oxidized with sodium hypochlorite and their mono- and di-chlorinated derivatives were obtained. These facts indicate that these flavonoids can directly scavenge hypochlorous acid and the active site in this scavenging reaction is not the hydroxyl group at C-3.

  • PDF

Anti-Cancer Mechanism and Possibility of Nano-Suspension Formulation for a Marine Algae Product Fucoxanthin

  • Muthuirulappan, Srinivasan;Francis, Steffi Pulikodan
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.14 no.4
    • /
    • pp.2213-2216
    • /
    • 2013
  • Recently, use of natural products available from marine sources, and especially algae products, are receiving more attention. Scientific evidence for claimed nutraceutical and therapeutical effects of one such marine algae product, fucoxanthin, is discussed in this paper with a summary of the currently available literature regarding its antioxidant, anti-obesity and anticancer activities. It is safe for use in humans, but as it has poor solubility a nano-suspension mode of delivery may be adopted to improve efficacy of supplments. We conclude from ourliterature review that the marine algae product fucoxanthin has significant antioxidant, anti-obesity and anticancer activity with established mechanisms of action.

AUTHENTICATION PROTOCOL: METHODS REVIEW

  • Cahyo Crysdian;Abdullah, Abdul-Hanan
    • Proceedings of the IEEK Conference
    • /
    • 2002.07a
    • /
    • pp.242-245
    • /
    • 2002
  • Authentication protocol as a part of security system has been growth rapidly since it was known that sending clear text password in the network is unsecured. Many protocols could be noted proposed to strengthen the authentication process. In 1985 an attempt to safeguard network services within Athena project resulting on the born of Kerberos 〔1〕〔8〕, one of the protocol that has a lot of attention from the research community. Several years later researchers were discovered some weaknesses carried by this protocol 〔2〕〔21〕. In 1992. EKE was introduced by Bellovin and Merrit. Since that time, many protocols introduced could be considered as its variant 〔5〕〔9〕〔13〕〔14〕. Some other protocols such as OKE〔5〕 and SRP〔18〕 although claimed different from EKE, they have the same basic mechanism in holding authentication process. Here, we explain the mechanism of those protocols, their strength and their weaknesses and shortcomings. Due to the limitations of the number of paper pages, only two types of authentication protocol can be explained here i.e EKE and SRP.

  • PDF