• Title/Summary/Keyword: Dual Attention

Search Result 190, Processing Time 0.033 seconds

Dual graph-regularized Constrained Nonnegative Matrix Factorization for Image Clustering

  • Sun, Jing;Cai, Xibiao;Sun, Fuming;Hong, Richang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.5
    • /
    • pp.2607-2627
    • /
    • 2017
  • Nonnegative matrix factorization (NMF) has received considerable attention due to its effectiveness of reducing high dimensional data and importance of producing a parts-based image representation. Most of existing NMF variants attempt to address the assertion that the observed data distribute on a nonlinear low-dimensional manifold. However, recent research results showed that not only the observed data but also the features lie on the low-dimensional manifolds. In addition, a few hard priori label information is available and thus helps to uncover the intrinsic geometrical and discriminative structures of the data space. Motivated by the two aspects above mentioned, we propose a novel algorithm to enhance the effectiveness of image representation, called Dual graph-regularized Constrained Nonnegative Matrix Factorization (DCNMF). The underlying philosophy of the proposed method is that it not only considers the geometric structures of the data manifold and the feature manifold simultaneously, but also mines valuable information from a few known labeled examples. These schemes will improve the performance of image representation and thus enhance the effectiveness of image classification. Extensive experiments on common benchmarks demonstrated that DCNMF has its superiority in image classification compared with state-of-the-art methods.

Pediatric dual-energy X-ray absorptiometry: interpretation and clinical and research application

  • Lim, Jung Sub
    • Clinical and Experimental Pediatrics
    • /
    • v.53 no.3
    • /
    • pp.286-293
    • /
    • 2010
  • Peak bone mass is established predominately during childhood and adolescence. It is an important determinant of future resistance to osteoporosis and fractures to gain bone mass during growth. The issue of low bone density in children and adolescents has recently attracted much attention and the use of pediatric dual-energy X-ray absorptiometry (DXA) is increasing. The process of interpretation of pediatric DXA results is different from that of adults because normal bone mineral density (BMD) of children varies by age, body size, pubertal stage, skeletal maturation, sex, and ethnicity. Thus, an appropriate normal BMD Z-score reference value with Z-score should be used to detect and manage low BMD. Z-scores below -2.0 are generally considered a low BMD to pediatrician even though diagnoses of osteoporosis in children and adolescents are usually only made in the presence of at least one fragility fracture. This article will review the basic knowledge and practical guidelines on pediatric DXA based on the International Society for Clinical Densitometry (ISCD) Pediatric Official Positions. Also discussed are the characteristics of normal Korean children and adolescents with respect to BMD development. The objective of this review is to help pediatricians to understand when DXA will be useful and how to interpret pediatric DXA reports in the clinical practice for management of children with the potential to develop osteoporosis in adulthood.

Design of Deep Space Missions Using a Dedicated Small Launch Vehicle (소형위성 전용 발사체를 이용한 심우주 임무 설계)

  • Choi, Su-Jin;Loucks, Mike;West, Stephen;Seo, Daeban;Lee, Keejoo
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.50 no.12
    • /
    • pp.877-888
    • /
    • 2022
  • Recently, as the CAPSTONE, a precursor mission for Lunar Gateway, was launched on a small launch vehicle for the purpose of demonstrating communications and navigation technology in the NRHO, large attention was brought to this event that enabled high-impact deep space mission using dedicated small launch vehicle and small spacecraft. In this study, we introduced the concept of a dual launch operation and examined the capability of the new concept in the exploration of the Moon, Mars and asteroid. It turned out a single launch is sufficient for the lunar low orbit mission up to around 247 kg, and the dual launch option can transport 215 kg and 183 kg to nearby destinations as such as Mars and astroid Apophis respectively.

Study on the Influence of Grid Voltage Quality on SVG and the Suppression

  • Yi, Guiping;Hu, Renjie
    • Journal of international Conference on Electrical Machines and Systems
    • /
    • v.3 no.2
    • /
    • pp.155-161
    • /
    • 2014
  • Industrial Static Var Generator (SVG) is typically applied at or near the load center to mitigate voltage fluctuation, flicker, phase unbalance, non-sine distortion or other load-related disturbance. Special attention is paid to the influence of grid voltage quality on SVG current, the non-sine distortion and unbalance of grid voltage causes not only the AC current distortion and unbalance but also the DC voltage fluctuation. In order to let the inverter voltage contain the fundamental negative sequence and harmonic component corresponding to the grid voltage, a new dual-loop control scheme is proposed to suppress the influence in this paper. The harmonic and negative sequence voltage decomposition algorithm and DC voltage control are also introduced. All these analyses can guide the practical applications. The simulation results verify the feasibility and effectiveness of the present control strategy and analyses.

System Design for 20W Portable Fuel Cell (20W급 휴대용 연료전지 시스템 설계)

  • Jee, Young-Seok;Ko, Jeong-Sik;Cha, Suk-Won
    • 한국신재생에너지학회:학술대회논문집
    • /
    • 2007.06a
    • /
    • pp.161-165
    • /
    • 2007
  • Recently by the development of the electronic engineering technology various mobile devices are developed. But their operation time need to be extended although capacity of the batteries are limited. We focused our attention to the portable SOFC system. Because SOFC has the high efficiency and a lot of strongness in comparison with other kinds of fuel cells. In addition they can be built as a self/non-reformable system and single/dual chamber system. So We evaluated some types of SOFC theoretically, and compared the results from the fuel and performance efficiency point of view.

  • PDF

Solution of Fuzzy Relation Equations Using Duality of Operators

  • Lai, Edmund;Park, Chan-Gook
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.106.2-106
    • /
    • 2001
  • The two typical composite operations of fuzzy relation are the max-min and the min-max composite operations. It is known that the two operations can be completely dual. This paper pays attention to the nature that these two typical operations are completely dual and investigates the correlation between the max-min composite relation equation and the min-max composite relation equation. An important scheme of correlation is in the characteristic of solution sets derived from these two fuzzy relation equations. The paper explains that one of the composite fuzzy relation equations is solvable using the solution method of the other fuzzy relation equation. The above-mentioned duality plays an important role in this solution procedure. Since it is not necessary to build the solution method separately like before, calculation efficiency can be raised. Moreover, the solution for the relation ...

  • PDF

The Proportional Resonant Controller for Improving the Current Distortion of the Dual buck inverter in DCM Section Connected grid system with harmonic voltage (고조파 전압이 포함된 계통과 연계된 듀얼벅 인버터의 DCM 구간에서 전류 왜곡 개선을 위한 비례공진 제어기)

  • Choi, Minjae;Cho, Younghoon;Choi, Jinuk;Moon, Youngmin
    • Proceedings of the KIPE Conference
    • /
    • 2018.07a
    • /
    • pp.286-287
    • /
    • 2018
  • Recently, the development of renewable energy using solar energy is drawing attention. One of these PV systems, the Dual buck Inverter, is one of the topologies used in conjunction with the system, characterized by high efficiency and shoot-through reduction. However, current distortion appears severely in grid connection. So, in this paper, the method of compensation through PR controller was verified through simulation as an analysis of current distortion components and a control method to improve them.

  • PDF

Falls in the Elderly and Attention Capacity Deficit Theory (노인 낙상과 주의력 결핍 이론)

  • Kim Hyeong-dong
    • The Journal of Korean Physical Therapy
    • /
    • v.14 no.3
    • /
    • pp.433-449
    • /
    • 2002
  • 노인에 있어 낙상 (falls)의 결과는 신체 기능상의 상실을 가져 올 뿐 아니 라 종종 사망에 이르게 하는 원인이 되기도 하여 중대한 건강상의 문제로 다루어지고 있다. 정상적인 노화과정은 감각(sensory)과 운동 (motor)계의 감퇴 그리고 주의력의 쇠퇴와 연관되어 있는데, 노인들은 이러한 감각(sensory)과 운동(motor)계 (system)의 손상으로 여러 가지 자세(posture)와 보행 (walking)등을 수행하는데 어려움을 겪는다. 또한 노화와 관련된 변화들은 자세를 조절 (postural control) 하는데 있어서 주의력 (attention capacity)을 감소시킨다. 이러한 조건 하에서 노인들은 이중과업 (dual task)을 수행하는데 젊은 사랑들보다도 더 많은 어려움을 느끼며 이는 곧바로 낙상 (falls)의 가능성을 증가시키는 중요한 원인이 되고 있다. 이러한 점들을 고려할 때 낙상(falls)을 방지하기 위한 훈련 프로그램 (training program)은 단순한 신체운동(physical exercise) 보다는 자세조절 (postural control)시의 인지시스템 (cognitive system)이 포함된 중추 통합 기전(central integrative mechanisms)을 최적화 (optimize) 시킬 수 있는 방향으로 구성되어야 한다.

  • PDF

Comparison and Analysis of the Attention Mechanism for Stock Prediction (주가 예측을 위한 어텐션 메커니즘의 비교분석)

  • Yu, Yeonguk;Cheon, Yongsang;Cho, Min-Hee;Kim, Yoon-Joong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2019.10a
    • /
    • pp.844-847
    • /
    • 2019
  • 주가 예측은 상업적인 매력 때문에 많은 이목이 끌리는 분야이지만, 주가의 불확실성과 변동성 때문에 주가 예측은 어려운 작업이다. 최근에는 주가 예측 모델에 어텐션 메커니즘을 사용하여 주가 예측에 많은 인자들이 사용되어 생기는 성능 하락 문제를 해결하여 좋은 성능을 보여주는 연구가 존재한다. 본 연구에서는 그 모델 중 하나인 Dual-Stage Attention-Based Recurrent Neural Network(DARNN)의 어텐션 메커니즘을 변경해가며 어떤 어텐션 메커니즘이 주가 예측에 적합한지를 알아본다. KOSPI100 지수의 예측실험을 통해 location 스코어함수를 사용한 어텐션 메커니즘이 가장 뛰어난 성능을 보여주는 것을 확인하였고, 이는 기존의 스코어함수를 사용한 DARNN에 비해 약 10% 향상된 성능으로 스코어 함수가 모델의 중요한 영향을 끼치는 것을 확인하였다.

Improving Transformer with Dynamic Convolution and Shortcut for Video-Text Retrieval

  • Liu, Zhi;Cai, Jincen;Zhang, Mengmeng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.7
    • /
    • pp.2407-2424
    • /
    • 2022
  • Recently, Transformer has made great progress in video retrieval tasks due to its high representation capability. For the structure of a Transformer, the cascaded self-attention modules are capable of capturing long-distance feature dependencies. However, the local feature details are likely to have deteriorated. In addition, increasing the depth of the structure is likely to produce learning bias in the learned features. In this paper, an improved Transformer structure named TransDCS (Transformer with Dynamic Convolution and Shortcut) is proposed. A Multi-head Conv-Self-Attention module is introduced to model the local dependencies and improve the efficiency of local features extraction. Meanwhile, the augmented shortcuts module based on a dual identity matrix is applied to enhance the conduction of input features, and mitigate the learning bias. The proposed model is tested on MSRVTT, LSMDC and Activity-Net benchmarks, and it surpasses all previous solutions for the video-text retrieval task. For example, on the LSMDC benchmark, a gain of about 2.3% MdR and 6.1% MnR is obtained over recently proposed multimodal-based methods.