• Title/Summary/Keyword: Long-Term Memory

Search Result 807, Processing Time 0.028 seconds

Water temperature prediction of Daecheong Reservoir by a process-guided deep learning model (역학적 모델과 딥러닝 모델을 융합한 대청호 수온 예측)

  • Kim, Sung Jin;Park, Hyungseok;Lee, Gun Ho;Chung, Se Woong
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2021.06a
    • /
    • pp.88-88
    • /
    • 2021
  • 최근 수자원과 수질관리 분야에 자료기반 머신러닝 모델과 딥러닝 모델의 활용이 급증하고 있다. 그러나 딥러닝 모델은 Blackbox 모델의 특성상 고전적인 질량, 운동량, 에너지 보존법칙을 고려하지 않고, 데이터에 내재된 패턴과 관계를 해석하기 때문에 물리적 법칙을 만족하지 않는 예측결과를 가져올 수 있다. 또한, 딥러닝 모델의 예측 성능은 학습데이터의 양과 변수 선정에 크게 영향을 받는 모델이기 때문에 양질의 데이터가 제공되지 않으면 모델의 bias와 variation이 클 수 있으며 정확도 높은 예측이 어렵다. 최근 이러한 자료기반 모델링 방법의 단점을 보완하기 위해 프로세스 기반 수치모델과 딥러닝 모델을 결합하여 두 모델링 방법의 장점을 활용하는 연구가 활발히 진행되고 있다(Read et al., 2019). Process-Guided Deep Learning (PGDL) 방법은 물리적 법칙을 반영하여 딥러닝 모델을 훈련시킴으로써 순수한 딥러닝 모델의 물리적 법칙 결여성 문제를 해결할 수 있는 대안으로 활용되고 있다. PGDL 모델은 딥러닝 모델에 물리적인 법칙을 해석할 수 있는 추가변수를 도입하며, 딥러닝 모델의 매개변수 최적화 과정에서 Cost 함수에 물리적 법칙을 위반하는 경우 Penalty를 추가하는 알고리즘을 도입하여 물리적 보존법칙을 만족하도록 모델을 훈련시킨다. 본 연구의 목적은 대청호의 수심별 수온을 예측하기 위해 역학적 모델과 딥러닝 모델을 융합한 PGDL 모델을 개발하고 적용성을 평가하는데 있다. 역학적 모델은 2차원 횡방향 평균 수리·수질 모델인 CE-QUAL-W2을 사용하였으며, 대청호를 대상으로 2017년부터 2018년까지 총 2년간 수온과 에너지 수지를 모의하였다. 기상(기온, 이슬점온도, 풍향, 풍속, 운량), 수문(저수위, 유입·유출 유량), 수온자료를 수집하여 CE-QUAL-W2 모델을 구축하고 보정하였으며, 모델은 저수위 변화, 수온의 수심별 시계열 변동 특성을 적절하게 재현하였다. 또한, 동일기간 대청호 수심별 수온 예측을 위한 순환 신경망 모델인 LSTM(Long Short-Term Memory)을 개발하였으며, 종속변수는 수온계 체인을 통해 수집한 수심별 고빈도 수온 자료를 사용하고 독립 변수는 기온, 풍속, 상대습도, 강수량, 단파복사에너지, 장파복사에너지를 사용하였다. LSTM 모델의 매개변수 최적화는 지도학습을 통해 예측값과 실측값의 RMSE가 최소화 되로록 훈련하였다. PGDL 모델은 동일 기간 LSTM 모델과 동일 입력 자료를 사용하여 구축하였으며, 역학적 모델에서 얻은 에너지 수지를 만족하지 않는 경우 Cost Function에 Penalty를 추가하여 물리적 보존법칙을 만족하도록 훈련하고 수심별 수온 예측결과를 비교·분석하였다.

  • PDF

Adverse Effects on EEGs and Bio-Signals Coupling on Improving Machine Learning-Based Classification Performances

  • SuJin Bak
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.10
    • /
    • pp.133-153
    • /
    • 2023
  • In this paper, we propose a novel approach to investigating brain-signal measurement technology using Electroencephalography (EEG). Traditionally, researchers have combined EEG signals with bio-signals (BSs) to enhance the classification performance of emotional states. Our objective was to explore the synergistic effects of coupling EEG and BSs, and determine whether the combination of EEG+BS improves the classification accuracy of emotional states compared to using EEG alone or combining EEG with pseudo-random signals (PS) generated arbitrarily by random generators. Employing four feature extraction methods, we examined four combinations: EEG alone, EG+BS, EEG+BS+PS, and EEG+PS, utilizing data from two widely-used open datasets. Emotional states (task versus rest states) were classified using Support Vector Machine (SVM) and Long Short-Term Memory (LSTM) classifiers. Our results revealed that when using the highest accuracy SVM-FFT, the average error rates of EEG+BS were 4.7% and 6.5% higher than those of EEG+PS and EEG alone, respectively. We also conducted a thorough analysis of EEG+BS by combining numerous PSs. The error rate of EEG+BS+PS displayed a V-shaped curve, initially decreasing due to the deep double descent phenomenon, followed by an increase attributed to the curse of dimensionality. Consequently, our findings suggest that the combination of EEG+BS may not always yield promising classification performance.

What Changed and Unchanged After Science Class: Analyzing High School Student's Conceptual Change on Circular Motion Based on Mental Model Theory (과학수업 후 변하는 것과 변하지 않는 것: 정신모형 이론을 중심으로 한 고등학생의 원운동 개념변화 사례 분석)

  • Park, Ji-Yeon;Lee, Gyoung-Ho;Shin, Jong-Ho;Song, Sang-Ho
    • Journal of The Korean Association For Science Education
    • /
    • v.26 no.4
    • /
    • pp.475-491
    • /
    • 2006
  • In physics education, the research on students' conceptions has developed in the discussion on the nature and the difficulty of conceptual change. Recently, mental models have been a theoretical background in concrete arguments on "how students' conceptions are constructed or created." Mental models that integrate information in the presented problem and individual knowledge in their long-term memory have important information about not only expressed ideas but also in the thinking process behind the expressed ideas. The purpose of this study is to investigate the forming process and the characteristics of high school student's mental models about circular motion, and how they were changed by instruction. We used the think-aloud method based on the instrument for identifying student's mental models about circular motion, pretest of physics concept, mind map and interview for investigating student's characteristics. The results of the study showed that instructions based on the mental model theory facilitated scientific expressed model, but several factors that affected forming mental models like epistemological belief didn't change scientifically after 3 lessons.

Does the Gut Microbiota Regulate a Cognitive Function? (장내미생물과 인지기능은 서로 연관되어 있는가?)

  • Choi, Jeonghyun;Jin, Yunho;Kim, Joo-Heon;Hong, Yonggeun
    • Journal of Life Science
    • /
    • v.29 no.6
    • /
    • pp.747-753
    • /
    • 2019
  • Cognitive decline is characterized by reduced long-/short-term memory and attention span, and increased depression and anxiety. Such decline is associated with various degenerative brain disorders, especially Alzheimer's disease (AD) and Parkinson's disease (PD). The increases in elderly populations suffering from cognitive decline create social problems and impose economic burdens, and also pose safety threats; all of these problems have been extensively researched over the past several decades. Possible causes of cognitive decline include metabolic and hormone imbalance, infection, medication abuse, and neuronal changes associated with aging. However, no treatment for cognitive decline is available. In neurodegenerative diseases, changes in the gut microbiota and gut metabolites can alter molecular expression and neurobehavioral symptoms. Changes in the gut microbiota affect memory loss in AD via the downregulation of NMDA receptor expression and increased glutamate levels. Furthermore, the use of probiotics resulted in neurological improvement in an AD model. PD and gut microbiota dysbiosis are linked directly. This interrelationship affected the development of constipation, a secondary symptom in PD. In a PD model, the administration of probiotics prevented neuron death by increasing butyrate levels. Dysfunction of the blood-brain barrier (BBB) has been identified in AD and PD. Increased BBB permeability is also associated with gut microbiota dysbiosis, which led to the destruction of microtubules via systemic inflammation. Notably, metabolites of the gut microbiota may trigger either the development or attenuation of neurodegenerative disease. Here, we discuss the correlation between cognitive decline and the gut microbiota.

Does Brand Experience Affect Consumer's Emotional Attachments? (브랜드의 총체적 체험이 소비자-브랜드의 정서적 유대관계에 미치는 영향)

  • Lee, Jieun;Jeon, Jooeon;Yoon, Jaeyoung
    • Asia Marketing Journal
    • /
    • v.12 no.2
    • /
    • pp.53-81
    • /
    • 2010
  • Brand experience has received much attention from considerable marketing research. When consumers consume and use brands, they are exposed to various specific brand-related stimuli. These brand-related stimuli include brand identity and brand communications(e.g., colors, shapes, designs, slogans, mascots, brand characters) components. Brakus, Schmitt, and Zarantonello(2009) conceptualized brand experience as subjective and internal consumer responses evoked by brand-related stimuli. They demonstrated that brand experience can be broken down into four dimensions(sensory, affective, intellectual, and behavioral). Because experiences result from stimulations and lead to pleasurable outcomes, we expect consumers to want to repeat theses experiences. That is, brand experiences, stored in consumer memory, should affect brand loyalty. Consumers with positive experiences should be more likely to buy a brand again and less likely to buy an alternative brand(Fournier 1998; Oliver 1997). Brand attachment, one of dimensions of the consumer-brand relationship, is defined as an emotional bond to the specific brand(Thomson, MacInnis, and Park 2005). Brand attachment is target-specific bond between the consumer and the specific brand. Thus, strong attachment is attended by a rich set of schema that link the brand to the consumer. Previous researches propose that brand attachments should affect consumers' commitment to the brand. Brand experience differs from affective construct such as brand attachment. Brand attachment is based on interaction between a consumer and the brand. In contrast, brand experience occurs whenever there is a direct and indirect interaction with the brand. Furthermore, brand experience is not an emotional relationship concept. Brakus et al.(2009) suggest that brand experience may result in brand attachment. This study aims to distinguish brand experience dimensions and investigate the effects of brand experience on brand attachment and brand commitment. We test research problems with data from 265 customers having brand experiences in various product categories by using multiple regression and structural equation model. The empirical results can be summarized as follows. First, the paths from affective, behavior, and intellectual experience to the brand attachment were found to be positively significant whereas the effect of sensory experience to brand attachment was not supported. In the consumer literature, sensory experiences for consumers are often equated with aesthetic pleasure. Over time, these pleasure experiences can affect consumer satisfaction. However, sensory pleasures are not linked to attachment such as consumers' strong emotional bond(i.e., hot affect). These empirical results confirms the results of previous studies. Second, brand attachment including passion and connection influences brand commitment positively but affection does not influence brand commitment. In marketing context, consumers with brand attachment have intention to have a willingness to stay with the relationship. The results also imply that consumers' emotional attachment is characterized by a set of brand experience dimensions and consumers who are emotionally attached to the brand are committed. The findings of this research contribute to develop differences between brand experience and brand attachment and to provide practical implications on the brand experience management. Recently, many brand managers have focused on short-term view. According to this study, we suggest that effective brand experience management requires taking a long-term view of marketing decisions.

  • PDF

Development of Deep-Learning-Based Models for Predicting Groundwater Levels in the Middle-Jeju Watershed, Jeju Island (딥러닝 기법을 이용한 제주도 중제주수역 지하수위 예측 모델개발)

  • Park, Jaesung;Jeong, Jiho;Jeong, Jina;Kim, Ki-Hong;Shin, Jaehyeon;Lee, Dongyeop;Jeong, Saebom
    • The Journal of Engineering Geology
    • /
    • v.32 no.4
    • /
    • pp.697-723
    • /
    • 2022
  • Data-driven models to predict groundwater levels 30 days in advance were developed for 12 groundwater monitoring stations in the middle-Jeju watershed, Jeju Island. Stacked long short-term memory (stacked-LSTM), a deep learning technique suitable for time series forecasting, was used for model development. Daily time series data from 2001 to 2022 for precipitation, groundwater usage amount, and groundwater level were considered. Various models were proposed that used different combinations of the input data types and varying lengths of previous time series data for each input variable. A general procedure for deep-learning-based model development is suggested based on consideration of the comparative validation results of the tested models. A model using precipitation, groundwater usage amount, and previous groundwater level data as input variables outperformed any model neglecting one or more of these data categories. Using extended sequences of these past data improved the predictions, possibly owing to the long delay time between precipitation and groundwater recharge, which results from the deep groundwater level in Jeju Island. However, limiting the range of considered groundwater usage data that significantly affected the groundwater level fluctuation (rather than using all the groundwater usage data) improved the performance of the predictive model. The developed models can predict the future groundwater level based on the current amount of precipitation and groundwater use. Therefore, the models provide information on the soundness of the aquifer system, which will help to prepare management plans to maintain appropriate groundwater quantities.

Development of a complex failure prediction system using Hierarchical Attention Network (Hierarchical Attention Network를 이용한 복합 장애 발생 예측 시스템 개발)

  • Park, Youngchan;An, Sangjun;Kim, Mintae;Kim, Wooju
    • Journal of Intelligence and Information Systems
    • /
    • v.26 no.4
    • /
    • pp.127-148
    • /
    • 2020
  • The data center is a physical environment facility for accommodating computer systems and related components, and is an essential foundation technology for next-generation core industries such as big data, smart factories, wearables, and smart homes. In particular, with the growth of cloud computing, the proportional expansion of the data center infrastructure is inevitable. Monitoring the health of these data center facilities is a way to maintain and manage the system and prevent failure. If a failure occurs in some elements of the facility, it may affect not only the relevant equipment but also other connected equipment, and may cause enormous damage. In particular, IT facilities are irregular due to interdependence and it is difficult to know the cause. In the previous study predicting failure in data center, failure was predicted by looking at a single server as a single state without assuming that the devices were mixed. Therefore, in this study, data center failures were classified into failures occurring inside the server (Outage A) and failures occurring outside the server (Outage B), and focused on analyzing complex failures occurring within the server. Server external failures include power, cooling, user errors, etc. Since such failures can be prevented in the early stages of data center facility construction, various solutions are being developed. On the other hand, the cause of the failure occurring in the server is difficult to determine, and adequate prevention has not yet been achieved. In particular, this is the reason why server failures do not occur singularly, cause other server failures, or receive something that causes failures from other servers. In other words, while the existing studies assumed that it was a single server that did not affect the servers and analyzed the failure, in this study, the failure occurred on the assumption that it had an effect between servers. In order to define the complex failure situation in the data center, failure history data for each equipment existing in the data center was used. There are four major failures considered in this study: Network Node Down, Server Down, Windows Activation Services Down, and Database Management System Service Down. The failures that occur for each device are sorted in chronological order, and when a failure occurs in a specific equipment, if a failure occurs in a specific equipment within 5 minutes from the time of occurrence, it is defined that the failure occurs simultaneously. After configuring the sequence for the devices that have failed at the same time, 5 devices that frequently occur simultaneously within the configured sequence were selected, and the case where the selected devices failed at the same time was confirmed through visualization. Since the server resource information collected for failure analysis is in units of time series and has flow, we used Long Short-term Memory (LSTM), a deep learning algorithm that can predict the next state through the previous state. In addition, unlike a single server, the Hierarchical Attention Network deep learning model structure was used in consideration of the fact that the level of multiple failures for each server is different. This algorithm is a method of increasing the prediction accuracy by giving weight to the server as the impact on the failure increases. The study began with defining the type of failure and selecting the analysis target. In the first experiment, the same collected data was assumed as a single server state and a multiple server state, and compared and analyzed. The second experiment improved the prediction accuracy in the case of a complex server by optimizing each server threshold. In the first experiment, which assumed each of a single server and multiple servers, in the case of a single server, it was predicted that three of the five servers did not have a failure even though the actual failure occurred. However, assuming multiple servers, all five servers were predicted to have failed. As a result of the experiment, the hypothesis that there is an effect between servers is proven. As a result of this study, it was confirmed that the prediction performance was superior when the multiple servers were assumed than when the single server was assumed. In particular, applying the Hierarchical Attention Network algorithm, assuming that the effects of each server will be different, played a role in improving the analysis effect. In addition, by applying a different threshold for each server, the prediction accuracy could be improved. This study showed that failures that are difficult to determine the cause can be predicted through historical data, and a model that can predict failures occurring in servers in data centers is presented. It is expected that the occurrence of disability can be prevented in advance using the results of this study.

Improving Bidirectional LSTM-CRF model Of Sequence Tagging by using Ontology knowledge based feature (온톨로지 지식 기반 특성치를 활용한 Bidirectional LSTM-CRF 모델의 시퀀스 태깅 성능 향상에 관한 연구)

  • Jin, Seunghee;Jang, Heewon;Kim, Wooju
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.253-266
    • /
    • 2018
  • This paper proposes a methodology applying sequence tagging methodology to improve the performance of NER(Named Entity Recognition) used in QA system. In order to retrieve the correct answers stored in the database, it is necessary to switch the user's query into a language of the database such as SQL(Structured Query Language). Then, the computer can recognize the language of the user. This is the process of identifying the class or data name contained in the database. The method of retrieving the words contained in the query in the existing database and recognizing the object does not identify the homophone and the word phrases because it does not consider the context of the user's query. If there are multiple search results, all of them are returned as a result, so there can be many interpretations on the query and the time complexity for the calculation becomes large. To overcome these, this study aims to solve this problem by reflecting the contextual meaning of the query using Bidirectional LSTM-CRF. Also we tried to solve the disadvantages of the neural network model which can't identify the untrained words by using ontology knowledge based feature. Experiments were conducted on the ontology knowledge base of music domain and the performance was evaluated. In order to accurately evaluate the performance of the L-Bidirectional LSTM-CRF proposed in this study, we experimented with converting the words included in the learned query into untrained words in order to test whether the words were included in the database but correctly identified the untrained words. As a result, it was possible to recognize objects considering the context and can recognize the untrained words without re-training the L-Bidirectional LSTM-CRF mode, and it is confirmed that the performance of the object recognition as a whole is improved.

Effect of Acupuncture on Nasal Obstruction in Patients with Persistent Allergic Rhinitis: A Randomized Controlled Trial (지속성 알레르기비염의 비폐색에 대한 침치료의 효과: 무작위배정 대조군 연구)

  • Jo, Jeong-Hyo;Hong, Kweon-Eey;Kang, Wee-Chang;Choi, Sun-Mi;Park, Yang-Chun
    • Journal of Acupuncture Research
    • /
    • v.22 no.6
    • /
    • pp.229-239
    • /
    • 2005
  • Objectives : Allergic rhinitis is a prevalent disease. Nasal obstruction is one of the main symptom in allergic rhinitis. It induces sleep disturbances, depression, attention deficit, memory impairments. Acupuncture treatment for rhinitis was mentioned in literature, but there is not enough report that provide evidence by well designed clinical study. The purpose of this research is to examine the effect of acupuncture treatment for nasal obstruction of allergic rhinitis. Methods : In this randomized, single blind, placebo-controlled study, we compared active acupuncture with minimal acupuncture for the treatment of nasal obstruction owing to persistent allergic rhinitis. Acupoints used in active acupuncture group were I120($Y{\hat{o}}nghyang$), GV23($Sangs{\hat{o}}ng$), IL4(Hapkok). Volunteers who satisfied the requirements were enrolled in study. Total nasal volume(NV) and total nasal minimum cross-sectional area(MCA) were measured by acoustic rhinometry before and after treatments(0min, 7.5min, 15min). Results : 101 subjects finished study. There were not difference between two groups on age, sex, weight, height, blood pressure, pulse, respiratory rate, severity of persistent allergic rhinitis, number of positive antigen. After treatment(0min) total NV were significantly increased compared with before treatment in active acupuncture group(p=0.0007) and minimal acupuncture group(p=0.0175). After treatment(15min) total NV of minimal acupuncture group was decreased compared with before treatment(p=0.2560), but total NV of active acupuncture group was maintained increasing in degree of borderline significance(p=0.0871). After treatment(0min) total NV were significantly increased compared with before treatment in active acupuncture group(0.0007) and minimal acupuncture group(p=0.0175). After treatment(Omin) total MCA were significantly increased compared with before treatment in active acupuncture group(p<0.000l) and minimal acupuncture group(p=0.0005). After treatment(15min) total MCA of minimal acupuncture group was decreased compared with before treatment(p=0.6082), but total NV of active acupuncture group was maintained increasing in degree of borderline significance(p=0.0929). Conclusion : Acupuncture treatment reduced nasal obstruction in persistent allergic rhinitis. Further study in the form of long term is needed.

  • PDF

Immunohistochemical Expression of Nuclear Retinoid Receptor and CREB(cAMP Response Element Binding Protein) in Lung Cancers (폐암종에서 Nuclear Retinoid Receptor 및 CREB의 면역조직화학적 발현 양상)

  • Shin, Jong Wook;Gi, Seung-Seok;Paik, Kwang Hyun;Choi, Won;Park, In Won;Kim, Mi Kyung
    • Tuberculosis and Respiratory Diseases
    • /
    • v.59 no.6
    • /
    • pp.631-637
    • /
    • 2005
  • Background : Transcriptional factors of the CREB(cAMP Response Element Binding Protein) are involved in the regulation of gene expression in response to a variety of signaling pathways. Proteins produced by the CREB genes play key roles in many physiological processes, including memory and long-term potentiation. The retinoic acid receptor (RAR) axis mediates epithelial cell differentiation and proliferation in many tissues including the lung. Material and method : The RAR and CREB expression levels were examined in 60 adenocarcinomas and 60 squamous cell carcinomas of the lung using immunohistochemical staining. Results : 1) RAR protein expression was found in 58.3%(35/60) of adenocarcinomas and 36.7%(22/60) of squamous cell carcinomas(P<0.05). 2) RAR protein expression was found in 80%(16/20) of well differentiated adenocarcinomas, 60%(12/20) of moderately differentiated adenocarcinomas, and 35%(7/20) of poorly differentiated adenocarcinomas (P<0.01). 3) RAR protein expression was found in 45%(9/20) of well differentiated squamous cell carcinomas, 35%(7/20) of moderately differentiated squamous cell carcinomas, and 30%(6/20) of poorly differentiated squamous cell carcinomas (P>0.05). 4) CREB expression was found in 61.7%(37/60) of adenocarcinomas and 40%(24/60) of squamous cell carcinomas( P<0.05). 5) CREB expression was found in 85%(17/20) of well differentiated adenocarcinomas, 60%(12/20) of moderately differentiated adenocarcinomas, and 40%(8/20) of poorly differentiated adenocarcinomas (P<0.01). 6) CREB expression was found in 45%(9/20) of well differentiated squamous cell carcinomas, 35%(7/20) of moderately differentiated squamous cell carcinomas, and 35%(8/20) of poorly differentiated squamous cell carcinomas(P>0.05). 7) RAR and CREB expression was found in 68.5% of lung cancers, and there was a significant correlation between them(P<0.05). Conclusion : RAR and CREB expression can be used to indirectly determine the malignant potentiality of a cell.