• Title/Summary/Keyword: Generalized Neural Network

Search Result 179, Processing Time 0.045 seconds

Seismic Traveltime Tomography using Neural Network (신경망 이론을 이용한 탄성파 주시 토모그래피의 연구)

  • Kim, Tae-Yeon;Yoon, Wang-Jung
    • Geophysics and Geophysical Exploration
    • /
    • v.2 no.4
    • /
    • pp.167-173
    • /
    • 1999
  • Since the resolution of the 2-D hole-to-hole seismic traveltime tomography is affected by the limited ray transmission angle, various methods were used to improve the resolution. Linear traveltime interpolation(LTI) ray tracing method was chosen for forward-modeling method. Inversion results using the LTI method were compared with those using the other ray tracing methods. As an inversion algorithm, SIRT method was used. In the iterative non-linear inversion method, the cost of ray tracing is quite expensive. To reduce the cost, each raypath was stored and the inversion was performed from this information. Using the proposed method, fast convergence was achieved. Inversion results are likely to be affected by the initial velocity guess, especially when the ray transmission angle was limited. To provide a good initial guess for the inversion, generalized regression neural network(GRNN) method was used. When the transmitted raypath angle is not limited or the geological model is very complex, the inversion results are not affected by initial velocity model very much. Since the raypath angles, however, are limited in most geophysical tomographic problems, the enhancement of resolution in tomography can be achieved by providing a proper initial velocity model by another inversion algorithm such as GRNN.

  • PDF

Development of a window-shifting ANN training method for a quantitative rock classification in unsampled rock zone (미시추 구간의 정량적 지반 등급 분류를 위한 윈도우-쉬프팅 인공 신경망 학습 기법의 개발)

  • Shin, Hyu-Soung;Kwon, Young-Cheul
    • Journal of Korean Tunnelling and Underground Space Association
    • /
    • v.11 no.2
    • /
    • pp.151-162
    • /
    • 2009
  • This study proposes a new methodology for quantitative rock classification in unsampled rock zone, which occupies the most of tunnel design area. This methodology is to train an ANN (artificial neural network) by using results from a drilling investigation combined with electric resistivity survey in sampled zone, and then apply the trained ANN to making a prediction of grade of rock classification in unsampled zone. The prediction is made at the center point of a shifting window by using a number of electric resistivity values within the window as input reference information. The ANN training in this study was carried out by the RPROP (Resilient backpropagation) training algorithm and Early-Stopping method for achieving a generalized training. The proposed methodology is then applied to generate a rock grade distribution on a real tunnel site where drilling investigation and resistivity survey were undertaken. The result from the ANN based prediction is compared with one from a conventional kriging method. In the comparison, the proposed ANN method shows a better agreement with the electric resistivity distribution obtained by field survey. And it is also seen that the proposed method produces a more realistic and more understandable rock grade distribution.

Synergetics based damage detection of frame structures using piezoceramic patches

  • Hong, Xiaobin;Ruan, Jiaobiao;Liu, Guixiong;Wang, Tao;Li, Youyong;Song, Gangbing
    • Smart Structures and Systems
    • /
    • v.17 no.2
    • /
    • pp.167-194
    • /
    • 2016
  • This paper investigates the Synergetics based Damage Detection Method (SDDM) for frame structures by using surface-bonded PZT (Lead Zirconate Titanate) patches. After analyzing the mechanism of pattern recognition from Synergetics, the operating framework with cooperation-competition-update process of SDDM was proposed. First, the dynamic identification equation of structural conditions was established and the adjoint vector (AV) set of original vector (OV) set was obtained by Generalized Inverse Matrix (GIM).Then, the order parameter equation and its evolution process were deduced through the strict mathematics ratiocination. Moreover, in order to complete online structural condition update feature, the iterative update algorithm was presented. Subsequently, the pathway in which SDDM was realized through the modified Synergetic Neural Network (SNN) was introduced and its assessment indices were confirmed. Finally, the experimental platform with a two-story frame structure was set up. The performances of the proposed methodology were tested for damage identifications by loosening various screw nuts group scenarios. The experiments were conducted in different damage degrees, the disturbance environment and the noisy environment, respectively. The results show the feasibility of SDDM using piezoceramic sensors and actuators, and demonstrate a strong ability of anti-disturbance and anti-noise in frame structure applications. This proposed approach can be extended to the similar structures for damage identification.

The change of rainfall quantiles calculated with artificial neural network model from RCP4.5 climate change scenario (RCP4.5 기후변화 시나리오와 인공신경망을 이용한 우리나라 확률강우량의 변화)

  • Lee, Joohyung;Heo, Jun-Haeng;Kim, Gi Joo;Kim, Young-Oh
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2022.05a
    • /
    • pp.130-130
    • /
    • 2022
  • 기후변화로 인한 기상이변 현상으로 폭우와 홍수 등 수문학적 극치 사상의 출현 빈도가 잦아지고 있다. 따라서 이러한 기상이변 현상에 적응하기 위하여 보다 정확한 확률강우량 측정의 필요성이 증가하고 있다. 대장 지점의 미래 확률강우량 계산을 위해선 기후변화 시나리오의 비정상성을 고려해야 한다. 본 연구는 비정상적인 미래 기후에서 확률강우량이 어떻게 변화하는지 측정하는 것을 목표로 한다. Representative Concentration Pathway (RCP4.5)에 따른 우리나라의 확률강우량 계산에 인공신경망을 포함한 정상성, 비정상성 확률강우량 산정 모델들이 사용되었다. 지점빈도해석(AFA), 홍수지수법(IFM), 모분포홍수지수법(PIF), 인공신경망을 이용한 Quantile & Parameter regression technique(QRT & PRT)이 정상성 자료에 대해 확률강우량을 계산하는 모델로 사용되었으며, 비정상성 자료에 대해서는 비정상성 지점빈도해석(NS-AFA), 비정상성 홍수지수법(NS-IFM), 비정상성 모분포홍수지수법(NS-PIF), 인공신경망을 사용한 비정상성 Quantile & Parameter regression technique(NS-QRT & NS-PRT)이 사용되었다. Rescaled Akaike information criterion(rAIC)를 사용한 불확실성 분석과 적합도 검정을 통해서 generalized extreme value(GEV) 분포형 모델이 정상성 및 비정상성 확률강우량 산정에 가장 적합한 모델로 선정되었다. 이후, 관측자료가 GEV(0,0,0)을 따르고 시나리오 자료가 GEV(1,0,0)을 따르는 지점들을 선택하여 미래의 확률강우량 변화를 추정하였다. 각 빈도해석 모델들은 몬테카를로 시뮬레이션을 통해 bias, relative bias(Rbias), root mean square error(RMSE), relative root mean square error(RRMSE)를 바탕으로 측정하여 정확도를 계산하였으며 그 결과 QRT와 NS-QRT가 각각 정상성과 비정상성 자료로부터 가장 정확하게 확률강우량을 계산하였다. 본 연구를 통해 향후 기후변화의 영향으로 확률강우량이 증가할 것으로 예상되며, 비정상성을 고려한 빈도분석 또한 필요함을 제안하였다.

  • PDF

Efficient Deep Learning Approaches for Active Fire Detection Using Himawari-8 Geostationary Satellite Images (Himawari-8 정지궤도 위성 영상을 활용한 딥러닝 기반 산불 탐지의 효율적 방안 제시)

  • Sihyun Lee;Yoojin Kang;Taejun Sung;Jungho Im
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.5_3
    • /
    • pp.979-995
    • /
    • 2023
  • As wildfires are difficult to predict, real-time monitoring is crucial for a timely response. Geostationary satellite images are very useful for active fire detection because they can monitor a vast area with high temporal resolution (e.g., 2 min). Existing satellite-based active fire detection algorithms detect thermal outliers using threshold values based on the statistical analysis of brightness temperature. However, the difficulty in establishing suitable thresholds for such threshold-based methods hinders their ability to detect fires with low intensity and achieve generalized performance. In light of these challenges, machine learning has emerged as a potential-solution. Until now, relatively simple techniques such as random forest, Vanilla convolutional neural network (CNN), and U-net have been applied for active fire detection. Therefore, this study proposed an active fire detection algorithm using state-of-the-art (SOTA) deep learning techniques using data from the Advanced Himawari Imager and evaluated it over East Asia and Australia. The SOTA model was developed by applying EfficientNet and lion optimizer, and the results were compared with the model using the Vanilla CNN structure. EfficientNet outperformed CNN with F1-scores of 0.88 and 0.83 in East Asia and Australia, respectively. The performance was better after using weighted loss, equal sampling, and image augmentation techniques to fix data imbalance issues compared to before the techniques were used, resulting in F1-scores of 0.92 in East Asia and 0.84 in Australia. It is anticipated that timely responses facilitated by the SOTA deep learning-based approach for active fire detection will effectively mitigate the damage caused by wildfires.

A novel approach to the classification of ultrasonic NDE signals using the Expectation Maximization(EM) and Least Mean Square(LMS) algorithms (Expectation Maximization (EM)과 Least Mean Square(LMS) algorithm을 이용하여 초음파 비파괴검사 신호의 분류를 하기 위한 새로운 접근법)

  • Daewon Kim
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.4 no.1
    • /
    • pp.15-26
    • /
    • 2003
  • Ultrasonic inspection methods are widely used for detecting flaws in materials. The signal analysis step plays a crucial part in the data interpretation process. A number of signal processing methods have been proposed to classify ultrasonic flaw signals. One of the more popular methods involves the extraction of an appropriate set of features followed by the use of a neural network for the classification of the signals in the feature space. This paper describes an alternative approach which uses the least mean square (LMS) method and expectation maximization (EM) algorithm with the model based deconvolution which is employed for classifying nondestructive evaluation (NDE) signals from steam generator tubes in a nuclear power plant. The signals due to cracks and deposits are not significantly different. These signals must be discriminated to prevent from happening a huge disaster such as contamination of water or explosion. A model based deconvolution has been described to facilitate comparison of classification results. The method uses the space alternating generalized expectation maximization (SAGE) algorithm In conjunction with the Newton-Raphson method which uses the Hessian parameter resulting in fast convergence to estimate the time of flight and the distance between the tube wall and the ultrasonic sensor Results using these schemes for the classification of ultrasonic signals from cracks and deposits within steam generator tubes are presented and showed a reasonable performances.

  • PDF

Classification of Ultrasonic NDE Signals Using the Expectation Maximization (EM) and Least Mean Square (LMS) Algorithms (최대 추정 기법과 최소 평균 자승 알고리즘을 이용한 초음파 비파괴검사 신호 분류법)

  • Kim, Dae-Won
    • Journal of the Korean Society for Nondestructive Testing
    • /
    • v.25 no.1
    • /
    • pp.27-35
    • /
    • 2005
  • Ultrasonic inspection methods are widely used for detecting flaws in materials. The signal analysis step plays a crucial part in the data interpretation process. A number of signal processing methods have been proposed to classify ultrasonic flaw signals. One of the more popular methods involves the extraction of an appropriate set of features followed by the use of a neural network for the classification of the signals in the feature spare. This paper describes an alternative approach which uses the least mean square (LMS) method and exportation maximization (EM) algorithm with the model based deconvolution which is employed for classifying nondestructive evaluation (NDE) signals from steam generator tubes in a nuclear power plant. The signals due to cracks and deposits are not significantly different. These signals must be discriminated to prevent from happening a huge disaster such as contamination of water or explosion. A model based deconvolution has been described to facilitate comparison of classification results. The method uses the space alternating generalized expectation maximiBation (SAGE) algorithm ill conjunction with the Newton-Raphson method which uses the Hessian parameter resulting in fast convergence to estimate the time of flight and the distance between the tube wall and the ultrasonic sensor. Results using these schemes for the classification of ultrasonic signals from cracks and deposits within steam generator tubes are presented and showed a reasonable performances.

Generalized Sigmidal Basis Function for Improving the Learning Performance fo Multilayer Perceptrons (다층 퍼셉트론의 학습 성능 개선을 위한 일반화된 시그모이드 베이시스 함수)

  • Park, Hye-Yeong;Lee, Gwan-Yong;Lee, Il-Byeong;Byeon, Hye-Ran
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.11
    • /
    • pp.1261-1269
    • /
    • 1999
  • 다층 퍼셉트론은 다양한 응용 분야에 성공적으로 적용되고 있는 대표적인 신경회로망 모델이다. 그러나 다층 퍼셉트론의 학습에서 나타나는 플라토에 기인한 느린 학습 속도와 지역 극소는 실제 응용문제에 적용함에 있어서 가장 큰 문제로 지적되어왔다. 이 문제를 해결하기 위해 여러 가지 다양한 학습알고리즘들이 개발되어 왔으나, 계산의 비효율성으로 인해 실제 문제에는 적용하기 힘든 예가 많은 등, 현재까지 만족할 만한 해결책은 제시되지 못하고 있다. 본 논문에서는 다층퍼셉트론의 베이시스 함수로 사용되는 시그모이드 함수를 보다 일반화된 형태로 정의하여 사용함으로써 학습에 있어서의 플라토를 완화하고, 지역극소에 빠지는 것을 줄이는 접근방법을 소개한다. 본 방법은 기존의 변형된 가중치 수정식을 사용한 학습 속도 향상의 방법들과는 다른 접근 방법을 택함으로써 기존의 방법들과 함께 사용하는 것이 가능하다는 특징을 갖고 있다. 제안하는 방법의 성능을 확인하기 위하여 간단한 패턴 인식 문제들에의 적용 실험 및 기존의 학습 속도 향상 방법을 함께 사용하여 시계열 예측 문제에 적용한 실험을 수행하였고, 그 결과로부터 제안안 방법의 효율성을 확인할 수 있었다. Abstract A multilayer perceptron is the most well-known neural network model which has been successfully applied to various fields of application. Its slow learning caused by plateau and local minima of gradient descent learning, however, have been pointed as the biggest problems in its practical use. To solve such a problem, a number of researches on learning algorithms have been conducted, but it can be said that none of satisfying solutions have been presented so far because the problems such as computational inefficiency have still been existed in these algorithms. In this paper, we propose a new learning approach to minimize the effect of plateau and reduce the possibility of getting trapped in local minima by generalizing the sigmoidal function which is used as the basis function of a multilayer perceptron. Adapting a new approach that differs from the conventional methods with revised updating equation, the proposed method can be used together with the existing methods to improve the learning performance. We conducted some experiments to test the proposed method on simple problems of pattern recognition and a problem of time series prediction, compared our results with the results of the existing methods, and confirmed that the proposed method is efficient enough to apply to the real problems.

A Study of 'Emotion Trigger' by Text Mining Techniques (텍스트 마이닝을 이용한 감정 유발 요인 'Emotion Trigger'에 관한 연구)

  • An, Juyoung;Bae, Junghwan;Han, Namgi;Song, Min
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.2
    • /
    • pp.69-92
    • /
    • 2015
  • The explosion of social media data has led to apply text-mining techniques to analyze big social media data in a more rigorous manner. Even if social media text analysis algorithms were improved, previous approaches to social media text analysis have some limitations. In the field of sentiment analysis of social media written in Korean, there are two typical approaches. One is the linguistic approach using machine learning, which is the most common approach. Some studies have been conducted by adding grammatical factors to feature sets for training classification model. The other approach adopts the semantic analysis method to sentiment analysis, but this approach is mainly applied to English texts. To overcome these limitations, this study applies the Word2Vec algorithm which is an extension of the neural network algorithms to deal with more extensive semantic features that were underestimated in existing sentiment analysis. The result from adopting the Word2Vec algorithm is compared to the result from co-occurrence analysis to identify the difference between two approaches. The results show that the distribution related word extracted by Word2Vec algorithm in that the words represent some emotion about the keyword used are three times more than extracted by co-occurrence analysis. The reason of the difference between two results comes from Word2Vec's semantic features vectorization. Therefore, it is possible to say that Word2Vec algorithm is able to catch the hidden related words which have not been found in traditional analysis. In addition, Part Of Speech (POS) tagging for Korean is used to detect adjective as "emotional word" in Korean. In addition, the emotion words extracted from the text are converted into word vector by the Word2Vec algorithm to find related words. Among these related words, noun words are selected because each word of them would have causal relationship with "emotional word" in the sentence. The process of extracting these trigger factor of emotional word is named "Emotion Trigger" in this study. As a case study, the datasets used in the study are collected by searching using three keywords: professor, prosecutor, and doctor in that these keywords contain rich public emotion and opinion. Advanced data collecting was conducted to select secondary keywords for data gathering. The secondary keywords for each keyword used to gather the data to be used in actual analysis are followed: Professor (sexual assault, misappropriation of research money, recruitment irregularities, polifessor), Doctor (Shin hae-chul sky hospital, drinking and plastic surgery, rebate) Prosecutor (lewd behavior, sponsor). The size of the text data is about to 100,000(Professor: 25720, Doctor: 35110, Prosecutor: 43225) and the data are gathered from news, blog, and twitter to reflect various level of public emotion into text data analysis. As a visualization method, Gephi (http://gephi.github.io) was used and every program used in text processing and analysis are java coding. The contributions of this study are as follows: First, different approaches for sentiment analysis are integrated to overcome the limitations of existing approaches. Secondly, finding Emotion Trigger can detect the hidden connections to public emotion which existing method cannot detect. Finally, the approach used in this study could be generalized regardless of types of text data. The limitation of this study is that it is hard to say the word extracted by Emotion Trigger processing has significantly causal relationship with emotional word in a sentence. The future study will be conducted to clarify the causal relationship between emotional words and the words extracted by Emotion Trigger by comparing with the relationships manually tagged. Furthermore, the text data used in Emotion Trigger are twitter, so the data have a number of distinct features which we did not deal with in this study. These features will be considered in further study.