• Title/Summary/Keyword: data-based model

Search Result 21,096, Processing Time 0.049 seconds

Applying Transfer Learning to Improve the Performance of Deep Learning-based Groundwater Level Prediction Model with Insufficient Training Data (딥러닝 기반 지하수위 예측 모델 개발에 있어 데이터 부족 문제 해결을 위한 전이학습의 응용)

  • Jiho Jeong;Jina Jeong
    • Economic and Environmental Geology
    • /
    • v.57 no.5
    • /
    • pp.551-562
    • /
    • 2024
  • Predicting groundwater levels with data-driven models like artificial neural networks typically requires a substantial amount of data. However, when groundwater monitoring wells are newly developed or when a significant portion of the data is invalid (for example, due to missing values or outliers), acquiring an adequate dataset for training prediction models becomes challenging, leading to diminished prediction accuracy. This study proposes a method based on transfer learning to address the issue of insufficient training data. The Gated Recurrent Unit (GRU) was used as the primary data-driven model for predictions. A GRU-based pretrained network for the transfer learning process was developed using groundwater level and corresponding rainfall data collected from 89 monitoring stations nationwide. Subsequently, this pretrained network was fine-tuned using a small amount of training data obtained from the target monitoring well to develop the final prediction model. To verify the effectiveness of the transfer learning algorithm, two different groundwater level prediction models were evaluated: 1) a GRU-based model trained with insufficient data from the target well, and 2) a GRU-based model utilizing the transfer learning algorithm. Comparative verification was conducted with groundwater level data obtained from wells at two different locations, where the model using the transfer learning algorithm demonstrated superior performance compared to the other. This study confirms that the transfer learning algorithm can significantly enhance the performance of groundwater level prediction models, irrespective of the amount of available training data.

A design concept on object database of measurement data for building a safety management network of road bridges (도로 교량의 안전관리 네트워크 구축을 위한 계측자료의 객체 데이터베이스 설계 개념)

  • Park, Sang-Il;An, Hyun-Jung;Kim, Hoy-Jin;Lee, Sang-Ho
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2008.04a
    • /
    • pp.518-523
    • /
    • 2008
  • In this study, we analyzed applicability of object database, designed the concept model based on object-oriented idea for measurement data management, and applied the design model to object database. The concept model composes three sub models Infrastructure managing information model, Infrastructure measurement data model, and Measurement unit model. The process to expand measurement data of new type was executed easily without changing database schema in object database. The process to expand measurement data of new type was executed easily without changing database schema in object database. Therefore, applicability of new technology to infrastructures for building a safety management network of road bridges could be increased with object database system.

  • PDF

Time series Analysis of State-space Model and Multiplication ARIMA Model in Dissolved Oxygen Simulation (용존산소 농도모의시 상태공간모형과 승법 ARIMA모형의 시계열 분석)

  • 이원호;서인석;한양수
    • Journal of environmental and Sanitary engineering
    • /
    • v.15 no.2
    • /
    • pp.65-74
    • /
    • 2000
  • The purpose of this study is to develop the stochastic stream water quality model for the intake station of Chung-Ju city waterworks in the Han river system. This model was based on the theory of Box-Jenkins Multiplicative ARIMA(SARIMA) and the state space model to simulate changes of water qualities. Variable of water qualities included in the model are temperature and dissolved oxygen(DO). The models development were based on the data obtained from Jan. 1990 to Dec. 1997 and followed the typical procedures of the Box-Jenkins method including identification and estimation. The seasonality of DO and temperature data to formulate for the SARIMA model are conspicuous and the period of revolution was twelve months. Both models had seasonality of twelve months and were formulates as SARIMA {TEX}$(2,1,1)(1,1,1)_{12}${/TEX} for DO and temperature. The models were validated by testing normality and independency of the residuals. The prediction ability of SARIMA model and state space model were tested using the data collected from Jan. 1998 to Oct. 1999. There were good agreements between the model predictions and the field measurements. The performance of the SARIMA model and state space model were examined through comparisons between the historical and generated monthly dissolved oxygen series. The result reveal that the state space model lead to the improved accuracy.

  • PDF

City Information Model-based Information Management of Flood Damages (도시정보모델의 침수피해정보관리에서의 활용)

  • Park, Sang Il;Kim, Min-Su;Kim, Jong Myung;Lee, Sang-Ho
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.28 no.4
    • /
    • pp.385-392
    • /
    • 2015
  • Open city information model can increase the understanding of the situation, enable the effective reuse of information due to access the semantic and relational conditions of objects, and support the reliable decision-making through linking with external references. The city information model focused on terrain and buildings was implemented based on the actual data. In addition, a process for flooding simulation was proposed using hydraulic analysis data and the city information model. The deaths and damages were estimated by flooding simulation. The availabilities were examined by detailed queries and responses based on model data of the city information model, hydraulic analysis data and the estimated damages.

Auxiliary Stacked Denoising Autoencoder based Collaborative Filtering Recommendation

  • Mu, Ruihui;Zeng, Xiaoqin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.6
    • /
    • pp.2310-2332
    • /
    • 2020
  • In recent years, deep learning techniques have achieved tremendous successes in natural language processing, speech recognition and image processing. Collaborative filtering(CF) recommendation is one of widely used methods and has significant effects in implementing the new recommendation function, but it also has limitations in dealing with the problem of poor scalability, cold start and data sparsity, etc. Combining the traditional recommendation algorithm with the deep learning model has brought great opportunity for the construction of a new recommender system. In this paper, we propose a novel collaborative recommendation model based on auxiliary stacked denoising autoencoder(ASDAE), the model learns effective the preferences of users from auxiliary information. Firstly, we integrate auxiliary information with rating information. Then, we design a stacked denoising autoencoder based collaborative recommendation model to learn the preferences of users from auxiliary information and rating information. Finally, we conduct comprehensive experiments on three real datasets to compare our proposed model with state-of-the-art methods. Experimental results demonstrate that our proposed model is superior to other recommendation methods.

A Non-Oriented DEA Game Cross Efficiency Model for Supplier Selection (비방향 DEA 게임 교차효율성을 이용한 공급업체 선정방법)

  • Lim, Sungmook
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.38 no.2
    • /
    • pp.108-119
    • /
    • 2015
  • This study intends to propose a non-oriented DEA based game cross-efficiency approach for supplier selection. With a discussion on the choice of DEA models and approaches that are most appropriate for supplier selection, we propose a game cross efficiency model based upon the non-oriented variable returns-to-scale RAM DEA by adapting the existing game cross efficiency model based upon the oriented constant returns-to-scale CCR DEA. We develop the RAM game cross efficiency model and a convergent iterative solution procedure to find the best game cross efficiency scores that constitute a Nash equilibrium. We illustrate the proposed model with two data sets of supplier selection, and demonstrate that significantly different results are obtained when compared with the existing approaches.

Surrogate based model calibration for pressurized water reactor physics calculations

  • Khuwaileh, Bassam A.;Turinsky, Paul J.
    • Nuclear Engineering and Technology
    • /
    • v.49 no.6
    • /
    • pp.1219-1225
    • /
    • 2017
  • In this work, a scalable algorithm for model calibration in nuclear engineering applications is presented and tested. The algorithm relies on the construction of surrogate models to replace the original model within the region of interest. These surrogate models can be constructed efficiently via reduced order modeling and subspace analysis. Once constructed, these surrogate models can be used to perform computationally expensive mathematical analyses. This work proposes a surrogate based model calibration algorithm. The proposed algorithm is used to calibrate various neutronics and thermal-hydraulics parameters. The virtual environment for reactor applications-core simulator (VERA-CS) is used to simulate a three-dimensional core depletion problem. The proposed algorithm is then used to construct a reduced order model (a surrogate) which is then used in a Bayesian approach to calibrate the neutronics and thermal-hydraulics parameters. The algorithm is tested and the benefits of data assimilation and calibration are highlighted in an uncertainty quantification study and requantification after the calibration process. Results showed that the proposed algorithm could help to reduce the uncertainty in key reactor attributes based on experimental and operational data.

An Efficient Data Distribution Method on a Distributed Shared Memory Machine (분산공유 메모리 시스템 상에서의 효율적인 자료분산 방법)

  • Min, Ok-Gee
    • The Transactions of the Korea Information Processing Society
    • /
    • v.3 no.6
    • /
    • pp.1433-1442
    • /
    • 1996
  • Data distribution of SPMD(Single Program Multiple Data) pattern is one of main features of HPF (High Performance Fortran). This paper describes design is sues for such data distribution and its efficient execution model on TICOM IV computer, named SPAX(Scalable Parallel Architecture computer based on X-bar network). SPAX has a hierarchical clustering structure that uses distributed shared memory(DSM). In such memory structure, it cannot make a full system utilization to apply unanimously either SMDD(shared Memory Data Distribution) or DMDD(Distributed Memory Data Distribution). Here we propose another data distribution model, called DSMDD(Distributed Shared Memory Data Distribution), a data distribution model based on hierarchical masters-slaves scheme. In this model, a remote master and slaves are designated in each node, shared address scheme is used within a node and message passing scheme between nodes. In our simulation, assuming a node size in which system performance degradation is minimized,DSMDD is more effective than SMDD and DMDD. Especially,the larger number of logical processors and the less data dependency between distributed data,the better performace is obtained.

  • PDF

Development of statistical forecast model for PM10 concentration over Seoul (서울지역 PM10 농도 예측모형 개발)

  • Sohn, Keon Tae;Kim, Dahong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.26 no.2
    • /
    • pp.289-299
    • /
    • 2015
  • The objective of the present study is to develop statistical quantitative forecast model for PM10 concentration over Seoul. We used three types of data (weather observation data in Korea, the China's weather observation data collected by GTS, and air quality numerical model forecasts). To apply the daily forecast system, hourly data are converted to daily data and then lagging was performed. The potential predictors were selected based on correlation analysis and multicollinearity check. Model validation has been performed for checking model stability. We applied two models (multiple regression model and threshold regression model) separately. The two models were compared based on the scatter plot of forecasts and observations, time series plots, RMSE, skill scores. As a result, a threshold regression model performs better than multiple regression model in high PM10 concentration cases.

BIM-Based Generation of Free-form Building Panelization Model (BIM 기반 비정형 건축물 패널화 모델 생성 방법에 관한 연구)

  • Kim, Yang-Gil;Lee, Yun-Gu;Ham, Nam-Hyuk;Kim, Jae-Jun
    • Journal of KIBIM
    • /
    • v.12 no.4
    • /
    • pp.19-31
    • /
    • 2022
  • With the development of 3D-based CAD (Computer Aided Design), attempts at freeform building design have expanded to small and medium-sized buildings in Korea. However, a standardized system for continuous utilization of shape data and BIM conversion process implemented with 3D-based NURBS is still immature. Without accurate review and management throughout the Freeform building project, interference between members occurs and the cost of the project increases. This is very detrimental to the project. To solve this problem, we proposed a continuous utilization process of 3D shape information based on BIM parameters. Our process includes algorithms such as Auto Split, Panel Optimization, Excel extraction based on shape information, BIM modeling through Adaptive Component, and BIM model utilization method using ID Code. The optimal cutting reference point was calculated and the optimal material specification was derived using the Panel Optimization algorithm. With the Adaptive Component design methodology, a BIM model conforming to the standard cross-section details and specifications was uniformly established. The automatic BIM conversion algorithm of shape data through Excel extraction created a BIM model without omission of data based on the optimized panel cutting reference point and cutting line. Finally, we analyzed how to use the BIM model built for automatic conversion. As a result of the analysis, in addition to the BIM utilization plan in the general construction stage such as visualization, interference review, quantity calculation, and construction simulation, an individual management plan for the unit panel was derived through ID data input. This study suggested an improvement process by linking the existing research on atypical panel optimization and the study of parameter-based BIM information management method. And it showed that it can solve the problems of existing Freeform building project.