• Title/Summary/Keyword: Scientific Computing

Search Result 182, Processing Time 0.022 seconds

Design and Implementation of an Execution-Provenance Based Simulation Data Management Framework for Computational Science Engineering Simulation Platform (계산과학공학 플랫폼을 위한 실행-이력 기반의 시뮬레이션 데이터 관리 프레임워크 설계 및 구현)

  • Ma, Jin;Lee, Sik;Cho, Kum-won;Suh, Young-kyoon
    • Journal of Internet Computing and Services
    • /
    • v.19 no.1
    • /
    • pp.77-86
    • /
    • 2018
  • For the past few years, KISTI has been servicing an online simulation execution platform, called EDISON, allowing users to conduct simulations on various scientific applications supplied by diverse computational science and engineering disciplines. Typically, these simulations accompany large-scale computation and accordingly produce a huge volume of output data. One critical issue arising when conducting those simulations on an online platform stems from the fact that a number of users simultaneously submit to the platform their simulation requests (or jobs) with the same (or almost unchanging) input parameters or files, resulting in charging a significant burden on the platform. In other words, the same computing jobs lead to duplicate consumption computing and storage resources at an undesirably fast pace. To overcome excessive resource usage by such identical simulation requests, in this paper we introduce a novel framework, called IceSheet, to efficiently manage simulation data based on execution metadata, that is, provenance. The IceSheet framework captures and stores each provenance associated with a conducted simulation. The collected provenance records are utilized for not only inspecting duplicate simulation requests but also performing search on existing simulation results via an open-source search engine, ElasticSearch. In particular, this paper elaborates on the core components in the IceSheet framework to support the search and reuse on the stored simulation results. We implemented as prototype the proposed framework using the engine in conjunction with the online simulation execution platform. Our evaluation of the framework was performed on the real simulation execution-provenance records collected on the platform. Once the prototyped IceSheet framework fully functions with the platform, users can quickly search for past parameter values entered into desired simulation software and receive existing results on the same input parameter values on the software if any. Therefore, we expect that the proposed framework contributes to eliminating duplicate resource consumption and significantly reducing execution time on the same requests as previously-executed simulations.

Livestock Disease Forecasting and Smart Livestock Farm Integrated Control System based on Cloud Computing (클라우드 컴퓨팅기반 가축 질병 예찰 및 스마트 축사 통합 관제 시스템)

  • Jung, Ji-sung;Lee, Meong-hun;Park, Jong-kweon
    • Smart Media Journal
    • /
    • v.8 no.3
    • /
    • pp.88-94
    • /
    • 2019
  • Livestock disease is a very important issue in the livestock industry because if livestock disease is not responded quickly enough, its damage can be devastating. To solve the issues involving the occurrence of livestock disease, it is necessary to diagnose in advance the status of livestock disease and develop systematic and scientific livestock feeding technologies. However, there is a lack of domestic studies on such technologies in Korea. This paper, therefore, proposes Livestock Disease Forecasting and Livestock Farm Integrated Control System using Cloud Computing to quickly manage livestock disease. The proposed system collects a variety of livestock data from wireless sensor networks and application. Moreover, it saves and manages the data with the use of the column-oriented database Hadoop HBase, a column-oriented database management system. This provides livestock disease forecasting and livestock farm integrated controlling service through MapReduce Model-based parallel data processing. Lastly, it also provides REST-based web service so that users can receive the service on various platforms, such as PCs or mobile devices.

Development and Application of a Turtle Ship Model Based on Physical Computing Platform for Students of Industrial Specialized High School (공업계 특성화고 학생을 위한 피지컬 컴퓨팅 플랫폼 기반의 모형 거북선 개발 및 적용)

  • Kim, Won-Woong;Choi, Jun-Seop
    • 대한공업교육학회지
    • /
    • v.41 no.2
    • /
    • pp.89-118
    • /
    • 2016
  • In this study, the model of Turtle Ship, which is evaluated as one of the world's first ironclad ship in battle as well as the traditional scientific and technological heritage in Korea, was combined with the Physical Computing Platform(Arduino and App Inventor) that enables students to learn the basic concepts of IT in an easy and fun way. Thus, this study contrived the Physical Computing Platform-based Turtle Ship model which will make the students of Industrial Specialized High School develop the technological literacy and humanities-based knowledge through flexible education out of stereotype and single subject as well as enhance the potential of creative convergence education. The following is a summary of the main results obtained through this study: First, Arduino-based Main-controller design and making is helpful to learn of the hardware and software knowledge about EEC(Electron Electronics Control) and to confirm the basic characteristics and performance of interaction of Arduino and actuators. Second, The fundamental Instructional environments of abilities such as implementing EEC systems, thinking logically, and problem-solving skills were provided by designing of pattern diagram, designing an actuator circuit and making, the creation of sketches as technical programming and developing of mobile app. Thirdly, This is physical computing platform based Turtle ship model that will enable students to bring up their technological literacy and interest in the cultural heritage.

A small review and further studies on the LASSO

  • Kwon, Sunghoon;Han, Sangmi;Lee, Sangin
    • Journal of the Korean Data and Information Science Society
    • /
    • v.24 no.5
    • /
    • pp.1077-1088
    • /
    • 2013
  • High-dimensional data analysis arises from almost all scientific areas, evolving with development of computing skills, and has encouraged penalized estimations that play important roles in statistical learning. For the past years, various penalized estimations have been developed, and the least absolute shrinkage and selection operator (LASSO) proposed by Tibshirani (1996) has shown outstanding ability, earning the first place on the development of penalized estimation. In this paper, we first introduce a number of recent advances in high-dimensional data analysis using the LASSO. The topics include various statistical problems such as variable selection and grouped or structured variable selection under sparse high-dimensional linear regression models. Several unsupervised learning methods including inverse covariance matrix estimation are presented. In addition, we address further studies on new applications which may establish a guideline on how to use the LASSO for statistical challenges of high-dimensional data analysis.

An Application-Level Fault Tolerant System For Synchronous Parallel Computation (동기 병렬연산을 위한 응용수준의 결함 내성 연산시스템)

  • Park, Pil-Seong
    • Journal of Internet Computing and Services
    • /
    • v.9 no.5
    • /
    • pp.185-193
    • /
    • 2008
  • An MTBF(mean time between failures) of large scale parallel systems is known to be only an order of several hours, and large computations sometimes result in a waste of huge amount of CPU time, However. the MPI(Message Passing Interface), a de facto standard for message passing parallel programming, suggests no possibility to handle such a problem. In this paper, we propose an application-level fault tolerant computation system, purely on the basis of the current MPI standard without using any non-standard fault tolerant MPI library, that can be used for general scientific synchronous parallel computation.

  • PDF

Development of 3D Visualization Technology for Meteorological Data (기상자료 3차원 가시화 기술개발 연구)

  • Seo In Bum;Joh Min Su;Yun Ja Young
    • Journal of the Korean Society of Visualization
    • /
    • v.1 no.2
    • /
    • pp.58-70
    • /
    • 2003
  • Meteorological data contains observation and numerical weather prediction model output data. The computerized analysis and visualization of meteorological data often requires very high computing capability due to the large size and complex structure of the data. Because the meteorological data is frequently formed in multi-variables, 3-dimensional and time-series form, it is very important to visualize and analyze the data in 3D spatial domain in order to get more understanding about the meteorological phenomena. In this research, we developed interactive 3-dimensional visualization techniques for visualizing meteorological data on a PC environment such as volume rendering, iso-surface rendering or stream line. The visualization techniques developed in this research are expected to be effectively used as basic technologies not only for deeper understanding and more exact prediction about meteorological environments but also for scientific and spatial data visualization research in any field from which three dimensional data comes out such as oceanography, earth science, and aeronautical engineering.

  • PDF

DATA MINING AND PREDICTION OF SAI TYPE MATRIX PRECONDITIONER

  • Kim, Sang-Bae;Xu, Shuting;Zhang, Jun
    • Journal of applied mathematics & informatics
    • /
    • v.28 no.1_2
    • /
    • pp.351-361
    • /
    • 2010
  • The solution of large sparse linear systems is one of the most important problems in large scale scientific computing. Among the many methods developed, the preconditioned Krylov subspace methods are considered the preferred methods. Selecting a suitable preconditioner with appropriate parameters for a specific sparse linear system presents a challenging task for many application scientists and engineers who have little knowledge of preconditioned iterative methods. The prediction of ILU type preconditioners was considered in [27] where support vector machine(SVM), as a data mining technique, is used to classify large sparse linear systems and predict best preconditioners. In this paper, we apply the data mining approach to the sparse approximate inverse(SAI) type preconditioners to find some parameters with which the preconditioned Krylov subspace method on the linear systems shows best performance.

Parallel Algorithm for Matrix-Matrix Multiplication on the GPU (GPU 기반 행렬 곱셈 병렬처리 알고리즘)

  • Park, Sangkun
    • Journal of Institute of Convergence Technology
    • /
    • v.9 no.1
    • /
    • pp.1-6
    • /
    • 2019
  • Matrix multiplication is a fundamental mathematical operation that has numerous applications across most scientific fields. In this paper, we presents a parallel GPU computation algorithm for dense matrix-matrix multiplication using OpenGL compute shader, which can play a very important role as a fundamental building block for many high-performance computing applications. Experimental results on NVIDIA Quad 4000 show that the proposed algorithm runs about 208 times faster than previous CPU algorithm and achieves performance of 75 GFLOPS in single precision for dense matrices with matrix size 4,096. Such performance proves that our algorithm is practical for real applications.

On the continuum formulation for modeling DNA loop formation

  • Teng, Hailong;Lee, Chung-Hao;Chen, Jiun-Shyan
    • Interaction and multiscale mechanics
    • /
    • v.4 no.3
    • /
    • pp.219-237
    • /
    • 2011
  • Recent advances in scientific computing enable the full atomistic simulation of DNA molecules. However, there exists length and time scale limitations in molecular dynamics (MD) simulation for large DNA molecules. In this work, a two-level homogenization of DNA molecules is proposed. A wavelet projection method is first introduced to form a coarse-grained DNA molecule represented with superatoms. The coarsened MD model offers a simplified molecular structure for the continuum description of DNA molecules. The coarsened DNA molecular structure is then homogenized into a three-dimensional beam with embedded molecular properties. The methods to determine the elasticity constants in the continuum model are also presented. The proposed continuum model is adopted for the study of mechanical behavior of DNA loop.

DEVELOPMENT OF A HYBRID CFD FRAMEDWORK FOR MULTI-PHENOMENA FLOW ANALYSIS AND DESIGN (다중현상 유동 해석 및 설계를 위한 융복합 프레임웍 개발)

  • Hur, Nahm-Keon
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2010.05a
    • /
    • pp.517-523
    • /
    • 2010
  • Recently, the rapid evolution of computational fluid dynamics (CFD) has enabled its key role in industries and predictive sciences. From diverse research disciplines, however, are there strong needs for integrated analytical tools for multi-phenomena beyond simple flow simulation. Based on the concurrent simulation of multi-dynamics, multi-phenomena beyond simple flow simulation. Based on the concurrent simulation of multi-dynamics, multi-physics and multi-scale phenomena, the multi-phenomena CFD technology enables us to perform the flow simulation for integrated and complex systems. From the multi-phenomena CFD analysis, the high-precision analytical and predictive capacity can enhance the fast development of industrial technologies. It is also expected to further enhance the applicability of the simulation technique to medical and bio technology, new and renewable energy, nanotechnology, and scientific computing, among others.

  • PDF