• Title/Summary/Keyword: DATA PRE-PROCESSING

Search Result 818, Processing Time 0.037 seconds

Development of Distributed Hydrological Analysis Tool for Future Climate Change Impacts Assessment of South Korea (전국 기후변화 영향평가를 위한 분포형 수문분석 툴 개발)

  • Kim, Seong Joon;Kim, Sang Ho;Joh, Hyung Kyung;Ahn, So Ra
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.57 no.2
    • /
    • pp.15-26
    • /
    • 2015
  • The purpose of this paper is to develop a software tool, PGA-CC (Projection of hydrology via Grid-based Assessment for Climate Change) to evaluate the present hydrologic cycle and the future watershed hydrology by climate change. PGA-CC is composed of grid-based input data pre-processing module, hydrologic cycle calculation module, output analysis module, and output data post-processing module. The grid-based hydrological model was coded by Fortran and compiled using Compaq Fortran 6.6c, and the Graphic User Interface was developed by using Visual C#. Other most elements viz. Table and Graph, and GIS functions were implemented by MapWindow. The applicability of PGA-CC was tested by assessing the future hydrology of South Korea by HadCM3 SRES B1 and A2 climate change scenarios. For the whole country, the tool successfully assessed the future hydrological components including input data and evapotranspiration, soil moisture, surface runoff, lateral flow, base flow etc. From the spatial outputs, we could understand the hydrological changes both seasonally and regionally.

Design of a PC based Real-Time Software GPS Receiver (PC기반 실시간 소프트웨어 GPS 수신기 설계)

  • Ko, Sun-Jun;Won, Jong-Hoon;Lee, Ja-Sung
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.55 no.6
    • /
    • pp.286-295
    • /
    • 2006
  • This paper presents a design of a real-time software GPS receiver which runs on a PC. The software GPS receiver has advantages over conventional hardware based receivers in terms of flexibility and efficiency in application oriented system design and modification. In odor to reduce the processing time of the software operations in the receiver, a shared memory structure is used with a dynamic data control, and the byte-type IF data is processed through an Open Multi-Processing technique in the mixer and integrator which requires the most computational load. A high speed data acquisition device is used to capture the incoming high-rate IF signals. The FFT-IFFT correlation technique is used for initial acquisition and FLL assisted PLL is used for carrier tracking. All software modules are operated in sequence and are synchronized with pre-defined time scheduling. The performance of the designed software GPS receiver is evaluated by running it in real-time using the real GPS signals.

Real-time Human Detection under Omni-dir ectional Camera based on CNN with Unified Detection and AGMM for Visual Surveillance

  • Nguyen, Thanh Binh;Nguyen, Van Tuan;Chung, Sun-Tae;Cho, Seongwon
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.8
    • /
    • pp.1345-1360
    • /
    • 2016
  • In this paper, we propose a new real-time human detection under omni-directional cameras for visual surveillance purpose, based on CNN with unified detection and AGMM. Compared to CNN-based state-of-the-art object detection methods. YOLO model-based object detection method boasts of very fast object detection, but with less accuracy. The proposed method adapts the unified detecting CNN of YOLO model so as to be intensified by the additional foreground contextual information obtained from pre-stage AGMM. Increased computational time incurred by additional AGMM processing is compensated by speed-up gain obtained from utilizing 2-D input data consisting of grey-level image data and foreground context information instead of 3-D color input data. Through various experiments, it is shown that the proposed method performs better with respect to accuracy and more robust to environment changes than YOLO model-based human detection method, but with the similar processing speeds to that of YOLO model-based one. Thus, it can be successfully employed for embedded surveillance application.

A Prediction-Based Data Read Ahead Policy using Decision Tree for improving the performance of NAND flash memory based storage devices (낸드 플래시 메모리 기반 저장 장치의 성능 향상을 위해 결정트리를 이용한 예측 기반 데이터 미리 읽기 정책)

  • Lee, Hyun-Seob
    • Journal of Internet of Things and Convergence
    • /
    • v.8 no.4
    • /
    • pp.9-15
    • /
    • 2022
  • NAND flash memory is used as a medium for various storage devices due to its high data processing speed with low power consumption. However, since the read processing speed of data is about 10 times faster than the write processing speed, various studies are being conducted to improve the speed difference. In particular, flash dedicated buffer management policies have been studied to improve write speed. However, SSD(solid state disks), which has recently been used for various purposes, is more vulnerable to read performance than write performance. In this paper, we find out why read performance is slower than write performance in SSD composed of NAND flash memory and study buffer management policies to improve it. The buffer management policy proposed in this paper proposes a method of improving the speed of a flash-based storage device by analyzing the pattern of read data and applying a policy of pre-reading data to be requested in the future from NAND flash memory. It also proves the effectiveness of the read-ahead policy through simulation.

A Study for Efficient Transmission Policies using Multimedia Scenarios (멀티미디어 시나리오를 이용한 효율적인 데이터 전송 기법 연구)

  • Suh, Duk-Rok;Lee, Won-Suk
    • The Transactions of the Korea Information Processing Society
    • /
    • v.5 no.11
    • /
    • pp.2797-2808
    • /
    • 1998
  • Multimedia scenario database system is a read-only multimedia-on-demand system which transfers scenarios representing the display ordering of multimedia objects. A scenario is a graph of multimedia objects and it contains spatial, temporal and contextual information of multimedia data. By structuring multimedia objects as a scenario, it is possible to enforce their display order based on their context. Furthermore, it can provide multiple display paths as well as the sharing of objects between different scenarios. As a result, the multimedia scenario database system can perform the pre-scheduling of multimedia objects, which makes it possible to reorder the transmission order of objects in a scenario. Consequently, the overall system resource such as data buffer and network bandwidth can be highly utilized. In this paper, we discuss the requirements of structuring a scenario to design a scenario database that stores and manages multimedia scenario. Furthermore, we devise and analyze several scheduling policies based on the reordering mechanism for the objects in a scenario.

  • PDF

Development of Web-Based Assistant System for Protein-Protein Interaction and Function Analysis (웹 기반의 단백질 상호작용 및 기능분석을 위한 보조 시스템 개발)

  • Jung Min-Chul;Park Wan;Kim Ki-Bong
    • Journal of Life Science
    • /
    • v.14 no.6 s.67
    • /
    • pp.997-1002
    • /
    • 2004
  • This paper deals with the WASPIFA (Web-based Assistant System for Protein-protein Interaction and Function Analysis) system that can provide the comprehensive information on Protein-protein interaction and function concerned with function analysis. Different from existing systems for protein function and protein-protein interaction analysis, which provide fragmentary information restricted to specific field, our system furnishes end-user with comprehensive and synthetic information on the input sequence to be analyzed, including function and annotation information, domain information, and interaction relationship information. The synthetic information that our system contains as local databases has been extracted from many resources related to function, annotation, motif and domain by various pre-processing. Employing our system, end-users can evaluate and judge the synthetic results to do protein interaction and function analysis effectively. In addition, the WASPIFA system is equipped with automatic system management and data update function that facilitates system manager to maintain and manage it efficiently.

Design and Implementation of Advanced Web Log Preprocess Algorithm for Rule based Web IDS (룰 기반 웹 IDS 시스템을 위한 효율적인 웹 로그 전처리 기법 설계 및 구현)

  • Lee, Hyung-Woo
    • Journal of Internet Computing and Services
    • /
    • v.9 no.5
    • /
    • pp.23-34
    • /
    • 2008
  • The number of web service user is increasing steadily as web-based service is offered in various form. But, web service has a vulnerability such as SQL Injection, Parameter Injection and DoS attack. Therefore, it is required for us to develop Web IDS system and additionally to offer Rule-base intrusion detection/response mechanism against those attacks. However, existing Web IDS system didn't correspond properly on recent web attack mechanism because they didn't including suitable pre-processing procedure on huge web log data. Therfore, we propose an efficient web log pre-processing mechanism for enhancing rule based detection and improving the performance of web IDS base attack response system. Proposed algorithm provides both a field unit parsing and a duplicated string elimination procedure on web log data. And it is also possible for us to construct improved web IDS system.

  • PDF

Load Balancing in Cloud Computing Using Meta-Heuristic Algorithm

  • Fahim, Youssef;Rahhali, Hamza;Hanine, Mohamed;Benlahmar, El-Habib;Labriji, El-Houssine;Hanoune, Mostafa;Eddaoui, Ahmed
    • Journal of Information Processing Systems
    • /
    • v.14 no.3
    • /
    • pp.569-589
    • /
    • 2018
  • Cloud computing, also known as "country as you go", is used to turn any computer into a dematerialized architecture in which users can access different services. In addition to the daily evolution of stakeholders' number and beneficiaries, the imbalance between the virtual machines of data centers in a cloud environment impacts the performance as it decreases the hardware resources and the software's profitability. Our axis of research is the load balancing between a data center's virtual machines. It is used for reducing the degree of load imbalance between those machines in order to solve the problems caused by this technological evolution and ensure a greater quality of service. Our article focuses on two main phases: the pre-classification of tasks, according to the requested resources; and the classification of tasks into levels ('odd levels' or 'even levels') in ascending order based on the meta-heuristic "Bat-algorithm". The task allocation is based on levels provided by the bat-algorithm and through our mathematical functions, and we will divide our system into a number of virtual machines with nearly equal performance. Otherwise, we suggest different classes of virtual machines, but the condition is that each class should contain machines with similar characteristics compared to the existing binary search scheme.

Development and Application of Software Education Program Based on Blended Learning for Improving Computational Thinking of Pre-Service Elementary Teachers (초등예비교사의 컴퓨팅 사고력 향상을 위한 블렌디드 러닝 기반의 소프트웨어교육 프로그램 개발 및 적용)

  • Song, Ui-Sung;Gil, Joon-Min
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.7
    • /
    • pp.353-360
    • /
    • 2017
  • In this study, a software education program based on blended learning using scratch was designed for pre-service elementary teachers' software education. Software education program was applied to experimental group and control group within the university of education using Scratch programming for 12 weeks. Blended learning using online lectures was applied to experimental group. The pre-service teachers' recognition about software education and self-evaluation of computational thinking were performed. Then, we analyzed the effect of the developed education program on the recognition of software education and computational thinking. As a result, the level of post-recognition of software education in the experimental group was significantly higher than that of the pre-recognition. In the self-evaluation of computational thinking, the experimental group was significantly higher than the control group. Therefore, it can be seen that the software education program based on blended learning can help improve the learner's computational thinking.

Data Framework Design of EDISON 2.0 Digital Platform for Convergence Research

  • Sunggeun Han;Jaegwang Lee;Inho Jeon;Jeongcheol Lee;Hoon Choi
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.8
    • /
    • pp.2292-2313
    • /
    • 2023
  • With improving computing performance, various digital platforms are being developed to enable easily utilization of high-performance computing environments. EDISON 1.0 is an online simulation platform widely used in computational science and engineering education. As the research paradigm changes, the demand for developing the EDISON 1.0 platform centered on simulation into the EDISON 2.0 platform centered on data and artificial intelligence is growing. Herein, a data framework, a core module for data-centric research on EDISON 2.0 digital platform, is proposed. The proposed data framework provides the following three functions. First, it provides a data repository suitable for the data lifecycle to increase research reproducibility. Second, it provides a new data model that can integrate, manage, search, and utilize heterogeneous data to support a data-driven interdisciplinary convergence research environment. Finally, it provides an exploratory data analysis (EDA) service and data enrichment using an AI model, both developed to strengthen data reliability and maximize the efficiency and effectiveness of research endeavors. Using the EDISON 2.0 data framework, researchers can conduct interdisciplinary convergence research using heterogeneous data and easily perform data pre-processing through the web-based UI. Further, it presents the opportunity to leverage the derived data obtained through AI technology to gain insights and create new research topics.