• 제목/요약/키워드: SQL-database

검색결과 433건 처리시간 0.023초

DB튜닝- 옵티마이져를 통한 데이터 처리경로의 최적화

  • Kim, Dong-Hun
    • Digital Contents
    • /
    • 7호통권74호
    • /
    • pp.76-81
    • /
    • 1999
  • SQL에 대한 수행속도를 결정하는 것은 옵티마이져가 작성한 데이터의 처리 경로이고 옵티마이져가 데이터의 처리경로를 작성하는데 가장 큰 영향을 주는 것은 사용자가 구성한 옵티마이져 요소들이다. 지금부터 데이터의 처리경로를 최적화할 수 있는 방법에 대하여 옵티마이져 요소과 관련하여 몇가지 설명하고자 한다.

  • PDF

SPARQL-DL Processor to Extract OWL Ontologies from Relational Databases (관계형 데이터베이스로부터 OWL 온톨로지를 추출하기 위한 SPARQL-DL 프로세서)

  • Choi, Ji-Woong;Kim, Myung-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • 제20권3호
    • /
    • pp.29-45
    • /
    • 2015
  • This paper proposes an implementation of SPARQL-DL, which is a query language for OWL ontologies, for query-answering over the OWL ontologies virtually generated from existing RDBs. The proposed SPARQL-DL processor internally translates input SPARQL-DL queries into SQL queries and then executes the translated queries. There are two advantages in the query processing method. First, another repository to store OWL ontologies generated from RDBs is not required. Second, a large ABox generated from an RDB instance is able to be served without using Tableau algorithm based reasoners which have a problem in large ABox reasoning. Our algorithm for query rewriting is designed to create one corresponding SQL query from one input SPARQL-DL query to minimize the overhead by establishing connections with RDBs.

Implementation of query model of CQRS pattern using weather data (기상 데이터를 활용한 CQRS 패턴의 조회 모델 구현)

  • Seo, Bomin;Jeon, Cheolho;Jeon, Hyeonsig;An, Seyun;Park, Hyun-ju
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • 제23권6호
    • /
    • pp.645-651
    • /
    • 2019
  • At a time when large amounts of data are being poured out, there are many changes in software architecture or data storage patterns because of the nature of the data being written, rather more read-intensive than writing. Accordingly, in this paper, the query model of Command Query Responsibility Segmentation (CQRS) pattern separating the responsibilities of commands and queries is used to implement an efficient high-capacity data lookup system in users' requirements. This paper uses the 2018 temperature, humidity and precipitation data of the Korea Meteorological Administration Open API to store about 2.3 billion data suitable for RDBMS (PostgreSQL) and NoSQL (MongoDB). It also compares and analyzes the performance of systems with CQRS pattern applied from the perspective of the web server (Web Server) implemented and systems without CQRS pattern, the storage structure performance of each database, and the performance corresponding to the data processing characteristics.

Design and Implementation of MongoDB-based Unstructured Log Processing System over Cloud Computing Environment (클라우드 환경에서 MongoDB 기반의 비정형 로그 처리 시스템 설계 및 구현)

  • Kim, Myoungjin;Han, Seungho;Cui, Yun;Lee, Hanku
    • Journal of Internet Computing and Services
    • /
    • 제14권6호
    • /
    • pp.71-84
    • /
    • 2013
  • Log data, which record the multitude of information created when operating computer systems, are utilized in many processes, from carrying out computer system inspection and process optimization to providing customized user optimization. In this paper, we propose a MongoDB-based unstructured log processing system in a cloud environment for processing the massive amount of log data of banks. Most of the log data generated during banking operations come from handling a client's business. Therefore, in order to gather, store, categorize, and analyze the log data generated while processing the client's business, a separate log data processing system needs to be established. However, the realization of flexible storage expansion functions for processing a massive amount of unstructured log data and executing a considerable number of functions to categorize and analyze the stored unstructured log data is difficult in existing computer environments. Thus, in this study, we use cloud computing technology to realize a cloud-based log data processing system for processing unstructured log data that are difficult to process using the existing computing infrastructure's analysis tools and management system. The proposed system uses the IaaS (Infrastructure as a Service) cloud environment to provide a flexible expansion of computing resources and includes the ability to flexibly expand resources such as storage space and memory under conditions such as extended storage or rapid increase in log data. Moreover, to overcome the processing limits of the existing analysis tool when a real-time analysis of the aggregated unstructured log data is required, the proposed system includes a Hadoop-based analysis module for quick and reliable parallel-distributed processing of the massive amount of log data. Furthermore, because the HDFS (Hadoop Distributed File System) stores data by generating copies of the block units of the aggregated log data, the proposed system offers automatic restore functions for the system to continually operate after it recovers from a malfunction. Finally, by establishing a distributed database using the NoSQL-based Mongo DB, the proposed system provides methods of effectively processing unstructured log data. Relational databases such as the MySQL databases have complex schemas that are inappropriate for processing unstructured log data. Further, strict schemas like those of relational databases cannot expand nodes in the case wherein the stored data are distributed to various nodes when the amount of data rapidly increases. NoSQL does not provide the complex computations that relational databases may provide but can easily expand the database through node dispersion when the amount of data increases rapidly; it is a non-relational database with an appropriate structure for processing unstructured data. The data models of the NoSQL are usually classified as Key-Value, column-oriented, and document-oriented types. Of these, the representative document-oriented data model, MongoDB, which has a free schema structure, is used in the proposed system. MongoDB is introduced to the proposed system because it makes it easy to process unstructured log data through a flexible schema structure, facilitates flexible node expansion when the amount of data is rapidly increasing, and provides an Auto-Sharding function that automatically expands storage. The proposed system is composed of a log collector module, a log graph generator module, a MongoDB module, a Hadoop-based analysis module, and a MySQL module. When the log data generated over the entire client business process of each bank are sent to the cloud server, the log collector module collects and classifies data according to the type of log data and distributes it to the MongoDB module and the MySQL module. The log graph generator module generates the results of the log analysis of the MongoDB module, Hadoop-based analysis module, and the MySQL module per analysis time and type of the aggregated log data, and provides them to the user through a web interface. Log data that require a real-time log data analysis are stored in the MySQL module and provided real-time by the log graph generator module. The aggregated log data per unit time are stored in the MongoDB module and plotted in a graph according to the user's various analysis conditions. The aggregated log data in the MongoDB module are parallel-distributed and processed by the Hadoop-based analysis module. A comparative evaluation is carried out against a log data processing system that uses only MySQL for inserting log data and estimating query performance; this evaluation proves the proposed system's superiority. Moreover, an optimal chunk size is confirmed through the log data insert performance evaluation of MongoDB for various chunk sizes.

X2RD: Storing and Querying XML Data Using XPath To Relational Database (X2RD: XPath를 이용한 XML 데이터의 관계형 데이터베이스로의 저장과 질의)

  • Oh, Sang-Yoon
    • Journal of the Korea Society of Computer and Information
    • /
    • 제14권3호
    • /
    • pp.57-64
    • /
    • 2009
  • XML has become a do facto standard for structured document and data on the Web. An XML data deluge over the network will be more, since XML based standards such as Web Service and Semantic Web gets popular. There are efforts to store and query XML documents in a relational database system and recent efforts focus on how to provide such operations using XPath and XQuery. In this paper, we present study about those research efforts and we propose a new scheme to stoγe and query XML documents in a relational database using XPath query. The scheme uses a 'shred' method to store and translates XPath queries to SQL. We also present our empirical experiments using a RDBMS.

Comparison and Evaluation of Data Collection System Database for Edge-Based Lightweight Platform (엣지 기반 경량화 플랫폼을 위한 데이터 수집 시스템의 데이터베이스 비교 및 평가)

  • Woojin Cho;Chae-young Lim;Jae-hoi Gu
    • Journal of Platform Technology
    • /
    • 제11권5호
    • /
    • pp.49-58
    • /
    • 2023
  • Factory energy management system is rapidly growing and evolving due to factors such as the 3rd Basic Energy Plan and global energy cost increases, as well as environmental issues. However, implementing an essential data collection system for energy management in factory settings, which have limited space and unique characteristics, presents spatial, environmental, and energy-related challenges. This paper endeavors to mitigate these challenges by devising a data collection system implemented through an edge-based lightweight platform. A comparison and evaluation of database operation on edge devices are conducted. To conduct the evaluation, a benchmarking tool called CDI Benchmark is developed, utilizing the characteristics of existing factories involved in practical applications. The evaluation results revealed that RDBMS systems like MySQL encountered errors in the database due to high data insertion loads, making them inoperable. On the other hand, InfluxDB, thanks to its highly efficient compression algorithm, demonstrated compression rates about 6 times higher than MyRocks according to the evaluation. However, it was observed that MyRocks outperformed InfluxDB by a significant margin, recording a maximum processing time approximately 80 times faster compared to InfluxDB.

  • PDF

Security of Database Based On Hybrid Blockchain (하이브리드 블록체인을 이용한 데이터베이스 보안)

  • Bae, Keun-Woo;Lee, Keun-Ho
    • Journal of Internet of Things and Convergence
    • /
    • 제6권1호
    • /
    • pp.9-15
    • /
    • 2020
  • Recently, interest in blockchain technology has increased. The data industry is increasingly growing around the world. In addition, databases which obtain important information such as personal data are targeted by hackers. Data exposed by attackers happen frequently. In 2017, OWASP announced SQL injection is a top 1 threat to web applications. However, the proportion of data security is the smallest in the data industry. To prevent data exposure, this paper proposes a method that can protect databases by using hybrid blockchain.

Design and Implementation of Light Loaded Web Application Based on .NET (.NET 기반의 저부하형 웹 애플리케이션 설계 및 구현)

  • 최동우;안현식
    • Journal of Korea Multimedia Society
    • /
    • 제7권2호
    • /
    • pp.272-282
    • /
    • 2004
  • As Web services need to manage lots of information, it is indispensable to reduce server's load and speed up processing time. In this paper, we analyze the loading problems of server and suggest designing methods for light loaded Web applications based on .NET. The proposed methods include using a relative database to produce minimized modules and Stored Procedures to simplify SQL statements for reducing sever's load. Web pages are organized with scripts replacing server language, which improve server's capability by reducing loads. The execution time is also speeded up by organizing Web pages with User Controls. And XML/EDI is used for managing the effective exchange of documents. The proposed methods are implemented as an education management system and shows its effectiveness.

  • PDF

Design and Implementation of Virtual Tutoring Estimation System on the Internet Environment (인터넷 환경에서 가상 학습평가 시스템 설계 및 구현)

  • 이석호;김창수;황현숙
    • Journal of Korea Multimedia Society
    • /
    • 제1권2호
    • /
    • pp.204-214
    • /
    • 1998
  • The existing tutoring estimation systems using the authoring tools or HTML forms on the Web environment don't have been improved inconvenient factors of uni-directional interactive systems. In this paper, we design and implement the interactive tutoring estimation system which is conveniently considered to user on the internet environment. The proposed system is divided into teacher and student modules, which have the functions of the new problem insertion and deletion in database, regular examination marking for the former and lecture/test selection, scoring look, etc for the letter. The environment of server system in this thesis is implemented using the IDC file and SQL database for internet access based on Windows NT, client systems are composed to Windows 95 environment based on Explorer or Netscape to access for interactive tutoring systems.

  • PDF

Design of Extended Database Query language Based on SMIL 2.0 (SMIL 2.0을 기반으로 하는 확장 데이터베이스 질의어 설계)

  • Lee Jung-hwa;Moon Kyong-hi;Yun Hong-won
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • 제9권7호
    • /
    • pp.1555-1560
    • /
    • 2005
  • The presentation of query results is usually made with an external tool or a report generator but, because the methods of preparing and storing presentations have not been standardized, there are many difficulties for other applications to use query results. Thus, it is necessary for a multimedia data query language to define presentation in a standardized method. In this paper we designed extented SQL is based on SMIL 2.0, which support the proposed presentation model effectively. Furthermore this study proposed methods of using query results in various multimedia applications.