• Title/Summary/Keyword: 기술적 한계

Search Result 4,088, Processing Time 0.034 seconds

Application of MicroPACS Using the Open Source (Open Source를 이용한 MicroPACS의 구성과 활용)

  • You, Yeon-Wook;Kim, Yong-Keun;Kim, Yeong-Seok;Won, Woo-Jae;Kim, Tae-Sung;Kim, Seok-Ki
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.13 no.1
    • /
    • pp.51-56
    • /
    • 2009
  • Purpose: Recently, most hospitals are introducing the PACS system and use of the system continues to expand. But small-scaled PACS called MicroPACS has already been in use through open source programs. The aim of this study is to prove utility of operating a MicroPACS, as a substitute back-up device for conventional storage media like CDs and DVDs, in addition to the full-PACS already in use. This study contains the way of setting up a MicroPACS with open source programs and assessment of its storage capability, stability, compatibility and performance of operations such as "retrieve", "query". Materials and Methods: 1. To start with, we searched open source software to correspond with the following standards to establish MicroPACS, (1) It must be available in Windows Operating System. (2) It must be free ware. (3) It must be compatible with PET/CT scanner. (4) It must be easy to use. (5) It must not be limited of storage capacity. (6) It must have DICOM supporting. 2. (1) To evaluate availability of data storage, we compared the time spent to back up data in the open source software with the optical discs (CDs and DVD-RAMs), and we also compared the time needed to retrieve data with the system and with optical discs respectively. (2) To estimate work efficiency, we measured the time spent to find data in CDs, DVD-RAMs and MicroPACS. 7 technologists participated in this study. 3. In order to evaluate stability of the software, we examined whether there is a data loss during the system is maintained for a year. Comparison object; How many errors occurred in randomly selected data of 500 CDs. Result: 1. We chose the Conquest DICOM Server among 11 open source software used MySQL as a database management system. 2. (1) Comparison of back up and retrieval time (min) showed the result of the following: DVD-RAM (5.13,2.26)/Conquest DICOM Server (1.49,1.19) by GE DSTE (p<0.001), CD (6.12,3.61)/Conquest (0.82,2.23) by GE DLS (p<0.001), CD (5.88,3.25)/Conquest (1.05,2.06) by SIEMENS. (2) The wasted time (sec) to find some data is as follows: CD ($156{\pm}46$), DVD-RAM ($115{\pm}21$) and Conquest DICOM Server ($13{\pm}6$). 3. There was no data loss (0%) for a year and it was stored 12741 PET/CT studies in 1.81 TB memory. In case of CDs, On the other hand, 14 errors among 500 CDs (2.8%) is generated. Conclusions: We found that MicroPACS could be set up with the open source software and its performance was excellent. The system built with open source proved more efficient and more robust than back-up process using CDs or DVD-RAMs. We believe that the operation of the MicroPACS would be effective data storage device as long as its operators develop and systematize it.

  • PDF

Analysis of HBeAg and HBV DNA Detection in Hepatitis B Patients Treated with Antiviral Therapy (항 바이러스 치료중인 B형 간염환자에서 HBeAg 및 HBV DNA 검출에 관한 분석)

  • Cheon, Jun Hong;Chae, Hong Ju;Park, Mi Sun;Lim, Soo Yeon;Yoo, Seon Hee;Lee, Sun Ho
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.23 no.1
    • /
    • pp.35-39
    • /
    • 2019
  • Purpose Hepatitis B virus (hepatitis B virus, HBV) infection is a worldwide major public health problem and it is known as a major cause of chronic hepatitis, liver cirrhosis and liver cancer. And serologic tests of hepatitis B virus is essential for diagnosing and treating these diseases. In addition, with the development of molecular diagnostics, the detection of HBV DNA in serum diagnoses HBV infection and is recognized as an important indicator for the antiviral agent treatment response assessment. We performed HBeAg assay using Immunoradiometric assay (IRMA) and Chemiluminescent Microparticle Immunoassay (CMIA) in hepatitis B patients treated with antiviral agents. The detection rate of HBV DNA in serum was measured and compared by RT-PCR (Real Time - Polymerase Chain Reaction) method Materials and Methods HBeAg serum examination and HBV DNA quantification test were conducted on 270 hepatitis B patients undergoing anti-virus treatment after diagnosis of hepatitis B virus infection. Two serologic tests (IRMA, CMIA) with different detection principles were applied for the HBeAg serum test. Serum HBV DNA was quantitatively measured by real-time polymerase chain reaction (RT-PCR) using the Abbott m2000 System. Results The detection rate of HBeAg was 24.1% (65/270) for IRMA and 82.2% (222/270) for CMIA. Detection rate of serum HBV DNA by real-time RT-PCR is 29.3% (79/270). The measured amount of serum HBV DNA concentration is $4.8{\times}10^7{\pm}1.9{\times}10^8IU/mL$($mean{\pm}SD$). The minimum value is 16IU/mL, the maximum value is $1.0{\times}10^9IU/mL$, and the reference value for quantitative detection limit is 15IU/mL. The detection rates and concentrations of HBV DNA by group according to the results of HBeAg serological (IRMA, CMIA)tests were as follows. 1) Group I (IRMA negative, CMIA positive, N = 169), HBV DNA detection rate of 17.7% (30/169), $6.8{\times}10^5{\pm}1.9{\times}10^6IU/mL$ 2) Group II (IRMA positive, CMIA positive, N = 53), HBV DNA detection rate 62.3% (33/53), $1.1{\times}10^8{\pm}2.8{\times}10^8IU/mL$ 3) Group III (IRMA negative, CMIA negative, N = 36), HBV DNA detection rate 36.1% (13/36), $3.0{\times}10^5{\pm}1.1{\times}10^6IU/mL$ 4) Group IV(IRMA positive, CMIA negative, N = 12), HBV DNA detection rate 25% (3/12), $1.3{\times}10^3{\pm}1.1{\times}10^3IU/mL$ Conclusion HBeAg detection rate according to the serological test showed a large difference. This difference is considered for a number of reasons such as characteristics of the Ab used for assay kit and epitope, HBV of genotype. Detection rate and the concentration of the group-specific HBV DNA classified serologic results confirmed the high detection rate and the concentration in Group II (IRMA-positive, CMIA positive, N = 53).

Critical Success Factor of Noble Payment System: Multiple Case Studies (새로운 결제서비스의 성공요인: 다중사례연구)

  • Park, Arum;Lee, Kyoung Jun
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.4
    • /
    • pp.59-87
    • /
    • 2014
  • In MIS field, the researches on payment services are focused on adoption factors of payment service using behavior theories such as TRA(Theory of Reasoned Action), TAM(Technology Acceptance Model), and TPB (Theory of Planned Behavior). The previous researches presented various adoption factors according to types of payment service, nations, culture and so on even though adoption factors of identical payment service were presented differently by researchers. The payment service industry relatively has strong path dependency to the existing payment methods so that the research results on the identical payment service are different due to payment culture of nation. This paper aims to suggest a successful adoption factor of noble payment service regardless of nation's culture and characteristics of payment and prove it. In previous researches, common adoption factors of payment service are convenience, ease of use, security, convenience, speed etc. But real cases prove the fact that adoption factors that the previous researches present are not always critical to success to penetrate a market. For example, PayByPhone, NFC based parking payment service, successfully has penetrated to early market and grown. In contrast, Google Wallet service failed to be adopted to users despite NFC based payment method which provides convenience, security, ease of use. As shown in upper case, there remains an unexplained aspect. Therefore, the present research question emerged from the question: "What is the more essential and fundamental factor that should takes precedence over factors such as provides convenience, security, ease of use for successful penetration to market". With these cases, this paper analyzes four cases predicted on the following hypothesis and demonstrates it. "To successfully penetrate a market and sustainably grow, new payment service should find non-customer of the existing payment service and provide noble payment method so that they can use payment method". We give plausible explanations for the hypothesis using multiple case studies. Diners club, Danal, PayPal, Square were selected as a typical and successful cases in each category of payment service. The discussion on cases is primarily non-customer analysis that noble payment service targets on to find the most crucial factor in the early market, we does not attempt to consider factors for business growth. We clarified three-tier non-customer of the payment method that new payment service targets on and elaborated how new payment service satisfy them. In case of credit card, this payment service target first tier of non-customer who can't pay for because they don't have any cash temporarily but they have regular income. So credit card provides an opportunity which they can do economic activities by delaying the date of payment. In a result of wireless phone payment's case study, this service targets on second of non-customer who can't use online payment because they concern about security or have to take a complex process and learn how to use online payment method. Therefore, wireless phone payment provides very convenient payment method. Especially, it made group of young pay for a little money without a credit card. Case study result of PayPal, online payment service, shows that it targets on second tier of non-customer who reject to use online payment service because of concern about sensitive information leaks such as passwords and credit card details. Accordingly, PayPal service allows users to pay online without a provision of sensitive information. Final Square case result, Mobile POS -based payment service, also shows that it targets on second tier of non-customer who can't individually transact offline because of cash's shortness. Hence, Square provides dongle which function as POS by putting dongle in earphone terminal. As a result, four cases made non-customer their customer so that they could penetrate early market and had been extended their market share. Consequently, all cases supported the hypothesis and it is highly probable according to 'analytic generation' that case study methodology suggests. We present for judging the quality of research designs the following. Construct validity, internal validity, external validity, reliability are common to all social science methods, these have been summarized in numerous textbooks(Yin, 2014). In case study methodology, these also have served as a framework for assessing a large group of case studies (Gibbert, Ruigrok & Wicki, 2008). Construct validity is to identify correct operational measures for the concepts being studied. To satisfy construct validity, we use multiple sources of evidence such as the academic journals, magazine and articles etc. Internal validity is to seek to establish a causal relationship, whereby certain conditions are believed to lead to other conditions, as distinguished from spurious relationships. To satisfy internal validity, we do explanation building through four cases analysis. External validity is to define the domain to which a study's findings can be generalized. To satisfy this, replication logic in multiple case studies is used. Reliability is to demonstrate that the operations of a study -such as the data collection procedures- can be repeated, with the same results. To satisfy this, we use case study protocol. In Korea, the competition among stakeholders over mobile payment industry is intensifying. Not only main three Telecom Companies but also Smartphone companies and service provider like KakaoTalk announced that they would enter into mobile payment industry. Mobile payment industry is getting competitive. But it doesn't still have momentum effect notwithstanding positive presumptions that will grow very fast. Mobile payment services are categorized into various technology based payment service such as IC mobile card and Application payment service of cloud based, NFC, sound wave, BLE(Bluetooth Low Energy), Biometric recognition technology etc. Especially, mobile payment service is discontinuous innovations that users should change their behavior and noble infrastructure should be installed. These require users to learn how to use it and cause infra-installation cost to shopkeepers. Additionally, payment industry has the strong path dependency. In spite of these obstacles, mobile payment service which should provide dramatically improved value as a products and service of discontinuous innovations is focusing on convenience and security, convenience and so on. We suggest the following to success mobile payment service. First, non-customers of the existing payment service need to be identified. Second, needs of them should be taken. Then, noble payment service provides non-customer who can't pay by the previous payment method to payment method. In conclusion, mobile payment service can create new market and will result in extension of payment market.

The Study on Foundation Remains(Jeoksim) According to Types of Buildings of Gyeongbok Palace (경복궁 건물 유형에 따른 적심 연구)

  • Choi, In Hwa
    • Korean Journal of Heritage: History & Science
    • /
    • v.42 no.3
    • /
    • pp.154-175
    • /
    • 2009
  • At the present state, studies on Gyeongbok palace are being done with history of architecture, records, and art. However, these studies have limits that they can only depend on existing buildings and record, which make it hard to research whole aspect of palaces. The foundation remains(Jeoksim) of Gyeongbok palace in the ground gives important clues that can fill the gaps of these studies. Thus I analysed jeoksim of Gyeongbok palace, assorted them by type, scale, material, and construction method. I examined jeoksim used by various types of building, and looked at changes by periods. Jeoksims are classified in 21 types. The foundation(jeoksim) varies according to types of buildings, building types and material of jeoksim also varies along the periods, and the fact proves certain peroid of time has its own jeoksim style in fashion. Jeoksims of Gyeongbok palace are divided into round-shape(I), rounded square-shape(II), rectangular-shape(III), square-shape(IV), and whole foundation of building(V) by the plane shape. They can be divided again into 21 types by construction techniques and materials used. During early Joseon(I), only three types of jeoksim; round-shape riprap jeoksim(1-1), II-1(rounded square-shape), II-2a(rounded square-shape riprap+roofingingtile brick), had been built, but as 19th century begun, all 21 types of jeoksim had built. In 19th century during Emperor Gojong, different types of jeoksim by periods were built, and especially different materials were used. During Gojong year 2(1865)~year 5(1868), in which Gyeongbok palace were rebuilt, 7 out of 10 types of jeoksim used piece of roofinging tile and brick mixture, in contrast, during Gojong year 10(1873)~13(1876), or 25(1888), 3 out of 5 types of jeoksim used sandy soil with mixture of plaster. Meanwhile palace buildings have different names by the class of owner and use such as Jeon, Dang, Hap, Gak, Jae, Heon, Nu, and Jeong, which were classified by types and buildings were built according to each level. With an analysis of jeoksim by its building types, I ascertained that jeoksim were built differently in accordance to building types(Jeon, Dang, Hap, Gak, Jae, Heon, Nu, and Jeong). By the limitation of present document, only some types of buildings such as Jeon, Dang, Gak, Bang were confirmed, as for Jeon and Gak, square-shape(IV) built with rectangular parallelepiped stone, and for Dang and Bang, rounded square-shape(IV) built with roofinginginging tile and riprap were commonly used. From the fact that other jeoksim with uncertain building names, were mostly built in early Joseon, we learn that round-shape riprap jeoksim(1-1) were commonly built. Therefore, the class of building was higher if the owner was in higher class, jeoksim is also considered to be built with the strongest and best material. And for Dang and Bang, rounded square-shape jeoksim were used, Dang has lots of II-2a (riprap + piece of roofing tile and brick rounded square-shape) type which mainly used riprap and piece of roofing tile and brick, but Bang has lots of II-2b (piece of roofing tile and brick+(riprap+piece of roofing tile and brick rounded square-shape), which paved piece of roofing tile and brick by 15~20cm above. These jeoksim by building types were confirmed to have changed its construction type by period. As for Jeon and Gak, they were built with round-shape riprap jeoksim(1-1) in early Joseon(14~15c), but in late Joseon(19c), various types of Jeoksim were built, especially square-shape(IV) were commonly built. For Dang, only changes in later Joseon were confirmed, jeoksim built in Gojong year 4(1867) mostly used mixture of riprap and piece of roofing tile and brick. In Gojong year 13(1876) or year 25(1888), unique type of plaster with sand and coal and soil layered jeoksim were built that are not found in any other building types. Through this study, I learned that various construction types of jeoksim and material were developed in later Joseon compare to early Joseon. This states that construction technique of building foundation of palace has upgraded. Above all, I learned jeoksim types are all different for various kinds of buildings. This tells us that when they constructed foundation of building, they used pre-calculated construction technique.

Characteristics of New Microsporidia S80 Isolated from Silkworm, Bombyx mori L. in Korea (가잠(家蠶)으로부터 분리(分離)된 새로운 Microsporidia S80의 특성(特性))

  • Lim, Jong Sung;Cho, Sae Yun
    • Current Research on Agriculture and Life Sciences
    • /
    • v.1
    • /
    • pp.67-83
    • /
    • 1983
  • The new microsporidia S80 isolated from, Bombyx mori L. in Korea showed ovoid in the morphology of the spores and the size were measured $2.9{\pm}0.28{\mu}$ in length and $1.7{\pm}0.29{\mu}$ width. No other microsporidian spore like this has not been so far isolated from Silkworm. The length of the polar filament extruded in hydrogen peroxide ($H_2O_2$) at $30^{\circ}C$ was $26{\mu}$ of a round cytoplasm on the top. The spores were partly stained with Giemsa, Safranin-O and Gram as the same staining properties as Nosema bombycis, Microsporidia K 79 and other microsporidian spores. The fine structures were observed under scanning eleceron microscope through ultrathin sectioning. The spore wall was composed of three layers ; the thin exospore of an electron dense rippled layer, the thick electron lucent endospore which was thinning considerably at the polar filament insertion point, and the inner limiting membrane. Polar cap present at the sporeapex, with a long polar filament of 12-13 coils, subtending angle of $60^{\circ}$ to spore axis, which is tubular made up of a multilayered and are a benes core, light ring structure enclosing the dance core, the dark ring structure enclosing the inner light ring structure and the other than and light ring structure bounded from cytoplasm. Lamellate polaroplast occupied the anterior part of the spore, and the two neclei with dense nucleoplasm bounded by a double nuclear envelope were cited in the slight downer middle portion of spore. From the characteristics of the shape, size and fine structures, it is certain to reason the Microsporidia S80 belong to the phylum Microspora, class Microspora, order Microsporida, order Microsporida. The shape of two nuclei cited seems to be genus Nosema, but in the classification for the suborder it should be defined wheather pansporoblasts be formed or not and for the genis especial attempts have been made to define the characters which distinguish the disporous genera in the life cycle. Survey through the infection of the bad cocoons during 1980 to 1982 in South Korea the areas contaminated with new microsporidia were revealed 5 provinces of Kyung-Gi, Kang-Won, Chung-Nam and Chun-Nam. Pathological effects inoculated per os at second instar larvae of silkworm, the LD 50 was $7.1{\times}10^7/ml$ as lower pathogenecity than that of Nosema bombycis Naegeli of $1.2{\times}10_7/ml$. While on the other hand the inoculation of the microsporidia at fourth instar larvae lowerd the whole cocoon weight and cocoon shell weight and significant at 1% level. The microsporidia S80 defined it can not be transmitted transovarially from the result of predictive and collective examination of 21 egg batches from the infected female moth.

  • PDF

Methodology for Identifying Issues of User Reviews from the Perspective of Evaluation Criteria: Focus on a Hotel Information Site (사용자 리뷰의 평가기준 별 이슈 식별 방법론: 호텔 리뷰 사이트를 중심으로)

  • Byun, Sungho;Lee, Donghoon;Kim, Namgyu
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.3
    • /
    • pp.23-43
    • /
    • 2016
  • As a result of the growth of Internet data and the rapid development of Internet technology, "big data" analysis has gained prominence as a major approach for evaluating and mining enormous data for various purposes. Especially, in recent years, people tend to share their experiences related to their leisure activities while also reviewing others' inputs concerning their activities. Therefore, by referring to others' leisure activity-related experiences, they are able to gather information that might guarantee them better leisure activities in the future. This phenomenon has appeared throughout many aspects of leisure activities such as movies, traveling, accommodation, and dining. Apart from blogs and social networking sites, many other websites provide a wealth of information related to leisure activities. Most of these websites provide information of each product in various formats depending on different purposes and perspectives. Generally, most of the websites provide the average ratings and detailed reviews of users who actually used products/services, and these ratings and reviews can actually support the decision of potential customers in purchasing the same products/services. However, the existing websites offering information on leisure activities only provide the rating and review based on one stage of a set of evaluation criteria. Therefore, to identify the main issue for each evaluation criterion as well as the characteristics of specific elements comprising each criterion, users have to read a large number of reviews. In particular, as most of the users search for the characteristics of the detailed elements for one or more specific evaluation criteria based on their priorities, they must spend a great deal of time and effort to obtain the desired information by reading more reviews and understanding the contents of such reviews. Although some websites break down the evaluation criteria and direct the user to input their reviews according to different levels of criteria, there exist excessive amounts of input sections that make the whole process inconvenient for the users. Further, problems may arise if a user does not follow the instructions for the input sections or fill in the wrong input sections. Finally, treating the evaluation criteria breakdown as a realistic alternative is difficult, because identifying all the detailed criteria for each evaluation criterion is a challenging task. For example, if a review about a certain hotel has been written, people tend to only write one-stage reviews for various components such as accessibility, rooms, services, or food. These might be the reviews for most frequently asked questions, such as distance between the nearest subway station or condition of the bathroom, but they still lack detailed information for these questions. In addition, in case a breakdown of the evaluation criteria was provided along with various input sections, the user might only fill in the evaluation criterion for accessibility or fill in the wrong information such as information regarding rooms in the evaluation criteria for accessibility. Thus, the reliability of the segmented review will be greatly reduced. In this study, we propose an approach to overcome the limitations of the existing leisure activity information websites, namely, (1) the reliability of reviews for each evaluation criteria and (2) the difficulty of identifying the detailed contents that make up the evaluation criteria. In our proposed methodology, we first identify the review content and construct the lexicon for each evaluation criterion by using the terms that are frequently used for each criterion. Next, the sentences in the review documents containing the terms in the constructed lexicon are decomposed into review units, which are then reconstructed by using the evaluation criteria. Finally, the issues of the constructed review units by evaluation criteria are derived and the summary results are provided. Apart from the derived issues, the review units are also provided. Therefore, this approach aims to help users save on time and effort, because they will only be reading the relevant information they need for each evaluation criterion rather than go through the entire text of review. Our proposed methodology is based on the topic modeling, which is being actively used in text analysis. The review is decomposed into sentence units rather than considering the whole review as a document unit. After being decomposed into individual review units, the review units are reorganized according to each evaluation criterion and then used in the subsequent analysis. This work largely differs from the existing topic modeling-based studies. In this paper, we collected 423 reviews from hotel information websites and decomposed these reviews into 4,860 review units. We then reorganized the review units according to six different evaluation criteria. By applying these review units in our methodology, the analysis results can be introduced, and the utility of proposed methodology can be demonstrated.

The Effect on Aviation Industry by WTO Agreement on Trade in Civil Aircraft and Policy Direction of Korea (WTO 민간항공기 교역 협정이 항공산업에 미치는 영향과 우리나라의 정책 방향)

  • Lee, Kang-Bin
    • The Korean Journal of Air & Space Law and Policy
    • /
    • v.35 no.2
    • /
    • pp.247-280
    • /
    • 2020
  • For customs-free and liberalization on the trade of aircraft parts, the WTO Agreement on Trade in Civil Aircraft was separately concluded as plurilateral trade agreement at the time of launching WTO in 1995, and currently 33 countries including the United States and the EU are acceded but Korea does not. Major details of the Agreement on Trade in Civil Aircraft include product coverage, the elimination of customs duties and other charges, the prohibition of government-directed procurement of civil aircraft, the application of the Agreement on Subsides and Countervailing Measures, and the consultation on issues related to this Agreement and dispute resolution. Article 89 paragraph 6 of the current Customs Act was newly established on December 31, 2018, and the tariff reduction rate for imports of aircraft parts will be reduced in stages from May 2019 and the tariff reduction system will be abolished in 2026. Accordingly, looking at the impact of the Agreement on Trade in Civil Aircraft on the aviation industry, first, as for the impact on the air transport industry, an tariff allotment of the domestic air transport industry is expected to reach about 160 billion won a year from 2026, and upon acceding to the Agreement on Trade in Civil Aircraft, the domestic air transport industry will be able to import aircraft parts at no tariff, so it will not have to pay 3 to 8 percent import duties. Second, as for the impact on the aviation MRO industry, if the tariff reduction system for aircraft parts is phased out or abolished in stages, overseas outsourcing costs in the engine maintenance and parts maintenance are expected to increase, and upon acceding to the Agreement on Trade in Civil Aircraft, the aviation MRO industry will be able to import aircraft parts at no tariff, so it will reduce overseas outsourcing costs. If the author proposes a policy direction for the trade liberalization of aircraft parts to ensure competitiveness of the aviation industry, first, as for the tariff reduction by the use of FTA, in order to be favored with the tariff reduction by the use of FTA, it is necessary to secure the certificate of origin from foreign traders in the United States and the EU, and to revise the provisions of Korea-Singapore and Korea-EU FTA. Second, as for the push of acceding to the Agreement on Trade in Civil Aircraft, it would be resonable to push the acceding to Agreement on Trade in Civil Aircraft for customs-free on the trade of aircraft parts, as the tariff reduction method by the use of FTA has limits. Third, as for the improvement of the tariff reduction system for aircraft parts under the Customs Act, it is expected that there will take a considerable amount of time until the acceding to the Agreement on Trade in Civil Aircraft, so separate improvement measures are needed to continue the tariff reduction system of aircraft parts under Article 89 paragraph 6 of the Customs Act. In conclusion, Korea should accede to the WTO Agreement on Trade in Civil Aircraft to create an environment in which our aviation industry can compete fairly with foreign aviation industries and ensure competitiveness by achieving customs-free and liberalization on the trade of aircraft parts.

Design and Implementation of MongoDB-based Unstructured Log Processing System over Cloud Computing Environment (클라우드 환경에서 MongoDB 기반의 비정형 로그 처리 시스템 설계 및 구현)

  • Kim, Myoungjin;Han, Seungho;Cui, Yun;Lee, Hanku
    • Journal of Internet Computing and Services
    • /
    • v.14 no.6
    • /
    • pp.71-84
    • /
    • 2013
  • Log data, which record the multitude of information created when operating computer systems, are utilized in many processes, from carrying out computer system inspection and process optimization to providing customized user optimization. In this paper, we propose a MongoDB-based unstructured log processing system in a cloud environment for processing the massive amount of log data of banks. Most of the log data generated during banking operations come from handling a client's business. Therefore, in order to gather, store, categorize, and analyze the log data generated while processing the client's business, a separate log data processing system needs to be established. However, the realization of flexible storage expansion functions for processing a massive amount of unstructured log data and executing a considerable number of functions to categorize and analyze the stored unstructured log data is difficult in existing computer environments. Thus, in this study, we use cloud computing technology to realize a cloud-based log data processing system for processing unstructured log data that are difficult to process using the existing computing infrastructure's analysis tools and management system. The proposed system uses the IaaS (Infrastructure as a Service) cloud environment to provide a flexible expansion of computing resources and includes the ability to flexibly expand resources such as storage space and memory under conditions such as extended storage or rapid increase in log data. Moreover, to overcome the processing limits of the existing analysis tool when a real-time analysis of the aggregated unstructured log data is required, the proposed system includes a Hadoop-based analysis module for quick and reliable parallel-distributed processing of the massive amount of log data. Furthermore, because the HDFS (Hadoop Distributed File System) stores data by generating copies of the block units of the aggregated log data, the proposed system offers automatic restore functions for the system to continually operate after it recovers from a malfunction. Finally, by establishing a distributed database using the NoSQL-based Mongo DB, the proposed system provides methods of effectively processing unstructured log data. Relational databases such as the MySQL databases have complex schemas that are inappropriate for processing unstructured log data. Further, strict schemas like those of relational databases cannot expand nodes in the case wherein the stored data are distributed to various nodes when the amount of data rapidly increases. NoSQL does not provide the complex computations that relational databases may provide but can easily expand the database through node dispersion when the amount of data increases rapidly; it is a non-relational database with an appropriate structure for processing unstructured data. The data models of the NoSQL are usually classified as Key-Value, column-oriented, and document-oriented types. Of these, the representative document-oriented data model, MongoDB, which has a free schema structure, is used in the proposed system. MongoDB is introduced to the proposed system because it makes it easy to process unstructured log data through a flexible schema structure, facilitates flexible node expansion when the amount of data is rapidly increasing, and provides an Auto-Sharding function that automatically expands storage. The proposed system is composed of a log collector module, a log graph generator module, a MongoDB module, a Hadoop-based analysis module, and a MySQL module. When the log data generated over the entire client business process of each bank are sent to the cloud server, the log collector module collects and classifies data according to the type of log data and distributes it to the MongoDB module and the MySQL module. The log graph generator module generates the results of the log analysis of the MongoDB module, Hadoop-based analysis module, and the MySQL module per analysis time and type of the aggregated log data, and provides them to the user through a web interface. Log data that require a real-time log data analysis are stored in the MySQL module and provided real-time by the log graph generator module. The aggregated log data per unit time are stored in the MongoDB module and plotted in a graph according to the user's various analysis conditions. The aggregated log data in the MongoDB module are parallel-distributed and processed by the Hadoop-based analysis module. A comparative evaluation is carried out against a log data processing system that uses only MySQL for inserting log data and estimating query performance; this evaluation proves the proposed system's superiority. Moreover, an optimal chunk size is confirmed through the log data insert performance evaluation of MongoDB for various chunk sizes.