• 제목/요약/키워드: Data collection and analysis system

검색결과 812건 처리시간 0.021초

SNMP를 이용한 인터넷 분석 파라미터 추출 시스템의 설계 및 구현 (The Design and Implementation of Parameter Extraction System for Analyzing Internet Using SNMP)

  • 신상철;안성진;정진욱
    • 한국정보처리학회논문지
    • /
    • 제6권3호
    • /
    • pp.710-721
    • /
    • 1999
  • In this paper, we have designed and implemented a parameter extraction system for analyzing Internet using SNMP. The extraction system has two modules; one is collection request module, and the other is analysis request module. The collection request module generates a polling script, which is used to collect management information from the managed system periodically. With this collected data, analysis request module extracts analysis parameters. These parameters are traffic flow analysis, interface traffic analysis, packet traffic analysis, and management traffic analysis parameter. For management activity, we have introduced two-step-analysis-view. One is Summary-View, which is used find out malfunction of a system among the entire managed systems. The Other is Specific-View. With this view we can analyze the specific system with all our analysis parameters. To show available data as indicators for line capacity planning, network redesigning decision making of performance upgrade for a network device and things like that.

  • PDF

A Large-scale Multi-track Mobile Data Collection Mechanism for Wireless Sensor Networks

  • Zheng, Guoqiang;Fu, Lei;Li, Jishun;Li, Ming
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권3호
    • /
    • pp.857-872
    • /
    • 2014
  • Recent researches reveal that great benefit can be achieved for data gathering in wireless sensor networks (WSNs) by employing mobile data collectors. In order to balance the energy consumption at sensor nodes and prolong the network lifetime, a multi-track large-scale mobile data collection mechanism (MTDCM) is proposed in this paper. MTDCM is composed of two phases: the Energy-balance Phase and the Data Collection Phase. In this mechanism, the energy-balance trajectories, the sleep-wakeup strategy and the data collection algorithm are determined. Theoretical analysis and performance simulations indicate that MTDCM is an energy efficient mechanism. It has prominent features on balancing the energy consumption and prolonging the network lifetime.

A Strategy Study on Sensitive Information Filtering for Personal Information Protect in Big Data Analyze

  • Koo, Gun-Seo
    • 한국컴퓨터정보학회논문지
    • /
    • 제22권12호
    • /
    • pp.101-108
    • /
    • 2017
  • The study proposed a system that filters the data that is entered when analyzing big data such as SNS and BLOG. Personal information includes impersonal personal information, but there is also personal information that distinguishes it from personal information, such as religious institution, personal feelings, thoughts, or beliefs. Define these personally identifiable information as sensitive information. In order to prevent this, Article 23 of the Privacy Act has clauses on the collection and utilization of the information. The proposed system structure is divided into two stages, including Big Data Processing Processes and Sensitive Information Filtering Processes, and Big Data processing is analyzed and applied in Big Data collection in four stages. Big Data Processing Processes include data collection and storage, vocabulary analysis and parsing and semantics. Sensitive Information Filtering Processes includes sensitive information questionnaires, establishing sensitive information DB, qualifying information, filtering sensitive information, and reliability analysis. As a result, the number of Big Data performed in the experiment was carried out at 84.13%, until 7553 of 8978 was produced to create the Ontology Generation. There is considerable significan ce to the point that Performing a sensitive information cut phase was carried out by 98%.

Road Surface Data Collection and Analysis using A2B Communication in Vehicles from Bearings and Deep Learning Research

  • Young-Min KIM;Jae-Yong HWANG;Sun-Kyoung KANG
    • 한국인공지능학회지
    • /
    • 제11권4호
    • /
    • pp.21-27
    • /
    • 2023
  • This paper discusses a deep learning-based road surface analysis system that collects data by installing vibration sensors on the 4-axis wheel bearings of a vehicle, analyzes the data, and appropriately classifies the characteristics of the current driving road surface for use in the vehicle's control system. The data used for road surface analysis is real-time large-capacity data, with 48K samples per second, and the A2B protocol, which is used for large-capacity real-time data communication in modern vehicles, was used to collect the data. CAN and CAN-FD commonly used in vehicle communication, are unable to perform real-time road surface analysis due to bandwidth limitations. By using A2B communication, data was collected at a maximum bandwidth for real-time analysis, requiring a minimum of 24K samples/sec for evaluation. Based on the data collected for real-time analysis, performance was assessed using deep learning models such as LSTM, GRU, and RNN. The results showed similar road surface classification performance across all models. It was also observed that the quality of data used during the training process had an impact on the performance of each model.

학습자 중심의 맞춤형 교육을 위한 학습 경험 데이터 수집 및 분석 체계 연구 (A Study on the Data Collection and Analysis System for Learning Experiences in Learner-Centered Customized Education)

  • 김상우;이명숙
    • 실천공학교육논문지
    • /
    • 제16권2호
    • /
    • pp.159-165
    • /
    • 2024
  • 본 연구는 학습자 중심의 맞춤형 교육을 위한 지능형 학습활동 데이터를 수집하기 위한 전체 체계를 연구하였다. 학습활동 데이터수집 표준인 xAPI, Caliper analytics, cmi5의 특징들을 비교 분석하였고, 이러한 표준화된 데이터뿐만 아니라 표준화되지 않은 학습활동 데이터도 모두 빅데이터로 저장되어 인공지능 학습분석을 할 수 있는 체계를 마련하였다. 그 결과 데이터 유형 정의, xAPI 적용한 학습데이터 표준화, 빅데이터 저장, 학습분석(통계 기반 및 AI 기반), 학습자 맞춤형 서비스인 5개의 단계로 구성하였다. 이를 통해 인공지능 기술을 적용한 학습데이터 분석을 위한 기반을 마련하고자 하였다. 향후 연구에서는 전체 체계를 3개의 단계로 나누어 구현하고 실행하면서 설계에서 부족한 부분을 수정·보완할 것이다.

공공도서관의 지역통합시스템 운영이 장서의 이용 및 중복에 미치는 영향에 관한 연구 (A Study on the Collection Use and Overlap of Regional Collaborative Library System in Public Libraries)

  • 박현경;노동조
    • 한국비블리아학회지
    • /
    • 제29권4호
    • /
    • pp.251-267
    • /
    • 2018
  • 본 연구는 지역통합시스템을 운영하고 있는 파주시 산하의 4개의 공공도서관을 대상으로 최근 3년간의 장서 데이터와 이용 데이터, 수서 데이터를 수집하여 도서관별 대출 및 상호대차를 분석하고, 나아가 이용과 수서간의 상관관계를 검증하기 위하여 구입 자료에 대한 중복도를 비교분석하였다. 본 연구의 결과, 이용대상 자료에 따라 주제별로 대출과 상호대차에 있어 차이가 있음을 발견하였고, 이러한 특징이 구입 자료의 중복에도 영향을 미치고 있음을 확인하였다. 본 연구를 통하여 관내 상호대차시스템을 실시하는 개별도서관은 장서구성 단계에서부터 보다 치밀한 장서개발정책이 필요함을 지적하였다.

FRACAS에 기반한 군 무기체계의 고장분석 워크플로우 구축에 대한 연구 (A Study on the Development of FRACAS-based Failure Analysis Workflow for Military weapon system)

  • 이민영;김완걸;김경수
    • 한국신뢰성학회지:신뢰성응용연구
    • /
    • 제10권2호
    • /
    • pp.93-105
    • /
    • 2010
  • The following thesis provides an explanation for the definition of the MIL-HDBK-2155 : Failure Reporting, Analysis and Corrective Action System (FRACAS), which systemizes the collection and analysis of failure data and the feedback process of the results. It also presents a plan based on MIL-HDBK-2155 for the collection and analysis of operating specifications on weapon systems. The collection and analysis of failure data and the feedback process utilizing FRACAS contributes to identifying improvement requirements during equipment operation as well as finding and eliminating the root cause of the failures. The objective of applying FRACAS to weapon systems is to receive source data feedback for reliability enhancements and performance improvements during operation. This is done by recognizing weaknesses in the design or operation by identifying the type of failures that might occur, and by performing Failure Modes, Effects and Criticality Analysis(FMECA) and Failure Tree Analysis(FTA).

IoT 기반의 실시간 에너지 사용 데이터 수집 및 분석 시스템 개발 (A Development of Real-time Energy Usage Data Collection and Analysis System based on the IoT)

  • 황현숙;서영원
    • 한국멀티미디어학회논문지
    • /
    • 제22권3호
    • /
    • pp.366-373
    • /
    • 2019
  • The development of monitoring and analysis systems to increase productivity while saving energy is needed as a method to reduce huge amount of energy consumed in the process of producing large forged products. In this paper, we propose a system to monitor and analyze energy usage in real-time collected from gas-meter, wattmeter, and thermometer based on IoT installed in forging factories. The system consists of a data collection server for collecting and processing data from IoT- based platform and existing SCADA equipment and ERP/MES system in forging factories, and an application server for providing services to users. To develop the system, the overall system structure is logically diagrammed, and the databases configuration and implementation modules to efficiently store and manage data are presented. In the future, the system will be utilized to reduce energy consumption by analyzing energy usage pattern and optimizing process works with real-time energy usage and production process data for each facility.

지역 스마트팜 데이터 연계 및 서비스 활용에 대한 연구 (Research on Regional Smart Farm Data Linkage and Service Utilization)

  • 이원구;구현정;채철주
    • 현장농수산연구지
    • /
    • 제26권2호
    • /
    • pp.14-24
    • /
    • 2024
  • To enhance the usability of smart agriculture, methods for utilizing smart farm data are required. Therefore, this study proposes a scheme for utilizing regional smart farm data by linking it to services. The current status of domestic and foreign smart farm data collection and linkage services is analyzed. To collect and link regional smart farm data, necessary data collection, data cleaning, data storage structure and schema, and data storage and linkage systems are proposed. Based on the standards currently being implemented for regional smart farm internal data storage, a farm schema, environmental information schema, facility control information schema, and growth information schema are designed by extending the crop schema and crop main environmental factor information database schema. A data collection and management system structure based on the Hadoop Ecosystem is designed for data collection and management at regional smart farm data centers. Strategies are proposed for utilizing regional smart farm data to provide smart farm productivity improvement and revenue optimization services, image-based crop analysis services, and virtual reality-based smart farm simulation services.

기업 마케팅 전략을 위한 SNS 및 Web 데이터 분석 시스템 설계 (A Design of SNS and Web Data Analysis System for Company Marketing Strategy)

  • 이병관;정은희;정이나
    • 한국정보전자통신기술학회논문지
    • /
    • 제6권4호
    • /
    • pp.195-200
    • /
    • 2013
  • 본 논문에서는 기업 이미지에 타격을 줄 수 있는 부정적인 SNS와 Web 데이터를 빠르게 분석하여 기업 마케팅 전략에 활용할 수 있는 SNS 및 Web 데이터 분석 시스템을 제안한다. 본 논문에서 제안하는 시스템은 SNS 및 Web Data를 수집하는 데이터 수집 모듈(Data Collection Module), 수집된 데이터를 저장하는 HBase 모듈(Hbase Module), 수집된 데이터의 의미 분석을 수행한 후 데이터의 의미를 평가 및 분류하는 데이터 분석 모듈(Data Analysis Module) 그리고 관리자에 의해 요청된 질의어에 따라 기업과 관련된 SNS와 Web데이터를 이용하여 최적화된 Map Reduce 과정을 수행하는 PSH 모듈(Priority Scheduling Hadoop Module)로 구성된다. 본 논문은 이런 모듈들을 통하여 SNS와 Web 데이터를 보다 효율적으로 관리하여 이 분석 결과를 기업 마케팅 전략에 활용할 수 있다.