• Title/Summary/Keyword: REDIS

Search Result 20, Processing Time 0.033 seconds

Transient Alert Message Processing System for the LSST era

  • Shin, Min-Su
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.44 no.1
    • /
    • pp.71.2-71.2
    • /
    • 2019
  • We have developed and tested a prototype system to process transient alert messages from the currently working facilities such as Gaia and GCN notices. Our experiments with the prototype focus on developing a platform that can be used in the LSST era with about 10 million alerts per night and helping Korean community members with the automated processing environment to provide auxiliary information for every alert message. The system consists of a message broker implemented by Redis and multiple message subscribers specialized for specific scientific interests. The current implementation of the entire system allows new Korean members to adopt their own processing chains receiving the messages from our local broker. We welcome experimental ideas and opinions from the Korean community about the current message processing system. We plan to test the current system with the ZTF alerts in the near future.

  • PDF

Sorting Cuckoo: Enhancing Lookup Performance of Cuckoo Hashing Using Insertion Sort (Sorting Cuckoo: 삽입 정렬을 이용한 Cuckoo Hashing의 입력 연산의 성능 향상)

  • Min, Dae-hong;Jang, Rhong-ho;Nyang, Dae-hun;Lee, Kyung-hee
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.42 no.3
    • /
    • pp.566-576
    • /
    • 2017
  • Key-value stores proved its superiority by being applied to various NoSQL databases such as Redis, Memcached. Lookup performance is important because key-value store applications performs more lookup than insert operations in most environments. However, in traditional applications, lookup may be slow because hash tables are constructed out of linked-list. Therefore, cuckoo hashing has been getting attention from the academia for constant lookup time, and bucketized cuckoo hashing (BCH) has been proposed since it can achieve high load factor. In this paper, we introduce Sorting Cuckoo which inserts data using insertion sort in BCH structure. Sorting Cuckoo determines the existence of a key with a relatively small memory access because data are sorted in each buckets. In particular, the higher memory load factor, the better lookup performance than BCH's. Experimental results show that Sorting Cuckoo has smaller memory access than BCH's as many as about 19 million (25%) in 10 million negative lookup operations (key is not in the table), about 4 million times (10%) in 10 million positive lookup operations (where it is) with load factor 95%.

The Sintering Mechanism and Crystallization Characteristics of Alumina-filled Cordierite-type Glass-ceramics (알루미나를 첨가한 코디어라이트계 결정화 유리의 소결거동 및 결정화 특성)

  • 박정현;노재호;성재석;구기덕
    • Journal of the Korean Ceramic Society
    • /
    • v.35 no.7
    • /
    • pp.706-714
    • /
    • 1998
  • The MgO-{{{{ { {Al }_{2 }O }_{3 } }}-{{{{ { {SiO }_{2 } }_{ } }}system containing alumina powder was fabricated sintered at various temperature and analyzed in order to study the sintering mechanism and crystallization characteristics. The specimen composed of glass powder with average particle size of 8.27 $\mu\textrm{m}$ and 0-40 vol% alumina powder were sint-ered for 3 hrs at the temperature between 850$^{\circ}C$ and 1350$^{\circ}C$ The sintering mechanism consists of the redis-tribution of particles occuring at 750$^{\circ}C$ and the viscous flow at 850∼950$^{\circ}C$. The degree of crystallization and sintering temperatue were dependent upon the ratio of glass/alumina. The second phase from the reaction between glass and alumina was not observed which was confirmed by XRD and properties analysis. The density dielectric constant and specific resistivity of specimen were 2.30∼3.26g/cm2 5.8∼7.38 at 1 GHz density dielectric constant and specific resistivity of specimen were 2.30∼3.26g/cm3 5.8∼7.38 at 1GHz and 1.23∼4.70${\times}$107 $\Omega$$.$m respectively.

  • PDF

Overview of KMTNet Control Software

  • Cha, Sang-Mok;Lee, Chung-Uk;Lee, Yongseok;Kim, Dong-Jin;Lee, Dong-Joo;Kim, Seung-Lee;Jin, Ho
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.43 no.1
    • /
    • pp.70.3-70.3
    • /
    • 2018
  • 외계행성 탐색시스템의 망원경-카메라 제어 시스템 및 소프트웨어 구성과 관측 유틸리티에 대해 소개한다. 망원경 제어 소프트웨어는 천문 위치보정, 포인팅, 돔 회전 등을 담당하는 PC-TCS 프로그램, 망원경 적경-적위 축 서보 제어를 담당하는 full-closed loop PID 컨트롤 프로그램, 포커서, 필터박스, 돔 셔터, 주경냉각, 온도 모니터 등의 보조 시스템을 제어하는 AUX controls 프로그램으로 구성된다. 카메라 제어 소프트웨어는 모자이크로 구성된 여러 CCD를 각각 독립적으로 제어하는 IC(Instrument Control) 패키지와 이들을 총괄 제어하는 ICS(IC Science) 패키지로 구성되며 망원경과 카메라 소프트웨어의 인터페이스 역할을 하는 TCS Agent 프로그램이 포함된다. 관측 진행을 돕는 유틸리티로서 관측제어 명령어 입력 및 관측 스크립트 구동 기능을 제공하는 OBS Agent 프로그램과 가이드 CCD를 이용한 시상 모니터링 및 자동초점조정 프로그램을 개발하여 활용하고 있다. 각 소프트웨어는 UDP, TCP/IP, RS-232, Redis server 등 다양한 인터페이스를 통하여 서로 통신하며, CCD 영상 자료 전달을 위해 RAM(Random Access Memory) 디스크와 Network File System(NSF)을 이용하고 있다.

  • PDF

Comparative study on NoSQL for Processing a Big Data (빅데이터 처리에 관한 NoSQL 비교연구)

  • Jang, Rae-Young;Bae, Jung-Min;Jung, Sung-Jae;Soh, Woo-Young;Sung, Kyung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2014.05a
    • /
    • pp.351-354
    • /
    • 2014
  • The emergence of big data has brought many changes to the database management environment. the each amount of big data will increase, but each data size is smaller and simpler. This feature was required to a new data processing techniques. Accordingly, A variety database technology was provided to Specializing in big data processing. It is defined as NoSQL. NoSQL is how to use each different, according to the data characteristics. It is difficult to define one. In this paper, Classified according to the characteristics of each type of NoSQL Appropriate NoSQL is proposed.

  • PDF

On the Establishment of LSTM-based Predictive Maintenance Platform to Secure The Operational Reliability of ICT/Cold-Chain Unmanned Storage

  • Sunwoo Hwang;Youngmin Kim
    • International journal of advanced smart convergence
    • /
    • v.12 no.3
    • /
    • pp.221-232
    • /
    • 2023
  • Recently, due to the expansion of the logistics industry, demand for logistics automation equipment is increasing. The modern logistics industry is a high-tech industry that combines various technologies. In general, as various technologies are grafted, the complexity of the system increases, and the occurrence rate of defects and failures also increases. As such, it is time for a predictive maintenance model specialized for logistics automation equipment. In this paper, in order to secure the operational reliability of the ICT/Cold-Chain Unmanned Storage, a predictive maintenance system was implemented based on the LSTM model. In this paper, a server for data management, such as collection and monitoring, and an analysis server that notifies the monitoring server through data-based failure and defect analysis are separately distinguished. The predictive maintenance platform presented in this paper works by collecting data and receiving data based on RabbitMQ, loading data in an InMemory method using Redis, and managing snapshot data DB in real time. The predictive maintenance platform can contribute to securing reliability by identifying potential failures and defects that may occur in the operation of the ICT/Cold-Chain Unmanned Storage in the future.

A Study on the art to wear of the Wiener Werkstaette (비인공방(Wiener Werkstaette)에 형성된 예술의상연구)

  • 양취경
    • Journal of the Korean Society of Costume
    • /
    • v.29
    • /
    • pp.143-158
    • /
    • 1996
  • It was the year of 1903 when avantgarde artists in Vienna gave a birth to the Wiener Werkstaette under the influence of Aesthetic Movement and Guild of Handicraft from England. This study is on the backgrounds of the birth of the Wiener Werkstaette its artis-tic motto and world-wide echo it provoked. This thesis goes back to the time when the decadent Wiener Secession shaped up refiewing the Reform Movement It also covers characteristics works of major members of the Wiener Werkstaette which were produced on the basis of the concept of Gesmtkunstwerk, The conclusion of this study is that : 1. Without losing its own specifc features various fields of formative arts were combinded together coherently and succeeded to realize the idealistic art that is the com-posite are 2. The Wiener Werkstaette was strongly opposed to the ready-made clothes which be-came popular as the society was Industrialized and commercialized. unlike those ready-to-wear clathes those members of the Wiener Werkstaette preferred to make each clothes with different mateirals and printed their own unique pattern designs. 3.As a results of close relationships between the Wiener Werkstaette and paul poiret 'Stu-dio Martine' was established in paris and new pattern deslhns were introduced by Raoul Dufy. 4. After the break-out of World War One cultural exchanges with other foreign countries were vuirtually cut off and the Wiener Werkstaette was disconnected from the influence of Parisl That was the motive for Wiener Werkstaette to start building up its unique artistic style with peculiar materials techniques and methods of productionl Those brisk and creative activities of the Wiener Werkstaette brought forth "the Golden perlod of 1920s" 5. Its historic design and ornamental pattern were assessed as a prelude to the Post-mod-ernism Since the late 1970s with the redis-covery of the culture of vienna in 1900s. the Art to wear which was created by the 'Wiener Werkstaette' but unfortunately tucked away by the Greate Depression and nationalism has been revaluated and studied. In Korea it was since 1985 when 'the art to wear' began to gain attention widely. It is urged that the theory of the 'Gesamtkunstwerk' should be also ac-cepted and shared earnestly.

  • PDF

On the Parcel Loading System of Naive Bayes-LSTM Model Based Predictive Maintenance Platform for Operational Safety and Reliability (Naive Bayes-LSTM 기반 예지정비 플랫폼 적용을 통한 화물 상차 시스템의 운영 안전성 및 신뢰성 확보 연구)

  • Sunwoo Hwang;Jinoh Kim;Junwoo Choi;Youngmin Kim
    • Journal of the Korea Safety Management & Science
    • /
    • v.25 no.4
    • /
    • pp.141-151
    • /
    • 2023
  • Recently, due to the expansion of the logistics industry, demand for logistics automation equipment is increasing. The modern logistics industry is a high-tech industry that combines various technologies. In general, as various technologies are grafted, the complexity of the system increases, and the occurrence rate of defects and failures also increases. As such, it is time for a predictive maintenance model specialized for logistics automation equipment. In this paper, in order to secure the operational safety and reliability of the parcel loading system, a predictive maintenance platform was implemented based on the Naive Bayes-LSTM(Long Short Term Memory) model. The predictive maintenance platform presented in this paper works by collecting data and receiving data based on a RabbitMQ, loading data in an InMemory method using a Redis, and managing snapshot DB in real time. Also, in this paper, as a verification of the Naive Bayes-LSTM predictive maintenance platform, the function of measuring the time for data collection/storage/processing and determining outliers/normal values was confirmed. The predictive maintenance platform can contribute to securing reliability and safety by identifying potential failures and defects that may occur in the operation of the parcel loading system in the future.

A Technique for Accurate Detection of Container Attacks with eBPF and AdaBoost

  • Hyeonseok Shin;Minjung Jo;Hosang Yoo;Yongwon Lee;Byungchul Tak
    • Journal of the Korea Society of Computer and Information
    • /
    • v.29 no.6
    • /
    • pp.39-51
    • /
    • 2024
  • This paper proposes a novel approach to enhance the security of container-based systems by analyzing system calls to dynamically detect race conditions without modifying the kernel. Container escape attacks allow attackers to break out of a container's isolation and access other systems, utilizing vulnerabilities such as race conditions that can occur in parallel computing environments. To effectively detect and defend against such attacks, this study utilizes eBPF to observe system call patterns during attack attempts and employs a AdaBoost model to detect them. For this purpose, system calls invoked during the attacks such as Dirty COW and Dirty Cred from popular applications such as MongoDB, PostgreSQL, and Redis, were used as training data. The experimental results show that this method achieved a precision of 99.55%, a recall of 99.68%, and an F1-score of 99.62%, with the system overhead of 8%.

Apriori Based Big Data Processing System for Improve Sensor Data Throughput in IoT Environments (IoT 환경에서 센서 데이터 처리율 향상을 위한 Apriori 기반 빅데이터 처리 시스템)

  • Song, Jin Su;Kim, Soo Jin;Shin, Young Tae
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.10 no.10
    • /
    • pp.277-284
    • /
    • 2021
  • Recently, the smart home environment is expected to be a platform that collects, integrates, and utilizes various data through convergence with wireless information and communication technology. In fact, the number of smart devices with various sensors is increasing inside smart homes. The amount of data that needs to be processed by the increased number of smart devices is also increasing, and big data processing systems are actively being introduced to handle it effectively. However, traditional big data processing systems have all requests directed to cluster drivers before they are allocated to distributed nodes, leading to reduced cluster-wide performance sharing as cluster drivers managing segmentation tasks become bottlenecks. In particular, there is a greater delay rate on smart home devices that constantly request small data processing. Thus, in this paper, we design a Apriori-based big data system for effective data processing in smart home environments where frequent requests occur at the same time. According to the performance evaluation results of the proposed system, the data processing time was reduced by up to 38.6% from at least 19.2% compared to the existing system. The reason for this result is related to the type of data being measured. Because the amount of data collected in a smart home environment is large, the use of cache servers plays a major role in data processing, and association analysis with Apriori algorithms stores highly relevant sensor data in the cache.