• Title/Summary/Keyword: Collection storage

Search Result 351, Processing Time 0.028 seconds

Design of a Platform for Collecting and Analyzing Agricultural Big Data (농업 빅데이터 수집 및 분석을 위한 플랫폼 설계)

  • Nguyen, Van-Quyet;Nguyen, Sinh Ngoc;Kim, Kyungbaek
    • Journal of Digital Contents Society
    • /
    • v.18 no.1
    • /
    • pp.149-158
    • /
    • 2017
  • Big data have been presenting us with exciting opportunities and challenges in economic development. For instance, in the agriculture sector, mixing up of various agricultural data (e.g., weather data, soil data, etc.), and subsequently analyzing these data deliver valuable and helpful information to farmers and agribusinesses. However, massive data in agriculture are generated in every minute through multiple kinds of devices and services such as sensors and agricultural web markets. It leads to the challenges of big data problem including data collection, data storage, and data analysis. Although some systems have been proposed to address this problem, they are still restricted either in the type of data, the type of storage, or the size of data they can handle. In this paper, we propose a novel design of a platform for collecting and analyzing agricultural big data. The proposed platform supports (1) multiple methods of collecting data from various data sources using Flume and MapReduce; (2) multiple choices of data storage including HDFS, HBase, and Hive; and (3) big data analysis modules with Spark and Hadoop.

An Adaptive Storage System for Enhancing Data Reliability in Solar-powered Sensor Networks (태양 에너지 기반 센서 네트워크에서 데이터의 안정성을 향상시키기 위한 적응형 저장 시스템)

  • Noh, Dong-Kun
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.36 no.5
    • /
    • pp.360-370
    • /
    • 2009
  • Using solar power in wireless sensor networks requires a different approach to energy optimization from networks with battery-based nodes. Solar energy is an inexhaustible supply which can potentially allow a system to run forever, but there are several issues to be considered such as the uncertainty of energy supply and the constraint of rechargeable battery capacity. In this paper, we present SolarSS: a reliable storage system for solar-powered sensor networks, which provides a set of functions, in separate layers, such as sensory data collection, replication to prevent failure-induced data loss, and storage balancing to prevent depletion-induced data loss. SolarSS adapts the level of layers activated dynamically depending on solar energy availability, and provides an efficient resource allocation and data distribution scheme to minimize data loss.

A study for the utilization of ready-prepared foodservice system concept to the Korean hospital foodservice operations (병원급식에서 Ready-Prepared Foodservice System 이용에 관한 연구)

  • Kim, Ji-Young;Kim, Hah-Young
    • Korean journal of food and cookery science
    • /
    • v.2 no.2
    • /
    • pp.21-31
    • /
    • 1986
  • Here is a research on hospital foodservice system, when korea traditional food of pyeon yuk and bin dae deok were used by ready-prepared foodservice system, it was estimated the preservations of microbiological quality and sensory quality. All data collection was replicated three times. The results were as following; 1. In time and temperature data, two menu items were needed internal temperature below $7^{\circ}C$ in a cooling stage, and in the case of cook/chill storage, the days were shortened within weeks, and the holding time must be possiblely minimized. Finally foods were served sanitary. 2. In view of microbiological safety, in the case of cook/chill storage as $0{\sim}4^{\circ}C$ the days must be shortened within 2 weeks and its was possible to store until 6 weeks in $-20{\sim}-23.3^{\circ}C$. So to preserve pre-cooked food longly, it was effective to freeze them quickly by using vacuum package and to reheat them by a microwave oven before serving and to serve lastly in microbiological quality. 3. Hospital ready-prepared foodservice system with food storage in plastic bags, biochemical test of C. Perfingens C. botulinum and Salmonella were not detected. 4. By using of a microwave oven, it had effects of thawing, reheating and sterilizing of chilled and frozen foods in a short time. 5. Sensory evaluations were made by a 10-member panel using five scoring tests. Because sensory of quality was lowered in the case of chilled storage, it was possible to serve foods within 2 weeks. Texture and aroma were preserved by cook/frozen system and usually there was no significance from 4 weeks until 6 weeks, but considering of the objects, it was good to store until 4 weeks in sensory quality.

  • PDF

In vitro shoot initiation of Artocarpus heterophyllus Lam. (Jak Fruit) Effect of the explant type and the season of explant collection

  • Kahk, Kasturiarachchi;Wtpsk, Senarath;Lee, Kui-Jae
    • Proceedings of the Plant Resources Society of Korea Conference
    • /
    • 2003.10a
    • /
    • pp.9-18
    • /
    • 2003
  • A method for rapid propagation of mature Jack fruit was developed. Four types of explants (mature embryos, apical meristems of young seedlings, apices from mature plants and nodal segments) were used. It has been found 88% of young apical meristems produced shoots in Campbell and Durzan (CD) medium compared to 60% in Murashige and Skoog (MS) medium. Only 1/3 of them produced multiple shoots. Shoot idtiation from nodal segments was very rare. Mature apices produced callus. Although removed of the sheathing cover around mature buds enhanced the shoot initiation but success rate was low in growth regulator free medium. Embryos respond to the CD medium but not to the MS medium. Embryos from seeds soaked in water for 24 hours produced shoots after 8 weeks of incubation and the success rate was 70% while embryos from dry seeds only produced roots. There was no significant effect of cold storage (refrigeration) for 7 days on shoot initiation from mature embryos (65%) but the ability for shoot induction declines with storage time (55% after 21 days of cold storage). Mature axillary buds were established in Modified Campbell and Durzan (CD) medium supplemented with 0.5mg/1 and IBA. There was a significant difference in the growth performance of shoots according to the period of the year in which explants were collected. Highest (60%) was observed in November-January period. It was only 30% when the explants were collected in February-April or May-July and decreased to 20% in August-October. The shoots produced in November-January showed a higher vigor than those produced in other months. Since Jak fruit show seasonal changes in fruit bearing and shedding of leaves, it can be suggested that the difference in growth performances of tissues cultured in artificial culture media would have been affected by endogenous rhythms.

  • PDF

The Automatic Collection and Analysis System of Cloud Artifact (클라우드 아티팩트 자동 수집 및 분석 시스템)

  • Kim, Mingyu;Jeong, Doowon;Lee, Sangjin
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.25 no.6
    • /
    • pp.1377-1383
    • /
    • 2015
  • As the cloud services users' increase, there are important files created by individual in cloud storage. Thus, investigation of cloud artifact should be conducted. There are two methods of analyzing cloud service, one is that investigates cloud server provider (CSP), and another is that investigates client. In this paper, we presents an automated framework to detect the altered artifact and developes a tool that detects the cloud artifact. We also developed Cloud Artifact Tool that can investigate client computer. Cloud Artifact Tool provides feature of collection and analysis for the services such as Google Drive, Dropbox, Evernote, NDrive, DaumCloud, Ucloud, LG Cloud, T Cloud and iCloud.

Problems in the Use of Microforms in Research Libraries -With a special reference to the users' attitude in Korean research organizations- (마이크로형태자료 이용의 문제점 -우리나라 연구기관의 이용자조사를 중심으로-)

  • Lee Soon Ja
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.7
    • /
    • pp.197-223
    • /
    • 1980
  • This paper consists of two parts: the first part discusses general problems of microforms as transmission and storage media of research information, especially in view of user's reactions to this unconventional media. Many articles and surveys from major American library journals and other professional publications have been mentioned and reviewed to find out the common issues which could be relevent to Korean case. The latter part is the analysis of the two sets of surveys. One was done from 5 research libraries in Seoul and the other, from 150 researchers who were the users of the libraries. The major findings are: The research libraries in Korea are in the infant stage of building their microform research collection. They are doing their special effort to level up the weaknesss of the collection. Presently, general level of usage is very low, although the users showed a positive attitude toward this unaccustomed media. They are well convinced with necessity of use of microforms in their research and they have correct ideas about some of the problems they are going to face along with the eventual heavier use of the materials. They are psychologically ready to accept them and to make a good use out of them if some of the external conditions for proper use of the material would be guaranteed.

  • PDF

A Flash Memory Swap System for Mobile Computers (모바일 컴퓨터를 위한 플래시 메모리 스왑 시스템)

  • Jeon, Seon-Su;Ryu, Yeon-Seung
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.9
    • /
    • pp.1272-1284
    • /
    • 2010
  • As the mobile computers are becoming powerful and are used like general-purpose computers, operating systems for mobile computers also require swap system functionality that utilizes main memory efficiently. Flash memory is widely used as storage device for mobile computers but current linux swap system does not consider flash memory. Swap system is tightly related with process execution since it stores the contents of process in execution. By taking advantage of this characteristics, in this paper, we study a new linux swap system called PASS(Process-Aware Swap System), which allocates the different flash memory blocks to each process. Trace-driven experimental results show that PASS outperforms existing linux swap system with existing garbage collection schemes in terms of garbage collection cost.

Effective visualization methods for a manufacturing big data system (제조 빅데이터 시스템을 위한 효과적인 시각화 기법)

  • Yoo, Kwan-Hee
    • Journal of the Korean Data and Information Science Society
    • /
    • v.28 no.6
    • /
    • pp.1301-1311
    • /
    • 2017
  • Manufacturing big data systems have supported decision making that can improve preemptive manufacturing activities through collection, storage, management, and predictive analysis of related 4M data in pre-manufacturing processes. Effective visualization of data is crucial for efficient management and operation of data in these systems. This paper presents visualization techniques that can be used to effectively show data collection, analysis, and prediction results in the manufacturing big data systems. Through the visualization technique presented in this paper, we have confirmed that it was not only easy to identify the problems that occurred at the manufacturing site, but also it was very useful to reply to these problems.

A Garbage Collection of Message Logs without Additional Messages on Causal Message Logging Protocol (인과적 메시지 로깅 기법에서 부가적 메시지 교환 없는 메시지 로그 쓰레기 처리 기법)

  • Jeong, Gwang-Sik;Yu, Heon-Chang;Baek, Maeng-Sun;Son, Jin-Gon;Hwang, Jong-Seon
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.28 no.7
    • /
    • pp.331-340
    • /
    • 2001
  • 이 논문은 인과적 메시지 로깅 기법에서 결함 포용을 목적으로 안전 저장 장치(stable storage)에 저장되는 메시지 내용 로그와 메시지 순서 로그의 쓰레기 처리 기법을 제안한다. 기존의 인과적 메시지 로깅을 기반으로 한 메시지 로그 쓰레기 처리 기법은 메시지 순서 로그의 쓰레기만을 처리하였다. 메시지 내용 로그는 불필요한 복귀를 피하기 위해 유지해야 하며, 메시지내용 로그의 쓰레기 처리를 위해서는 부가적인 메시지를 필요로 하였다. 이 논문은 인과적 메시지 로깅 기법에서 메시지 내용 로그와 메시지 순서 로그가 쓰레기 처리되어지기 위해 필요한 조건을 새롭게 정의하며, 이 정의를 기반으로 한 메시지 내용 로그와 메시지 순서 로그의 쓰레기 처리 알고리즘을 제안한다. 제시된 조건을 기반으로 한 메시지 내용 로그와 메시지 순서 로그의 쓰레기 처리는 송수신 메시지에 부가된 MAG(Modified Antecednce Graph)를 이용하므로 쓰레기 처리를 위한 부가적인 메시지를 발생시키지 않는다. 하지만 제안된 기법은 일반 메시지가 송수신되기 전까지 쓰레기 처리가 지연되는 '지연 쓰레기 처리 현상(lazy garbage collection)'을 발생시킨다. 하지만 '지연 쓰레기 처리 현상'은 분산 시스템의 일관성을 위배하지 않으며, 쓰레기 처리를 위한 부가적인 메시지 교환을 필요로 하지 않는다.

  • PDF

Shannon's Information Theory and Document Indexing (Shannon의 정보이론과 문헌정보)

  • Chung Young Mee
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.6
    • /
    • pp.87-103
    • /
    • 1979
  • Information storage and retrieval is a part of general communication process. In the Shannon's information theory, information contained in a message is a measure of -uncertainty about information source and the amount of information is measured by entropy. Indexing is a process of reducing entropy of information source since document collection is divided into many smaller groups according to the subjects documents deal with. Significant concepts contained in every document are mapped into the set of all sets of index terms. Thus index itself is formed by paired sets of index terms and documents. Without indexing the entropy of document collection consisting of N documents is $log_2\;N$, whereas the average entropy of smaller groups $(W_1,\;W_2,...W_m)$ is as small $(as\;(\sum\limits^m_{i=1}\;H(W_i))/m$. Retrieval efficiency is a measure of information system's performance, which is largely affected by goodness of index. If all and only documents evaluated relevant to user's query can be retrieved, the information system is said $100\%$ efficient. Document file W may be potentially classified into two sets of relevant documents and non-relevant documents to a specific query. After retrieval, the document file W' is reclassified into four sets of relevant-retrieved, relevant-not retrieved, non-relevant-retrieved and non-relevant-not retrieved. It is shown in the paper that the difference in two entropies of document file Wand document file W' is a proper measure of retrieval efficiency.

  • PDF