• Title/Summary/Keyword: redundant data

Search Result 444, Processing Time 0.024 seconds

VLSI Implementation of Forward Error Control Technique for ATM Networks

  • Padmavathi, G.;Amutha, R.;Srivatsa, S.K.
    • ETRI Journal
    • /
    • v.27 no.6
    • /
    • pp.691-696
    • /
    • 2005
  • In asynchronous transfer mode (ATM) networks, fixed length cells of 53 bytes are transmitted. A cell may be discarded during transmission due to buffer overflow or a detection of errors. Cell discarding seriously degrades transmission quality. The quality degradation can be reduced by employing efficient forward error control (FEC) to recover discarded cells. In this paper, we present the design and implementation of decoding equipment for FEC in ATM networks based on a single parity check (SPC) product code using very-large-scale integration (VLSI) technology. FEC allows the destination to reconstruct missing data cells by using redundant parity cells that the source adds to each block of data cells. The functionality of the design has been tested using the Model Sim 5.7cXE Simulation Package. The design has been implemented for a $5{\times}5$ matrix of data cells in a Virtex-E XCV 3200E FG1156 device. The simulation and synthesis results show that the decoding function can be completed in 81 clock cycles with an optimum clock of 56.8 MHz. A test bench was written to study the performance of the decoder, and the results are presented.

  • PDF

The Generation of Control Rules for Data Mining (데이터 마이닝을 위한 제어규칙의 생성)

  • Park, In-Kyoo
    • Journal of Digital Convergence
    • /
    • v.11 no.11
    • /
    • pp.343-349
    • /
    • 2013
  • Rough set theory comes to derive optimal rules through the effective selection of features from the redundancy of lots of information in data mining using the concept of equivalence relation and approximation space in rough set. The reduction of attributes is one of the most important parts in its applications of rough set. This paper purports to define a information-theoretic measure for determining the most important attribute within the association of attributes using rough entropy. The proposed method generates the effective reduct set and formulates the core of the attribute set through the elimination of the redundant attributes. Subsequently, the control rules are generated with a subset of feature which retain the accuracy of the original features through the reduction.

An Efficient Algorithm for Mining Ranged Association Rules (영역 연관규칙 탐사를 위한 효율적 알고리즘)

  • 조일래
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.1 no.2
    • /
    • pp.169-181
    • /
    • 1997
  • Some association rules can have very high confidence in a sub-interval or a subrange of the domain, though not quite high confidence in the whole domain. In this paper, we define a ranged association rule, an association with high confidence worthy of special attention in a sub-domain, and further propose an efficient algorithm which finds out ranged association rules. The proposed algorithm is data-driven method in a sense that hypothetical subranges are built based on data distribution itself. In addition, to avoid redundant database scanning, we devise an effective in-memory data structure, that is collected through single database scanning. The simulation shows that the suggested algorithm has reliable performance at the acceptable time cost in actual application areas.

  • PDF

Design and Implementation of Integrated System for Microarray Data (마이크로어레이 실험 및 분석 데이터 처리를 위한 통합 관리 시스템의 설계와 구현)

  • 이미경;최정현;조환규
    • Microbiology and Biotechnology Letters
    • /
    • v.31 no.2
    • /
    • pp.182-190
    • /
    • 2003
  • As DNA microarrays are widely used recently, the amount of microarray data is exponentially increasing. Until now, however, no domestic system is available for the efficient management of such data. Because the number of experimental data in a specific laboratory is limited, it is necessary to avoid redundant experiments and to accumulate the results using a shared data management system for microarrays. In this paper, a system named WEMA (WEb management of Micro Arrays) was designed and implemented to manage and process the microarray data. WEMA system was designed to include the basic feature of MIAME (Minimal Information About a Microarray Experiment), and general data units were also defined in the system in order to systematically manage the data. The WEMA system has three main features: efficient management of microarray data, integration of input/ouput data, and metafile processing. The system was tested with actual microarray data produced by a molecular biology laboratory, and we found that the biologists could systematically manage and easily analyze the microarray data. As a consequence, the researchers could reduce the cost of data exchange and communication.

The Study of Data Classification Rethesis on Korea Government DRM (Data Reference Model) - The Establishment of New Data Principal, Classfication and Case Verification - (범정부 데이터 참조모형 데이터 분류체계 재정립에 관한 연구 - 데이터 분류 원칙, 체계수립 및 사례 검증 -)

  • Koo, Ja-Myon;Park, Joo-Seok;Shin, Daul
    • Journal of Information Technology and Architecture
    • /
    • v.9 no.2
    • /
    • pp.187-197
    • /
    • 2012
  • The investment on informatization has caused the increase in complexity of IT resources as well as inefficiency of Information system management and redundant investment. Thus, the idea of EA (Enterprise Architecture) was developed in order to manage the IT resources efficiently but the systematical guideline was insufficiently provided in data area.. Because of this, it is necessary to make full use of DRM (Data Reference Model) so we can enhance the sharing and reuse of data between several institutions in public sector by extracting and managing data behind processes. In this study, we recognize the necessity of improvement on data classification which is highly utilized and present the direction for the data classification rethesis.

Performance Test of Paylad Data Receiving Equipment for STSAT-2 (과학기술위성 2호 탑재체데이터 수신시스템의 성능 시험)

  • Lee, Jong-Ju;Seo, In-Ho;Lee, Chol;Oh, Chi-Wook;Kim, Kyung-Hee;Park, Sung-Ok
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.35 no.4
    • /
    • pp.347-352
    • /
    • 2007
  • This paper describes the design and implementation of PFM(Proto Flight Model, PFM) of DRE(Data Receiving Equipment, DRE) for Science and Technology Satellite 2(STSAT-2) and the results of integration performance test. DRE components are X-band receiver, DCE(Data Combine Equipment, DCE) and RAC(Receiving and Archiving Computer, RAC). DCE consists of I&Q data combiner and ECL signal distributor. RAC consists of DRC(Data Receiving Card) and ST2RAS(STSAT-2 Receiving and Archinving Software). X-band receiver receives 10Mbps QPSK I, Q satellite data and sends the data to DCE. DRC stores the I&Q combine data from DCE to RAID. The pre-processing program sorts and stores to satellite status data and payload data. The performance of DRE in the functional and space environments test satisfies the requirements of STSAT-2.

The Use of Linearly Transformed LANDSAT Data in Landuse Classification (선형 변환된 LANDSAT 데이타를 이용한 토지이용분류(낙동강 하구역을 중심으로))

  • 안철호;박병욱;김종인
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.7 no.2
    • /
    • pp.85-92
    • /
    • 1989
  • The aim of this study is to find out the combination of effective transformed data, applying Remote Sensing techniques, as to the classification and particular objects by transforming the MSS data and TM data of the satellite LANDSAT into several linearly transformed data. Since one of the problems in the processing of the LANDSAT data is the vastness of the data, the Linear Transformation could be a method to perform analysis of those vast data, more efficiently and economically. This method is carried out as follows : (1) offering the simplicity over complex data, (2) selectional processing over redundant data and removing unnecessary data, (3) emphasizing on the object of the study ; by transforming multispectral data through linear calculation and statistical transformation. In this study, the analysis and transformation of the data have been performed by means of Band Ratioing and Principal Component Analysis. As the classificatory consequence, Infrared/RED Ratioing which expands the characterization of green vegetation, has been useful for a distinctive classification among other classes. For the Principal Component Analysis, band 1,2,7 are efficient in the classification of the green vegetation.

  • PDF

Development of Climate & Environment Data System for Big Data from Climate Model Simulations (대용량 기후모델자료를 위한 통합관리시스템 구축)

  • Lee, Jae-Hee;Sung, Hyun Min;Won, Sangho;Lee, Johan;Byu, Young-Hwa
    • Atmosphere
    • /
    • v.29 no.1
    • /
    • pp.75-86
    • /
    • 2019
  • In this paper, we introduce a novel Climate & Environment Database System (CEDS). The CEDS is developed by the National Institute of Meteorological Sciences (NIMS) to provide easy and efficient user interfaces and storage management of climate model data, so improves work efficiency. In uploading the data/files, the CEDS provides an option to automatically operate the international standard data conversion (CMORization) and the quality assurance (QA) processes for submission of CMIP6 variable data. This option increases the system performance, removes the user mistakes, and increases the level of reliability as it eliminates user operation for the CMORization and QA processes. The uploaded raw files are saved in a NAS storage and the Cassandra database stores the metadata that will be used for efficient data access and storage management. The Metadata is automatically generated when uploading a file, or by the user inputs. With the Metadata, the CEDS supports effective storage management by categorizing data/files. This effective storage management allows easy and fast data access with a higher level of data reliability when requesting with the simple search words by a novice. Moreover, the CEDS supports parallel and distributed computing for increasing overall system performance and balancing the load. This supports the high level of availability as multiple users can use it at the same time with fast system-response. Additionally, it deduplicates redundant data and reduces storage space.

Design and Integration of a Dual Redundancy Air Data System for Unmanned Air Vehicles (무인항공기 이중화 대기자료시스템 설계 및 통합 연구)

  • Won, Dae-Yeon;Yun, Seonghun;Lee, Hongju;Hong, Jin-Sung;Hwang, Sun-Yu;Lim, Heung-Sik;Kim, Taekyeum
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.23 no.6
    • /
    • pp.639-649
    • /
    • 2020
  • Air data systems measure airspeed, pressure altitude, angle of attack and angle of sideslip. These measurements are essential for operating flight control laws to ensure safe flights. Since the loss or corruption of air data measurements is considered as catastrophic, a high level of operational reliability needs to be achieved for air data systems. In the case of unmanned air vehicles, failure of any of air data sensors is more critical due to the absence of onboard pilot decision aid. This paper presents design of a dual redundancy air data system and the integration process for an unmanned air vehicle. The proposed dual-redundant architecture is based on two independent air data probes and redundancy management by central processing in two independent flight control computers. Starting from unit testing of single air data sensor, details are provided of system level tests used to meet overall requirements. Test results from system integration demonstrate the efficiency of the proposed process.

Similar Trajectory Store Scheme for Efficient Store of Vehicle Historical Data (효율적인 차량 이력 데이터 저장을 위한 유사 궤적 저장 기법)

  • Kwak Ho-Young;Han Kyoung-Bok
    • The Journal of the Korea Contents Association
    • /
    • v.6 no.1
    • /
    • pp.114-125
    • /
    • 2006
  • Since wireless Internet services and small mobile communication devices come into wide use as well as the use of GPS is rapidly growing, researches on moving object, whose location information shifts sequently in accordance with time interval, are being carried out actively. Especially, the researches on vehicle moving object are applied to Advanced traveler information system, vehicle tracking system, and distribution transport system. These systems are very useful in searching previous positions, predicted future positions, the optimum course, and the shortest course of a vehicle by managing historical data of the vehicle movement. In addition, vehicle historical data are used for distribution transport plan and vehicle allocation. Vehicle historical data are stored at regular intervals, which can have a pattern. For example, a vehicle going repeatedly around a specific section follows a route very similar to another. If historical data of the vehicle with a repeated route course are stored at regular intervals, many redundant data occur, which result in much waste of storage. Therefore this thesis suggest a vehicle historical data store scheme for vehicles with a repeated route course using similar trajectory which efficiently store vehicle historical data.

  • PDF