• Title/Summary/Keyword: store format

Search Result 109, Processing Time 0.026 seconds

A Study on Data Processing Technology based on a open source R to improve utilization of the Geostationary Ocean Color Imager(GOCI) Products (천리안해양관측위성 산출물 활용성 향상을 위한 오픈소스 R 기반 데이터 처리기술 연구)

  • OH, Jung-Hee;CHOI, Hyun-Woo;LEE, Chol-Young;YANG, Hyun;HAN, Hee-Jeong
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.22 no.4
    • /
    • pp.215-228
    • /
    • 2019
  • HDF5 data format is used to effectively store and distribute large volume of Geostationary Ocean Color Imager(GOCI) satellite data. The Korea Ocean Satellite Center has developed and provided a GOCI Data Processing System(GDPS) for general users who are not familiar with HDF5 format. Nevertheless, it is not easy to merge and process Hierarchical Data Format version5(HDF5) data that requires an understanding of satellite data characteristics, needs to learn how to use GDPS, and stores location and attribute information separately. Therefore, the open source R and rhdf5, data.table, and matrixStats packages were used to develop algorithm that could easily utilize satellite data in HDF5 format without the need for the process of using GDPS.

Manipulating Geometry Instances in an STEP-based OODB from Commercial CAD Systems (상업용 CAD에서 STEP 기반 객체지향 데이터베이스 내부의 형상 인스턴스 검색 및 수정)

  • Kim, Junhwan;Han, Soonhung
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.28 no.4
    • /
    • pp.435-442
    • /
    • 2002
  • It is difficult to access and share design data among heterogeneous CAD systems. Usually, different CAD systems exchange the design data using a neutral format such as IGES or STEP. A prototype CAD system which uses a geometric kernel and a commercial database management system has been implemented. The prototype system used the Open Cascade geometric kernel and the commercial object-oriented database ObjectStore. STEP provides the database schema. The database can be accessed from commercial CAD systems such as SolidWorks or Unigraphics. The data access module from a commercial CAD system is developed with the CAD system's native API, ObjectStore API functions, and ActiveX.

A Reference Architecture and Manifest Standard Suggestions for Interworking Open Web Store (OWS(Open Web Store) 연동을 위한 참조 모델 및 Manifest 표준 제안)

  • Ryu, Taejun;Kim, Changjun;Jeon, Jonghong;Lee, Seungyoon;Park, Sangwon
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.2 no.11
    • /
    • pp.779-788
    • /
    • 2013
  • With a wide dissemination of smartphones, the number of native applications developed and sold freely by anyone is growing now. The application market activated by Apple's App Store is spreading more rapidly with Google's Google Play. But due to platform-dependent of native application's attribute, developers are programming at each platform. As a result, development cost is increasing compared to earnings. To solve a dependency problem, people focused on web application developed by web-based language. However, stores at each browser are requiring a web application to follow manifest format. And this causes browser-dependent problem. Those problems can be solved by installing a certain browser, but this can make an application useless on the other browser of a store. Dependency problem can narrow not only user's application variation, but also concentration on some specific store. OWS(Open Web Store) is a standard store that supports various web environments. It overcomes browser or platform dependency problems by interworking applications between stores. Also customers are able to choose a large number of applications. In this paper, related to OWS, I would like to suggest manifest standards and store's reference architecture. An interworking scenario is going to be proposed as well.

A New Dictionary Mechanism for Efficient Fault Diagnosis (효율적인 고장진단을 위한 딕셔너리 구조 개발)

  • Kim Sang-Wook;Kim Yong-Joon;Chun Sung-Hoon;Kang Sung-Ho
    • Journal of the Institute of Electronics Engineers of Korea SD
    • /
    • v.43 no.4 s.346
    • /
    • pp.49-55
    • /
    • 2006
  • In this paper, a fault dictionary for fault locations is considered. The foremost problem in fault diagnosis is the size of the data. As circuits are large, the data for fault diagnosis increase to the point where they are impossible to be stored. The increased information makes it impossible to store the dictionary into storage media. In order to generate the dictionary, j.e. pass-fail dictionary some dictionaries store a portion of the information. The deleted data makes it difficult to diagnose fault models except single stuck-at fault. This paper proposes a new dictionary format. A new format makes a dictionary small size without deleting any informations.

Design and Implementation of a Data Conversion System between SDTS and Informap (SDTS와 Informap간의 데이타 변환 시스템의 설계 및 구현)

  • Oh, Byoung-Woo;Lee, Kang-Jun;Han, Ki-Joon
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.4 no.2 s.8
    • /
    • pp.109-121
    • /
    • 1996
  • It is very difficult to exchange geographical data among geographical information systems which store their spatial data with independent storage structures. Since, moreover, large amount of storage space is necessary to store spatial data and ex pen sive cost is required to input them, waste will grow as they are stored redundantly. Therefore, it is essential to share them with other geographical information systems by exchanging spatial data among them. In order to exchange spatial data efficiently, there exist several international standards for data exchange format. In this paper, we design and implement a data conversion system that converts geographical data between SDTS (Spatial Data Transfer Standard) which is adopted as the national standard for common data exchange format and Informap which is the existing mapping system. We first analyze the storage structures of SDTS and Informap, respectively and develop gateway functions according to these analyses for efficient conversion. Finally, we design and implement the overall data conversion system between SDTS and Informap using the gateway functions.

  • PDF

Development of a SDTS Data Conversion System for GOTHIC (GOTHIC을 위한 SDTS 데이타 변환 시스템의 개발)

  • Zhang, Yan-Sheng;Kim, Jun-Jong;Han, Ki-Joon;Yun, Jae-Kwan
    • Journal of Korea Spatial Information System Society
    • /
    • v.2 no.2 s.4
    • /
    • pp.99-115
    • /
    • 2000
  • A geographic information system (GIS) generally has a great deal of geographic data and has a singular storage structure individually. It is very hard to exchange geographic data between geographic information systems which store their geographic data with incompatible formats. Moreover, since it needs large amount of storage space to store geographic data and expensive cost to input them. In this paper, we designed and implemented a SDTS (Spatial Data Transfer Standard) Data Conversion System for Gothic which is an existing geographic information system. In order to convert geographic data without loss of information, we first carefully define a mapping between SDTS data and Gothic data. Especially, since SDTS data are in the format of ISO8211, the FIPS123 library is used to access them. Because the internal data format of Gothic is not open to the public, we also use the Gothic library to access Gothic data. The SDTS data conversion system developed in this paper uses an intermediate file to convert geographic data efficiently. In addition, we use UIL (User Interface Language) to implement a graphic user interface (GUI) of our system.

  • PDF

An Efficient Technique for Storing XML Data Without DTD (DTD가 없는 XML 데이터의 효율적인 저장 기법)

  • Park, Gyeong-Hyeon;Lee, Gyeong-Hyu;Ryu, Geun-Ho
    • The KIPS Transactions:PartD
    • /
    • v.8D no.5
    • /
    • pp.495-506
    • /
    • 2001
  • XML makes it possible for data to be exchanged regradless of the data model in which it is represented or the platform on which it is stored, serving as a standard for data exchange format on the internet. Especially, it is natural to send XML data without DTD on the internet when XML is data-centric. Therefore it is needed to extract relational schema to store XML data efficiently, to optimize queries, and to publish data which have been stored in the relational database in the XML format. In this paper, we proposed a method to generate relational database in the XML documents without DTD and store XML data using upper/lower bound schema extraction technique for semistructured data. In extracting a lower bound schema, we especially show an efficient technique for creating relational schema by using simulation with is more advanced than the datalog method.

  • PDF

Processing Method of Mass Small File Using Hadoop Platform (하둡 플랫폼을 이용한 대량의 스몰파일 처리방법)

  • Kim, Chang-Bok;Chung, Jae-Pil
    • Journal of Advanced Navigation Technology
    • /
    • v.18 no.4
    • /
    • pp.401-408
    • /
    • 2014
  • Hadoop is composed with MapReduce programming model for distributed processing and HDFS distributed file system. Hadoop is suitable framework for big data processing, but processing of mass small files have many problems. The processing of mass small file in hadoop have problems to created one mapper per one file, and it have problems to needed many memory for store of meta information of file. This paper have comparison evaluation processing method of mass small file with various method in hadoop platform. The processing of general compression format is inadequate because of processing by one mapper regardless of data size. The processing of sequence and hadoop archive file is removed memory problem of namenode by compress and combine of small file. Hadoop archive file is faster then sequence file about combine time of small file. The processing using CombineFileInputFormat class is needed not combine of small file, and it have similar speed big data processing method.

Design of a XML-based Data Store Architecture for Run-time Process Monitor (실행시간 프로세스 모니터를 위한 XML 기반의 데이터 저장소의 설계)

  • Jeong, Yoon-Seok;Kim, Tae-Wan;Chang, Chun-Hyon
    • The KIPS Transactions:PartA
    • /
    • v.10A no.6
    • /
    • pp.715-722
    • /
    • 2003
  • Monitoring is used to see if a real-time system provides a service on time. The target of monitoring is not only an interior system but also a remote system which is located in the remote network. Monitoring needs data store to monitor data from each system. But a data store should be designed on the considerations of time constraints and data accessibility. In this paper, we present an architecture of XML-based data store and network delivery. XML-based data store is based on XML which is a standardized data format. So any platform which supports TCP/IP and HTTP can access data in the data store without any conversion. The XML-based delivery architecture is designed to reduce the time of data access and delivery. In addition, some experiments were tested to provide the timing guideline to be kept by a real-time system which uses the architecture presented in this paper. The architecture of XML-based data store and delivery designed in this paper can be used in the domains of remote real-time monitoring and control.

A Design of Architecture Information Management System Using XML (XML을 이용한 건축정보관리 시스템 설계)

  • Lee, Jae-Young;Han, Chi-Geun;Kim, In-Han;Jo, Chan-Won
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2004.05a
    • /
    • pp.405-408
    • /
    • 2004
  • This paper describes an architecture information management system using XML. The purpose of the system is to manage the information stored in standard format, XML, that has many valuable properties. The proposed architecture information consists of project information, drawing information, and material information. Each information is expressed using XML and for each information, XML schema is presented in this paper. In this system, detail information of materials that exists on the supplier's homepage can be displayed when the user of the system wants to check the detail information. Also, drawings stored in STEP data can be browsed in this system. The reports of each information are prepared using XSL. The proposed system shows that XML can be used for a format to store architecture information and various functions can be implemented based on XML related standards.

  • PDF