• Title/Summary/Keyword: grid file

Search Result 77, Processing Time 0.023 seconds

Provisioning Scheme of Large Volume File for Efficient Job Execution in Grid Environment (그리드 환경에서 효율적인 작업 처리를 위한 대용량 파일 프로비저닝 방안)

  • Kim, Eun-Sung;Yeom, Beon-Y.
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.15 no.8
    • /
    • pp.525-533
    • /
    • 2009
  • Staging technique is used to provide files for a job in the Grid. If a staged file has large volume, the start time of the job is delayed and the throughput of job in the Grid may decrease. Therefore, removal of staging overhead helps the Grid operate more efficiently. In this paper, we present two methods for efficient file provisioning to clear the overhead. First, we propose RA-RFT, which extends RFT of Globus Toolkit and enables it to utilize RLS with replica information. RA-RFT can reduce file transfer time by doing partial transfer for each replica in parallel. Second, we suggest Remote Link that uses remote I/O instead of file transfer. Remote link is able to save storage of computational nodes and enables fast file provisioning via prefetching. Through various experiments, we argue that our two methods have an advantage over existing staging techniques.

A Study of File Replacement Policy in Data Grid Environments (데이터 그리드 환경에서 파일 교체 정책 연구)

  • Park, Hong-Jin
    • The KIPS Transactions:PartA
    • /
    • v.13A no.6 s.103
    • /
    • pp.511-516
    • /
    • 2006
  • The data grid computing provides geographically distributed storage resources to solve computational problems with large-scale data. Unlike cache replacement policies in virtual memory or web-caching replacement, an optimal file replacement policy for data grids is the one of the important problems by the fact that file size is very large. The traditional file replacement policies such as LRU(Least Recently Used) LCB-K(Least Cost Beneficial based on K), EBR(Economic-based cache replacement), LVCT(Least Value-based on Caching Time) have the problem that they have to predict requests or need additional resources to file replacement. To solve theses problems, this paper propose SBR-k(Sized-based replacement-k) that replaces files based on file size. The results of the simulation show that the proposed policy performs better than traditional policies.

UI4GSD: Design and Implementation of User Interface for Grid Service Development Based on Globus Toolkit 4 (UI4GSD: 글로버스 툴킷 4 기반 그리드 서비스 개발을 위한 사용자 인터페이스의 설계 및 구현)

  • Kim, Hyuk-Ho;Lee, Pil-Woo;Kim, Yang-Woo
    • Journal of Internet Computing and Services
    • /
    • v.8 no.5
    • /
    • pp.45-58
    • /
    • 2007
  • This paper presents UI4GSD (User Interface for Grid Service Development) for grid service developers that provides an efficient and friendly development environment based on Globus Toolkit 4, Normally, implementing grid service requires special expert knowledge for Grid as well as programming, Moreover, grid service development as well as testing of the deployed service in the Globus container takes a long Time, which makes the grid service implementation very inefficient, However, UI4GSD can automatically generate a grid service interface file, a build file, and grid service class files as well as a client class file, using the information supplied by developers through GUI. In UI4GSD, a grid service is developed easily based on typical five step processes with required input data fed at each step. As, a result, UI4GSD can provide an easy and convenient development environment thereby increasing the efficiency and convenience in developing grid services.

  • PDF

SBR-k(Sized-base replacement-k) : File Replacement in Data Grid Environments (SBR-k(Sized-based replacement-k) : 데이터 그리드 환경에서 파일 교체)

  • Park, Hong-Jin
    • The Journal of the Korea Contents Association
    • /
    • v.8 no.11
    • /
    • pp.57-64
    • /
    • 2008
  • The data grid computing provides geographically distributed storage resources to solve computational problems with large-scale data. Unlike cache replacement policies in virtual memory or web-caching replacement, an optimal file replacement policy for data grids is the one of the important problems by the fact that file size is very large. The traditional file replacement policies such as LRU(Least Recently Used), LCB-K(Least Cost Beneficial based on K), EBR(Economic-based cache replacement), LVCT(Least Value-based on Caching Time) have the problem that they have to predict requests or need additional resources to file replacement. To solve theses problems, this paper propose SBR-k(Sized-based replacement-k) that replaces files based on file size. The proposed policy considers file size to reduce the number of files corresponding to a requested file rather than forecasting the uncertain future for replacement. The results of the simulation show that hit ratio was similar when the cache size was small, but the proposed policy was superior to traditional policies when the cache size was large.

The Implementation of DXF Application On Smart Devices

  • Kim, Dong-Hyun
    • Journal of information and communication convergence engineering
    • /
    • v.9 no.5
    • /
    • pp.567-572
    • /
    • 2011
  • As the mobile devices have powerful CPUs and memories, it is possible to carry the large volumes of design drawings, such as DXF files, on mobile devices. However, since the format of a DXF file is the ASCII, it has the shortcoming where the size of a file is larger than a binary formatted file and it is difficult to display the entities of drawings quickly on mobile devices. In this paper, we design the DXF manager system on a smart phone. To speed up the rate of the display and panning, the DXF manager hires the spatial index, the fixed grid file. We also implement the system on the Samsung Omnia-1$^{(R)}$ to exploit the Windows Mobile$^{(R)}$ operating system.

Construction of rapid earthquake damage evaluation system - Real-time two-dimensional visualization of ground motion (지진신속피해평가시스템 구축 - 실시간 지진동의 2차원적 영상화)

  • 지헌철;전정수;이희일;박정호;임인섭
    • Proceedings of the Earthquake Engineering Society of Korea Conference
    • /
    • 2002.09a
    • /
    • pp.51-60
    • /
    • 2002
  • In this study we developed the visualization scheme of spatial ground-motion measurements in real time by using DSS data. Even though this scheme itself is useful for national earthquake mitigation plans, this scheme could be served as the crucial core for constructing rapid earthquake damage evaluation system. DSS is the abbreviation of Data Subscription Service and this is the pre-assigned request for the seismic stations to send very limited brief data with high priority and negligible transmission load. In addition to visualize the damage area with intensity, the corresponding epicenter can be estimated roughly for quick event alarm. For the interpolation of spatially irregular PGA data, the program, named as surface. of GMT was used with NetCDF grid file format. Since the grid file is similar to a postscript file, the program, called as shading, was coded with C language by using Matpak library in order to convert grid files into image files.

  • PDF

Estimation of Data Distribution Using Multidimensional Dynamic File Organization (다차원 동적 화일 구조를 이용한 데이타 분포의 추정)

  • Kim, Sang-Wook
    • Journal of Industrial Technology
    • /
    • v.15
    • /
    • pp.41-50
    • /
    • 1995
  • This paper presents a technique for estimating distribution of data stored in a database. This technique is very useful for accurate selectivity estimation, which is essential in query optimization and physical database design. To maintain data distribution, we employ the directory of the multilevel grid file, a multidimensional dynamic file organization. The major advantage of our technique is that data distribution information is maintained dynamically in the multilevel grid file. In contrast, other static methods such as the histogram method use static date structures, which requires periodic restructuring. Furthermore, we propose a method for keeping the abstract information of data distribution in main memory. This is advantageous in the situation where the size of main memory is not sufficient. Finally, We also suggest formulas for calculating selectivies of various queries based on our data distribution information.

  • PDF

Text File Region Management on Grids (그리드 시스템에서 텍스트 파일 영역 관리)

  • Kim, Seung-Min;Yoo, Suk-I.;Kim, Il-Kon
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.13 no.7
    • /
    • pp.499-507
    • /
    • 2007
  • In the areas of CAE, CAD and CAO integration & automation technology, the word 'File Wrapping' means a virtualization of TEXT files that supports variables-based I/Os like variable assignments in programming languages. This File Wrapping process is one of the cornerstones of CAE, CAD and GAO integration & automation, and the performance of File Wrapping process, which is depending on the sire of a TEXT file to be accessed and the number of regions and their distribution, has a critical effect on the total performance of the CAE, CAD and CAO integration & automation systems. In this paper, we define TEXT File Region Management which generalizes the main functions of the File Wrapping process, and describe a prototype of TEXT file Region Management which is implemented as a Grid service. After that, the validity of the proposed model and the TEXT File Region Management service are discussed with evaluation results of the prototype.

The Design of the Drawing Management on Smart Operating Environments (스마트 운영 환경에서의 도면 관리기의 설계)

  • Kim, Dong-Hyun;Park, Min-Ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2011.05a
    • /
    • pp.223-226
    • /
    • 2011
  • To design a drawing at construction sites or ship yards, generally, they exploit CAD program, such as AutoCAD. They also carry the printed drawings in the fields in order to refer the designs. However, the printed designs are easy to be damaged. In this paper, we propose the design of a management system for the CAD drawings on top of the smart operating systems of a smart device. The proposed system exploits the index file based on the Fixed GRID file in order to improve the display speed of the drawings.

  • PDF

The Implementation of a Fixed Grid File on the Hand-held Storage (휴대저장장치에서 고정그리드파일의 구현)

  • Kim, Dong Hyun;Ban, Chae Hoon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2013.10a
    • /
    • pp.313-315
    • /
    • 2013
  • Hand-held devices such as smart phones exploit flash memory based storages to store data for processing jobs. Since the flash memory, non-volatile memory, is able to store mass data, it is required to use the index for processing queries. However, the flash memory has the shortcomings that it does not support the overwrite operation and its write operation is very slow. In this paper, we build the fixed grid file, one of the multi-dimensional spatial index, on a flash memory and evaluate the performance test.

  • PDF