• Title/Summary/Keyword: Compress Map

Search Result 15, Processing Time 0.021 seconds

Conversion of Large RDF Data using Hash-based ID Mapping Tables with MapReduce Jobs (맵리듀스 잡을 사용한 해시 ID 매핑 테이블 기반 대량 RDF 데이터 변환 방법)

  • Kim, InA;Lee, Kyu-Chul
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.236-239
    • /
    • 2021
  • With the growth of AI technology, the scale of Knowledge Graphs continues to be expanded. Knowledge Graphs are mainly expressed as RDF representations that consist of connected triples. Many RDF storages compress and transform RDF triples into the condensed IDs. However, if we try to transform a large scale of RDF triples, it occurs the high processing time and memory overhead because it needs to search the large ID mapping table. In this paper, we propose the method of converting RDF triples using Hash-based ID mapping tables with MapReduce, which is the software framework with a parallel, distributed algorithm. Our proposed method not only transforms RDF triples into Integer-based IDs, but also improves the conversion speed and memory overhead. As a result of our experiment with the proposed method for LUBM, the size of the dataset is reduced by about 3.8 times and the conversion time was spent about 106 seconds.

  • PDF

Lossless Compression for Hyperspectral Images based on Adaptive Band Selection and Adaptive Predictor Selection

  • Zhu, Fuquan;Wang, Huajun;Yang, Liping;Li, Changguo;Wang, Sen
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.8
    • /
    • pp.3295-3311
    • /
    • 2020
  • With the wide application of hyperspectral images, it becomes more and more important to compress hyperspectral images. Conventional recursive least squares (CRLS) algorithm has great potentiality in lossless compression for hyperspectral images. The prediction accuracy of CRLS is closely related to the correlations between the reference bands and the current band, and the similarity between pixels in prediction context. According to this characteristic, we present an improved CRLS with adaptive band selection and adaptive predictor selection (CRLS-ABS-APS). Firstly, a spectral vector correlation coefficient-based k-means clustering algorithm is employed to generate clustering map. Afterwards, an adaptive band selection strategy based on inter-spectral correlation coefficient is adopted to select the reference bands for each band. Then, an adaptive predictor selection strategy based on clustering map is adopted to select the optimal CRLS predictor for each pixel. In addition, a double snake scan mode is used to further improve the similarity of prediction context, and a recursive average estimation method is used to accelerate the local average calculation. Finally, the prediction residuals are entropy encoded by arithmetic encoder. Experiments on the Airborne Visible Infrared Imaging Spectrometer (AVIRIS) 2006 data set show that the CRLS-ABS-APS achieves average bit rates of 3.28 bpp, 5.55 bpp and 2.39 bpp on the three subsets, respectively. The results indicate that the CRLS-ABS-APS effectively improves the compression effect with lower computation complexity, and outperforms to the current state-of-the-art methods.

Development of PDA-Based Software for Forest Geographic Information (PDA기반의 산림지리정보 소프트웨어 개발에 관한 연구)

  • Suk, Sooil;Lee, Heonho;Lee, Dohyung
    • Journal of Korean Society of Forest Science
    • /
    • v.96 no.1
    • /
    • pp.7-13
    • /
    • 2007
  • This study was done to develop PDA based application system for forest geographic information with GPS. The major results obtained in this study were as follows. A PDA based application program was developed to work on $Microsoft^{TM}$ PocketPC 2002 and 2003 operating system. The screen of PDA displays a 1:25,000 digital topographical map adopted DXF format converted from PC, and the map data with 1:2,500 to 1:30,000 on PDA can be zoomed in or out to five levels. Current position and navigating path received from GPS can be displayed on the screen and be saved in PDA. Information selected among layers of digital topographic map in DXF format can be converted into binary files which can be used on forest geographic information software. This can compress DXF files to 90% in size, and the processing speed of PDA was improved. The forest geographic information management system can be used to manage sample plots on which forest inventory is done, with the help of the sub-menus and grid index values with position information received from GPS. Forest workers can in quire forest geographic information such as forest type, location, forest roads, soil erosion control dams using forest geographic information management system in the field. The forest geographic information management system can provide current position and mobile path information to people who enjoy forest related activities like mountain-climbing, sightseeing, and visiting to historic spots.

DESIGNING EXPERIENCE OF AUTOMOTIVE TURBOCHARGER IMPELLER FOR FLANK MILLING (Flank Milling 공법적용을 위한 자동차용 터보차져 임펠러의 설계체험)

  • Bang, J.C.;Shuripa, V.A.
    • Journal of computational fluids engineering
    • /
    • v.18 no.4
    • /
    • pp.1-8
    • /
    • 2013
  • The performance of small-size impellers with ruled surfaces was investigated for flank milling over a wide speed range, using computational fluid dynamics analyses and gas bench tests. An impeller with a ruled surface was designed, manufactured, and tested to evaluate the effects of blade loading, the backsweep angle, and the relative velocity distribution on the compressor performance. The simulations and tests were completed using the same compressor cover with identical inlet and outlet channels to accurately compare the performance of the abovementioned impeller with a commercial impeller containing sculptured blades. Both impellers have the same number of blades, number of splitters, and shroud meridional profiles. The backsweep angles of the blades on the ruled impeller were selected to work with the same pinched diffuser as for a sculptured impeller. The inlet-to-exit relative velocity diffusion ratio and the blade loading were provided to maximize the flow rate and to minimize the surge flow rate. The design flow rate, rpm, were selected same for both impellers. Test results showed that for the compressor stage with a ruled impeller, the efficiency was increased by 0.32% with an extended surge margin without a reduction in the pressure ratio as compared to the impeller with the sculptured design. It was concluded that an increased relative velocity diffusion coupled with a large backsweep angle was an effective way to improve the compressor stage efficiency. Additionally, an appropriate blade loading distribution was important for achieving a wide operating range and higher efficiency.

Extraction of Water Depth in Coastal Area Using EO-1 Hyperion Imagery (EO-1 Hyperion 영상을 이용한 연안해역의 수심 추출)

  • Seo, Dong-Ju;Kim, Jin-Soo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.12 no.4
    • /
    • pp.716-723
    • /
    • 2008
  • With rapid development of science and technology and recent widening of mankind's range of activities, development of coastal waters and the environment have emerged as global issues. In relation to this, to allow more extensive analyses, the use of satellite images has been on the increase. This study aims at utilizing hyperspectral satellite images in determining the depth of coastal waters more efficiently. For this purpose, a partial image of the research subject was first extracted from an EO-1 Hyperion satellite image, and atmospheric and geometric corrections were made. Minimum noise fraction (MNF) transformation was then performed to compress the bands, and the band most suitable for analyzing the characteristics of the water body was selected. Within the chosen band, the diffuse attenuation coefficient Kd was determined. By deciding the end-member of pixels with pure spectral properties and conducting mapping based on the linear spectral unmixing method, the depth of water at the coastal area in question was ultimately determined. The research findings showed the calculated depth of water differed by an average of 1.2 m from that given on the digital sea map; the errors grew larger when the water to be measured was deeper. If accuracy in atmospheric correction, end-member determination, and Kd calculation is enhanced in the future, it will likely be possible to determine water depths more economically and efficiently.