• Title/Summary/Keyword: hierarchical file system

Search Result 29, Processing Time 0.026 seconds

Development of Retargetable Hadoop Simulation Environment Based on DEVS Formalism (DEVS 형식론 기반의 재겨냥성 하둡 시뮬레이션 환경 개발)

  • Kim, Byeong Soo;Kang, Bong Gu;Kim, Tag Gon;Song, Hae Sang
    • Journal of the Korea Society for Simulation
    • /
    • v.26 no.4
    • /
    • pp.51-61
    • /
    • 2017
  • Hadoop platform is a representative storing and managing platform for big data. Hadoop consists of distributed computing system called MapReduce and distributed file system called HDFS. It is important to analyse the effectiveness according to the change of cluster constructions and several parameters. However, since it is hard to construct thousands of clusters and analyse the constructed system, simulation method is required to analyse the system. This paper proposes Hadoop simulator based on DEVS formalism which provides hierarchical and modular modeling. Hadoop simulator provides a retargetable experimental environment that is possible to change of various parameters, algorithms and models. It is also possible to design input models reflecting the characteristics of Hadoop applications. To maximize the user's convenience, the user interface, real-time model viewer, and input scenario editor are also provided. In this paper, we validate Hadoop Simulator through the comparison with the Hadoop execution results and perform various experiments.

Applicability of Geo-spatial Processing Open Sources to Geographic Object-based Image Analysis (GEOBIA)

  • Lee, Ki-Won;Kang, Sang-Goo
    • Korean Journal of Remote Sensing
    • /
    • v.27 no.3
    • /
    • pp.379-388
    • /
    • 2011
  • At present, GEOBIA (Geographic Object-based Image Analysis), heir of OBIA (Object-based Image Analysis), is regarded as an important methodology by object-oriented paradigm for remote sensing, dealing with geo-objects related to image segmentation and classification in the different view point of pixel-based processing. This also helps to directly link to GIS applications. Thus, GEOBIA software is on the booming. The main theme of this study is to look into the applicability of geo-spatial processing open source to GEOBIA. However, there is no few fully featured open source for GEOBIA which needs complicated schemes and algorithms, till It was carried out to implement a preliminary system for GEOBIA running an integrated and user-oriented environment. This work was performed by using various open sources such as OTB or PostgreSQL/PostGIS. Some points are different from the widely-used proprietary GEOBIA software. In this system, geo-objects are not file-based ones, but tightly linked with GIS layers in spatial database management system. The mean shift algorithm with parameters associated with spatial similarities or homogeneities is used for image segmentation. For classification process in this work, tree-based model of hierarchical network composing parent and child nodes is implemented by attribute join in the semi-automatic mode, unlike traditional image-based classification. Of course, this integrated GEOBIA system is on the progressing stage, and further works are necessary. It is expected that this approach helps to develop and to extend new applications such as urban mapping or change detection linked to GIS data sets using GEOBIA.

The Development of Image Processing System for Medical Robot Remote Application (의료용 로봇 원격 응용을 위한 영상처리 시스템 개발)

  • Kim, Joo Young;Kim, Joong Hyuk;Kim, Jung Chae;Kim, Kee Deog;Yoo, Sun K.
    • Progress in Medical Physics
    • /
    • v.23 no.4
    • /
    • pp.239-251
    • /
    • 2012
  • In this paper, web-base image processing system has been implemented for remote-controlled medical robot applications. The developed software system was hierarchically composed of diverse image processing and remote operation modules, and the hierarchical composition was satisfied the expandability to higher level application and the accessibility over the web. It can also support diverse file formats including DICOM, VRML, and CAD(STL) to display, transmit, store and share the processed images depending on application environment. Message-based data exchange, object-oriented module and open-source based software configuration will enable the dynamic combination associated with diverse remote medical application requirements.

A Hierarchical User Interface for Large 3D Meshes in Mobile Systems (모바일 시스템의 대용량 3차원 메쉬를 위한 계층적 사용자 인터페이스)

  • Park, Jiro;Lee, Haeyoung
    • Journal of the Korea Computer Graphics Society
    • /
    • v.19 no.1
    • /
    • pp.11-20
    • /
    • 2013
  • This paper introduces a user interface for large 3D meshes in mobile systems, which have limited memory, screen size and battery power. A large 3D mesh is divided into partitions and simplified in multi-resolutions so a large file is transformed into a number of small data files and saved in a PC server. Only selected small files specified by the user are hierarchically transmitted to the mobile system for 3D browsing and rendering. A 3D preview in a pop-up shows a simplified mesh in the lowest resolution. The next step displays simplified meshes whose resolutions are automatically controlled by the user interactions. The last step is to render a set of detailed original partitions in a selected range. As a result, while minimizing using mobile system resources, our interface enables us to browse and display 3D meshes in mobile systems through real-time interactions. A mobile 3D viewer and a 3D app are also presented to show the utility of the proposed user interface.

PIRS : Personalized Information Retrieval System using Adaptive User Profiling and Real-time Filtering for Search Results (적응형 사용자 프로파일기법과 검색 결과에 대한 실시간 필터링을 이용한 개인화 정보검색 시스템)

  • Jeon, Ho-Cheol;Choi, Joong-Min
    • Journal of Intelligence and Information Systems
    • /
    • v.16 no.4
    • /
    • pp.21-41
    • /
    • 2010
  • This paper proposes a system that can serve users with appropriate search results through real time filtering, and implemented adaptive user profiling based personalized information retrieval system(PIRS) using users' implicit feedbacks in order to deal with the problem of existing search systems such as Google or MSN that does not satisfy various user' personal search needs. One of the reasons that existing search systems hard to satisfy various user' personal needs is that it is not easy to recognize users' search intentions because of the uncertainty of search intentions. The uncertainty of search intentions means that users may want to different search results using the same query. For example, when a user inputs "java" query, the user may want to be retrieved "java" results as a computer programming language, a coffee of java, or a island of Indonesia. In other words, this uncertainty is due to ambiguity of search queries. Moreover, if the number of the used words for a query is fewer, this uncertainty will be more increased. Real-time filtering for search results returns only those results that belong to user-selected domain for a given query. Although it looks similar to a general directory search, it is different in that the search is executed for all web documents rather than sites, and each document in the search results is classified into the given domain in real time. By applying information filtering using real time directory classifying technology for search results to personalization, the number of delivering results to users is effectively decreased, and the satisfaction for the results is improved. In this paper, a user preference profile has a hierarchical structure, and consists of domains, used queries, and selected documents. Because the hierarchy structure of user preference profile can apply the context when users perfomed search, the structure is able to deal with the uncertainty of user intentions, when search is carried out, the intention may differ according to the context such as time or place for the same query. Furthermore, this structure is able to more effectively track web documents search behaviors of a user for each domain, and timely recognize the changes of user intentions. An IP address of each device was used to identify each user, and the user preference profile is continuously updated based on the observed user behaviors for search results. Also, we measured user satisfaction for search results by observing the user behaviors for the selected search result. Our proposed system automatically recognizes user preferences by using implicit feedbacks from users such as staying time on the selected search result and the exit condition from the page, and dynamically updates their preferences. Whenever search is performed by a user, our system finds the user preference profile for the given IP address, and if the file is not exist then a new user preference profile is created in the server, otherwise the file is updated with the transmitted information. If the file is not exist in the server, the system provides Google' results to users, and the reflection value is increased/decreased whenever user search. We carried out some experiments to evaluate the performance of adaptive user preference profile technique and real time filtering, and the results are satisfactory. According to our experimental results, participants are satisfied with average 4.7 documents in the top 10 search list by using adaptive user preference profile technique with real time filtering, and this result shows that our method outperforms Google's by 23.2%.

Comparison of the wall clock time for extracting remote sensing data in Hierarchical Data Format using Geospatial Data Abstraction Library by operating system and compiler (운영 체제와 컴파일러에 따른 Geospatial Data Abstraction Library의 Hierarchical Data Format 형식 원격 탐사 자료 추출 속도 비교)

  • Yoo, Byoung Hyun;Kim, Kwang Soo;Lee, Jihye
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.21 no.1
    • /
    • pp.65-73
    • /
    • 2019
  • The MODIS (Moderate Resolution Imaging Spectroradiometer) data in Hierarchical Data Format (HDF) have been processed using the Geospatial Data Abstraction Library (GDAL). Because of a relatively large data size, it would be preferable to build and install the data analysis tool with greater computing performance, which would differ by operating system and the form of distribution, e.g., source code or binary package. The objective of this study was to examine the performance of the GDAL for processing the HDF files, which would guide construction of a computer system for remote sensing data analysis. The differences in execution time were compared between environments under which the GDAL was installed. The wall clock time was measured after extracting data for each variable in the MODIS data file using a tool built lining against GDAL under a combination of operating systems (Ubuntu and openSUSE), compilers (GNU and Intel), and distribution forms. The MOD07 product, which contains atmosphere data, were processed for eight 2-D variables and two 3-D variables. The GDAL compiled with Intel compiler under Ubuntu had the shortest computation time. For openSUSE, the GDAL compiled using GNU and intel compilers had greater performance for 2-D and 3-D variables, respectively. It was found that the wall clock time was considerably long for the GDAL complied with "--with-hdf4=no" configuration option or RPM package manager under openSUSE. These results indicated that the choice of the environments under which the GDAL is installed, e.g., operation system or compiler, would have a considerable impact on the performance of a system for processing remote sensing data. Application of parallel computing approaches would improve the performance of the data processing for the HDF files, which merits further evaluation of these computational methods.

A Study on the Musical Theme Clustering for Searching Note Sequences (음렬 탐색을 위한 주제소절 자동분류에 관한 연구)

  • 심지영;김태수
    • Journal of the Korean Society for information Management
    • /
    • v.19 no.3
    • /
    • pp.5-30
    • /
    • 2002
  • In this paper, classification feature is selected with focus of musical content, note sequences pattern, and measures similarity between note sequences followed by constructing clusters by similar note sequences, which is easier for users to search by showing the similar note sequences with the search result in the CBMR system. Experimental document was $\ulcorner$A Dictionary of Musical Themes$\lrcorner$, the index of theme bar focused on classical music and obtained kern-type file. Humdrum Toolkit version 1.0 was used as note sequences treat tool. The hierarchical clustering method is by stages focused on four-type similarity matrices by whether the note sequences segmentation or not and where the starting point is. For the measurement of the result, WACS standard is used in the case of being manual classification and in the case of the note sequences starling from any point in the note sequences, there is used common feature pattern distribution in the cluster obtained from the clustering result. According to the result, clustering with segmented feature unconnected with the starting point Is higher with distinct difference compared with clustering with non-segmented feature.

Methodology of Fire Safety IFC Schema Extension through Architectural WBS Hierarchy Analysis (건축 WBS 위계 분석을 통한 소방 IFC 스키마 확장 방법론에 관한 연구)

  • Kim, Tae-Hoon;Won, Jung-Hye;Hong, Soon-Min;Choo, Seung-Yeon
    • Journal of KIBIM
    • /
    • v.12 no.4
    • /
    • pp.70-79
    • /
    • 2022
  • As BIM(Building Information Modeling) technology advances in architecture around the world, projects and industries using BIM are increasing. Unlike previous developments that were limited to buildings, BIM is now spreading to other fields such as civil engineering and electricity. In architecture, BIM is used in the entire process from design to maintenance of a building, and IFC(Industry Foundation Classes), a neutral format with interoperability, is used as an open BIM format. Since firefighting requires intuitive 3D models for evacuation and fire simulations, BIM models are desirable. However, due to the BIM model, which was developed centered on building objects, there are no objects and specific properties for fire evacuation in the IFC scheme. Therefore, in this study, when adding a new object in the firefighting area to the IFC schema, the IFC interoperability is not broken and the building WBS(Work Breakdown Structure) is analyzed with a hierarchical system similar to the IFC format to define the scope for a new object and the firefighting part within of the building WBS to derive a firefighting HBS(Hierarchy Breakdown Structure) with the extension of the object-oriented IFC file. And according to HBS, we propose an IFC schema extension method. It is a methodology that allows BIM users to instantly adapt the IFC schema to their needs. Accordingly, the methodology derived from this study is expected to be expanded in various areas to minimize information loss from IFC. In the future, we will apply the IFC extension methodology to the actual development process using HBS to verify that it is actually applicable within the IFC schema.

The Current Status of Arrangement and the Direction of Rearrangement of the Archives Relating to the Korean Provisional Assembly (임시의정원 관련 기록물의 정리 현황과 재정리 방향)

  • Park, Dowon
    • The Korean Journal of Archival Studies
    • /
    • no.73
    • /
    • pp.161-188
    • /
    • 2022
  • This article explores the current status of arrangement of the archives relating to the Korean Provisional Assembly held by the National Assembly Library and suggests the direction of rearrangement focusing on the principles of arrangement. The Korean Provisional Assembly had records management regulations, and records were produced and stored according to them. However, the archives lost their original order at some point. The National Assembly Library collected and managed them in the 1960s. The National Assembly Library did not fully consider the records management system at the time of record production and various situations that may occur during the storage process while organizing the collected archives. At that time, the National Assembly Library did not follow the records management regulations of the Korean Provisional Assembly. In addition, the hierarchical structure of archives was not applied during the arrangement, and the National Assembly Library arranged without considering the Principal of Provenance and the Principle of original order. As a result, it became difficult to understand the structure and context of the archives. In order to solve these problems and come up with a plan for rearranging the archives, first of all, it is necessary to examine the characteristics of the records related to the Korean Provisional Assembly in accordance with the principles of record arrangement. First, according to the Principal of Provenance, it is necessary to identify the organization, function, and records and classify the records item, records file, creators, dates of creation, types of records etc. Second, by applying the Principle of original order, it is necessary to understand what the order of records was at the time when records were created and preserved. Third, it is necessary to examine whether the records are completely created and valid. It is impossible to completely arrange the archives related to the Korean Provisional Assembly as it was in the past. However, by examining the current state of arrangement and the direction of rearrangement, it will be possible to newly understand the contents, structure, and context of the archives and create a basis for effective reference service.