• Title/Summary/Keyword: big data system

Search Result 2,027, Processing Time 0.027 seconds

Hadoop System Design for Big data Processing of RFID Distribution (RFID/NFC 물류의 빅 데이터 처리를 위한 하둡 시스템의 설계)

  • Kim, Nam-Ho;Noh, Jin-Heon;Jeong, Hee-Ja
    • Smart Media Journal
    • /
    • v.2 no.3
    • /
    • pp.47-53
    • /
    • 2013
  • Recently convergence of IT in logistics system as a typical application RFID/NFC technology is being used, such as, according to the distribution of the flow is generated by a lot of big data. The Hadoop distributed system to collect data items produced by the parallel processing capabilities of logistics information and logistics information for the record management can create. Hadoop system to support the design and development of prototypes were approaching the possibility of its utilization.

  • PDF

Design and Implementation of a Survey System for Expanding Big Data-Based Commercial District Service (빅 데이터 기반의 상권 서비스 확장을 위한 설문조사시스템 설계 및 구현)

  • Lee, Won-Cheol;Kang, Man-Su;Kim, Jinho
    • The Journal of Bigdata
    • /
    • v.5 no.2
    • /
    • pp.171-186
    • /
    • 2020
  • The proportion of micro-enterprises and self-employed in Korea is excessively high compared to that of major developed countries, and frequent start-ups and business closures are repeated, causing enormous damage to the national economy. In order to solve this problem, various studies are underway for micro-enterprises, and the government provides commercial district information analysis services using big data for micro-enterprises. Among the commercial district information analysis services, the commercial district information analysis of our village store operated by the Seoul Metropolitan Government is continuously improving its service to provide the big data analysis service related to micro-enterprises. Since the service was built by integrating big data provided by various organizations, however, there are limitations in data reliability, data analysis, and service composition. In order to overcome these limitations, this paper proposes a location-based survey system that can be analyzed in conjunction with big data-based commercial district services. The proposed questionnaire survey system established the basis for expending the big data commercial district analysis service by linking the survey information and commercial district information.

A Study on the Crime Prevention Smart System Based on Big Data Processing (빅데이터 처리 기반의 범죄 예방 스마트 시스템에 관한 연구)

  • Kim, Won
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.11
    • /
    • pp.75-80
    • /
    • 2020
  • Since the Fourth Industrial Revolution, important technologies such as big data analysis, robotics, Internet of Things, and the artificial intelligence have been used in various fields. Generally speaking it is understood that the big-data technology consists of gathering stage for enormous data, analyzing and processing stage and distributing stage. Until now crime records which is one of useful big-sized data are utilized to obtain investigation information after occurring crimes. If crime records are utilized to predict crimes it is believed that crime occurring frequency can be lowered by processing big-sized crime records in big-data framework. In this research the design is proposed that the smart system can provide the users of smart devices crime occurrence probability by processing crime records in big-data analysis. Specifically it is meant that the proposed system will guide safer routes by displaying crime occurrence probabilities on the digital map in a smart device. In the experiment result for a smart application dealing with small local area it is showed that its usefulness is quite good in crime prevention.

Design and Implementation of a Realtime Public Transport Route Guidance System using Big Data Analysis (빅데이터 분석 기법을 이용한 실시간 대중교통 경로 안내 시스템의 설계 및 구현)

  • Lim, Jongtae;Bok, Kyoungsoo;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.2
    • /
    • pp.460-468
    • /
    • 2019
  • Recently, analysis techniques to extract new meanings using big data analysis and various services using these analysis techniques have been developed. Among them, the transport is one of the most important areas that can be utilized about big data. However, the existing traffic route guidance system can not recommend the optimal traffic route because they use only the traffic information when the user search the route. In this paper, we propose a realtime optimal traffic route guidance system using big data analysis. The proposed system considers the realtime traffic information and results of big data analysis using historical traffic data. And, the proposed system show the warning message to the user when the user need to change the traffic route.

Offline-to-Online Service and Big Data Analysis for End-to-end Freight Management System

  • Selvaraj, Suganya;Kim, Hanjun;Choi, Eunmi
    • Journal of Information Processing Systems
    • /
    • v.16 no.2
    • /
    • pp.377-393
    • /
    • 2020
  • Freight management systems require a new business model for rapid decision making to improve their business processes by dynamically analyzing the previous experience data. Moreover, the amount of data generated by daily business activities to be analyzed for making better decisions is enormous. Online-to-offline or offline-to-online (O2O) is an electronic commerce (e-commerce) model used to combine the online and physical services. Data analysis is usually performed offline. In the present paper, to extend its benefits to online and to efficiently apply the big data analysis to the freight management system, we suggested a system architecture based on O2O services. We analyzed and extracted the useful knowledge from the real-time freight data for the period 2014-2017 aiming at further business development. The proposed system was deemed useful for truck management companies as it allowed dynamically obtaining the big data analysis results based on O2O services, which were used to optimize logistic freight, improve customer services, predict customer expectation, reduce costs and overhead by improving profit margins, and perform load balancing.

A Study on an Integrative Model for Big Data System Adoption : Based on TOE, DOI and UTAUT (빅데이터 시스템 도입을 위한 통합모형의 연구 : TOE, DOI, UTAUT를 기반으로)

  • Lee, Sunwoo;Lee, Heesang
    • Journal of Information Technology Applications and Management
    • /
    • v.21 no.4_spc
    • /
    • pp.463-483
    • /
    • 2014
  • Data are dramatically increased and big data technology is spotlighted innovative technology among the latest information technologies. Organizations are interested in adoption of big data system to analyze various data format and to identify new business opportunity. The purpose of this study is to build a unified model for a system adoption through analysis of impact that affects behavioral intention and usage behavior of using big data. This study in addition to Technology-Organization-Environment (TOE), that is used the introduction of organizational studies, and Diffusion of Innovation (DOI) have implemented an extended unified model including the unified theory of acceptance and use of technology (UTAUT) that is usually used in personal level adoption study. The hypothesis was set up after implementing research model, and then got 411 effective survey data to target the member of organizations. As a result, all models (UTAUT, TOE, DOI) are affect to behavioral intention and usage behavior. It is verified that the suggested unified model was appropriate.

Study on Big Data Linkage Method for Managing Port Infrastructure Disasters and Aging (항만 인프라 재해 및 노후화 관리를 위한 빅데이터 연계 방안 연구)

  • Choi, Woo-geun;Park, Sun-ho
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.134-137
    • /
    • 2021
  • This study aims to develop a digital twin and big data-based port infrastructure control system that reflects smart maintenance technology. It is a technology that can evaluate aging and disaster risk by converting heterogeneous data such as sensing data and image data acquired from port infrastructure into big data, visualized in a digital twin-based control system, and comprehensively analyzed. The meaning of big data to express the physical world and processes by combining data, which are the core components of the virtual world, and the matters to be reflected in each stage of securing, processing, storing, analyzing and utilizing necessary big data, and we would like to define methods for linking with IT resources.

  • PDF

An Efficient Information Retrieval System for Unstructured Data Using Inverted Index

  • Abdullah Iftikhar;Muhammad Irfan Khan;Kulsoom Iftikhar
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.7
    • /
    • pp.31-44
    • /
    • 2024
  • The inverted index is combination of the keywords and posting lists associated for indexing of document. In modern age excessive use of technology has increased data volume at a very high rate. Big data is great concern of researchers. An efficient Document indexing in big data has become a major challenge for researchers. All organizations and web engines have limited number of resources such as space and storage which is very crucial in term of data management of information retrieval system. Information retrieval system need to very efficient. Inverted indexing technique is introduced in this research to minimize the delay in retrieval of data in information retrieval system. Inverted index is illustrated and then its issues are discussed and resolve by implementing the scalable inverted index. Then existing algorithm of inverted compared with the naïve inverted index. The Interval list of inverted indexes stores on primary storage except of auxiliary memory. In this research an efficient architecture of information retrieval system is proposed particularly for unstructured data which don't have a predefined structure format and data volume.

A Study on Possible Construction of Big Data Analysis System Applied to the Offline Market (오프라인 마켓에 적용 가능한 빅데이터 분석 시스템 구축 방안에 관한 연구)

  • Lee, Hoo-Young;Park, Koo-Rack;Kim, Dong-Hyun
    • Journal of Digital Convergence
    • /
    • v.14 no.9
    • /
    • pp.317-323
    • /
    • 2016
  • Big Data is now seen as a major asset in the company's competitiveness, its influence in the future is expected to grow. Companies that recognize the importance are already actively engaged with Big Data in product development and marketing, which are increasingly applied across sectors of society, including politics, sports. However, lack of knowledge of the system implementation and high costs are still a big obstacles to the introduction of Big Data and systems. It is an objective in this study to build a Big Data system, which is based on open source Hadoop and Hive among Big Data systems, utilizing POS sales data of small and medium-sized offline markets. This approach of convergence is expected to improve existing sales systems that have been simply focusing on profit and loss analysis. It will also be able to use it as the basis for the decisions of the executive to enable prediction of the consumption patterns of customer preference and demand in advance.

Design of Distributed Cloud System for Managing large-scale Genomic Data

  • Seine Jang;Seok-Jae Moon
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.2
    • /
    • pp.119-126
    • /
    • 2024
  • The volume of genomic data is constantly increasing in various modern industries and research fields. This growth presents new challenges and opportunities in terms of the quantity and diversity of genetic data. In this paper, we propose a distributed cloud system for integrating and managing large-scale gene databases. By introducing a distributed data storage and processing system based on the Hadoop Distributed File System (HDFS), various formats and sizes of genomic data can be efficiently integrated. Furthermore, by leveraging Spark on YARN, efficient management of distributed cloud computing tasks and optimal resource allocation are achieved. This establishes a foundation for the rapid processing and analysis of large-scale genomic data. Additionally, by utilizing BigQuery ML, machine learning models are developed to support genetic search and prediction, enabling researchers to more effectively utilize data. It is expected that this will contribute to driving innovative advancements in genetic research and applications.