• Title/Summary/Keyword: Big data analysis method

Search Result 869, Processing Time 0.029 seconds

Big Data Analysis of Weather Condition and Air Quality on Cosmetics Marketing

  • Wang, Zebin;Wu, Tong;Zhao, Xinshuang;Cheng, Shuchun;Dai, Genghui;Dai, Weihui
    • Journal of Information Technology Applications and Management
    • /
    • v.24 no.3
    • /
    • pp.93-105
    • /
    • 2017
  • Demands of cosmetics are affected not only by the well-known elements such as brand, price, and customer's consumption capacity, but also by some latent factors, for example, weather and air environment. Due to complexity and dynamic changes of the above factors, their influences can hardly be estimated in an accurate way by the traditional approaches such as survey and questionnaires. Through modeling and statistical analysis of big data, this article studied the impacts of weather condition and air quality on customer flow and sales of the cosmetics distributors in China, and found several hidden influencing factors. It provided a big-data based method for the analysis of unconventional factors on cosmetics marketing in the changing weather condition and air environment.

The big data analysis framework of information security policy based on security incidents

  • Jeong, Seong Hoon;Kim, Huy Kang;Woo, Jiyoung
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.10
    • /
    • pp.73-81
    • /
    • 2017
  • In this paper, we propose an analysis framework to capture the trends of information security incidents and evaluate the security policy based on the incident analysis. We build a big data from news media collecting security incidents news and policy news, identify key trends in information security from this, and present an analytical method for evaluating policies from the point of view of incidents. In more specific, we propose a network-based analysis model that allows us to easily identify the trends of information security incidents and policy at a glance, and a cosine similarity measure to find important events from incidents and policy announcements.

An Extraction Method of Sentiment Infromation from Unstructed Big Data on SNS (SNS상의 비정형 빅데이터로부터 감성정보 추출 기법)

  • Back, Bong-Hyun;Ha, Ilkyu;Ahn, ByoungChul
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.6
    • /
    • pp.671-680
    • /
    • 2014
  • Recently, with the remarkable increase of social network services, it is necessary to extract interesting information from lots of data about various individual opinions and preferences on SNS(Social Network Service). The sentiment information can be applied to various fields of society such as politics, public opinions, economics, personal services and entertainments. To extract sentiment information, it is necessary to use processing techniques that store a large amount of SNS data, extract meaningful data from them, and search the sentiment information. This paper proposes an efficient method to extract sentiment information from various unstructured big data on social networks using HDFS(Hadoop Distributed File System) platform and MapReduce functions. In experiments, the proposed method collects and stacks data steadily as the number of data is increased. When the proposed functions are applied to sentiment analysis, the system keeps load balancing and the analysis results are very close to the results of manual work.

Big Data Analysis and Prediction of Traffic in Los Angeles

  • Dauletbak, Dalyapraz;Woo, Jongwook
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.2
    • /
    • pp.841-854
    • /
    • 2020
  • The paper explains the method to process, analyze and predict traffic patterns in Los Angeles county using Big Data and Machine Learning. The dataset is used from a popular navigating platform in the USA, which tracks information on the road using connected users' devices and also collects reports shared by the users through the app. The dataset mainly consists of information about traffic jams and traffic incidents reported by users, such as road closure, hazards, accidents. The major contribution of this paper is to give a clear view of how the large-scale road traffic data can be stored and processed using the Big Data system - Hadoop and its ecosystem (Hive). In addition, analysis is explained with the help of visuals using Business Intelligence and prediction with classification machine learning model on the sampled traffic data is presented using Azure ML. The process of modeling, as well as results, are interpreted using metrics: accuracy, precision and recall.

Methodology of Local Government Policy Issues Through Big Data Analysis (빅데이터 분석을 통한 지방자치단체 정책이슈 도출 방법론)

  • Kim, Yong-Jin;Kim, Do-Young
    • The Journal of the Korea Contents Association
    • /
    • v.18 no.10
    • /
    • pp.229-235
    • /
    • 2018
  • The purpose of this study is to propose a method to utilize Big Data Analysis to find policy issues of local governments in the reality that utilization of big data becomes increasingly important in efficient and effective policy making process. For this purpose, this study analyzed the 180,000 articles of Suwon city for the past three years and identified policy issues and evaluated policy priorities through IPA analysis. The results of this study showed that the analysis of semi-formal big data through newspaper articles is effective in deriving the differentiated policy issues of different local autonomous bodies from the main issues in the nation, In this way, the methodology of finding policy issues through the analysis of big data suggested in this study means that local governments can effectively identify policy issues and effectively identify the people. In addition, the methodology proposed in this study is expected to be applicable to the policy issues through the analysis of various semi - formal and informal big data such as online civil complaint data of the local government, resident SNS.

The Method for Analyzing Potentially Collapsible Aged Buildings Using Big Data and its Application to Seoul (빅데이터 기반의 잠재적 붕괴위험 노후건축물 도출 방법 및 서울특별시 적용 연구)

  • Lim, Hae-Yeon;Park, Cheol-Yeong;Cho, Sung-Hyeon;Lee, Ghang
    • Journal of the Architectural Institute of Korea Planning & Design
    • /
    • v.35 no.2
    • /
    • pp.139-146
    • /
    • 2019
  • The purpose of this study is to derive an improved method for analyzing old buildings with risk of collapse using public big data. Previous studies on the risk of building collapse focused on internal factors such as building age and structural vulnerability. However, this study suggests a method to derive potentially collapsible buildings considering not only internal factors of buildings but also external factors such as nearby new construction data. Based on the big data analysis, this study develops a system to visualize vulnerable buildings that require safety diagnosis and proposed a future utilization plan.

A Study on the Semantic Network Analysis of "Cooking Academy" through the Big Data (빅데이터를 활용한 "조리학원"의 의미연결망 분석에 관한 연구)

  • Lee, Seung-Hoo;Kim, Hak-Seon
    • Culinary science and hospitality research
    • /
    • v.24 no.3
    • /
    • pp.167-176
    • /
    • 2018
  • In this study, Big Data was used to collect the information related to 'Cooking Academy' keywords. After collecting all the data, we calculated the frequency through the text mining and selected the main words for future data analysis. Data collection was conducted from Google Web and News during the period from January 1, 2013 to December 31, 2017. The selected 64 words were analyzed by using UCINET 6.0 program, and the analysis results were visualized with NetDraw in order to present the relationship of main words. As a result, it was found that the most important goal for the students from cooking school is to work as a cook, likewise to have practical classes. In addition, we obtained the result that SNS marketing system that the social sites, such as Facebook, Twitter, and Instagram are actively utilized as a marketing strategy of the institute. Therefore, the results can be helpful in searching for the method of utilizing big data and can bring brand-new ideas for the follow-up studies. In practical terms, it will be remarkable material about the future marketing directions and various programs that are improved by the detailed curriculums through semantic network of cooking school by using big data.

Conparison of Data Collection Methods for Big Data Analysis (빅데이터 분석을 위한 자료 수집 방안 비교)

  • Kim, Sung-kook;Oh, Chang-heon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.10a
    • /
    • pp.422-424
    • /
    • 2018
  • Recently there has been growing interest in big data analysis and methods for collecting data have been developed diversely but researchers are still not easy to collect and use these large scale data. In this paper, researchers try to compare and analyze the method of collecting big data by using several methods and present it. I hope that you can provide the results of your research if you select and use methods that match your research objectives.

  • PDF

A Method for Compound Noun Extraction to Improve Accuracy of Keyword Analysis of Social Big Data

  • Kim, Hyeon Gyu
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.8
    • /
    • pp.55-63
    • /
    • 2021
  • Since social big data often includes new words or proper nouns, statistical morphological analysis methods have been widely used to process them properly which are based on the frequency of occurrence of each word. However, these methods do not properly recognize compound nouns, and thus have a problem in that the accuracy of keyword extraction is lowered. This paper presents a method to extract compound nouns in keyword analysis of social big data. The proposed method creates a candidate group of compound nouns by combining the words obtained through the morphological analysis step, and extracts compound nouns by examining their frequency of appearance in a given review. Two algorithms have been proposed according to the method of constructing the candidate group, and the performance of each algorithm is expressed and compared with formulas. The comparison result is verified through experiments on real data collected online, where the results also show that the proposed method is suitable for real-time processing.

Social Big Data Analysis for Franchise Stores

  • Kim, Hyeon Gyu
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.8
    • /
    • pp.39-46
    • /
    • 2021
  • When conducting social big data analysis for franchise stores, reviews of multiple branches of a franchise can be collected together, from which analysis results can be distorted significantly. To improve its accuracy, it should be possible to filter reviews of other branches properly which are not subject to the analysis. This paper presents a method for social big data analysis which reflects characteristics of franchise stores. The proposed method consists of search key configuration and review filtering. For the former, the open data provided by Small Business Promotion Agency is used to extract region names for collecting reviews more accurately. For the latter, open search APIs provided by Naver or Kakao are used to obtain franchise branch information for filtering reviews of other branches that are not subject to analysis. To verify performance of the proposed method, experiments were conducted based on real social reviews collected from online, where the results showed that the accuracy of the proposed review filtering was 93.6% on the average.