• Title/Summary/Keyword: Stream processing

Search Result 720, Processing Time 0.029 seconds

Twitter Issue Tracking System by Topic Modeling Techniques (토픽 모델링을 이용한 트위터 이슈 트래킹 시스템)

  • Bae, Jung-Hwan;Han, Nam-Gi;Song, Min
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.2
    • /
    • pp.109-122
    • /
    • 2014
  • People are nowadays creating a tremendous amount of data on Social Network Service (SNS). In particular, the incorporation of SNS into mobile devices has resulted in massive amounts of data generation, thereby greatly influencing society. This is an unmatched phenomenon in history, and now we live in the Age of Big Data. SNS Data is defined as a condition of Big Data where the amount of data (volume), data input and output speeds (velocity), and the variety of data types (variety) are satisfied. If someone intends to discover the trend of an issue in SNS Big Data, this information can be used as a new important source for the creation of new values because this information covers the whole of society. In this study, a Twitter Issue Tracking System (TITS) is designed and established to meet the needs of analyzing SNS Big Data. TITS extracts issues from Twitter texts and visualizes them on the web. The proposed system provides the following four functions: (1) Provide the topic keyword set that corresponds to daily ranking; (2) Visualize the daily time series graph of a topic for the duration of a month; (3) Provide the importance of a topic through a treemap based on the score system and frequency; (4) Visualize the daily time-series graph of keywords by searching the keyword; The present study analyzes the Big Data generated by SNS in real time. SNS Big Data analysis requires various natural language processing techniques, including the removal of stop words, and noun extraction for processing various unrefined forms of unstructured data. In addition, such analysis requires the latest big data technology to process rapidly a large amount of real-time data, such as the Hadoop distributed system or NoSQL, which is an alternative to relational database. We built TITS based on Hadoop to optimize the processing of big data because Hadoop is designed to scale up from single node computing to thousands of machines. Furthermore, we use MongoDB, which is classified as a NoSQL database. In addition, MongoDB is an open source platform, document-oriented database that provides high performance, high availability, and automatic scaling. Unlike existing relational database, there are no schema or tables with MongoDB, and its most important goal is that of data accessibility and data processing performance. In the Age of Big Data, the visualization of Big Data is more attractive to the Big Data community because it helps analysts to examine such data easily and clearly. Therefore, TITS uses the d3.js library as a visualization tool. This library is designed for the purpose of creating Data Driven Documents that bind document object model (DOM) and any data; the interaction between data is easy and useful for managing real-time data stream with smooth animation. In addition, TITS uses a bootstrap made of pre-configured plug-in style sheets and JavaScript libraries to build a web system. The TITS Graphical User Interface (GUI) is designed using these libraries, and it is capable of detecting issues on Twitter in an easy and intuitive manner. The proposed work demonstrates the superiority of our issue detection techniques by matching detected issues with corresponding online news articles. The contributions of the present study are threefold. First, we suggest an alternative approach to real-time big data analysis, which has become an extremely important issue. Second, we apply a topic modeling technique that is used in various research areas, including Library and Information Science (LIS). Based on this, we can confirm the utility of storytelling and time series analysis. Third, we develop a web-based system, and make the system available for the real-time discovery of topics. The present study conducted experiments with nearly 150 million tweets in Korea during March 2013.

GIS based Development of Module and Algorithm for Automatic Catchment Delineation Using Korean Reach File (GIS 기반의 하천망분석도 집수구역 자동 분할을 위한 알고리듬 및 모듈 개발)

  • PARK, Yong-Gil;KIM, Kye-Hyun;YOO, Jae-Hyun
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.20 no.4
    • /
    • pp.126-138
    • /
    • 2017
  • Recently, the national interest in environment is increasing and for dealing with water environment-related issues swiftly and accurately, the demand to facilitate the analysis of water environment data using a GIS is growing. To meet such growing demands, a spatial network data-based stream network analysis map(Korean Reach File; KRF) supporting spatial analysis of water environment data was developed and is being provided. However, there is a difficulty in delineating catchment areas, which are the basis of supplying spatial data including relevant information frequently required by the users such as establishing remediation measures against water pollution accidents. Therefore, in this study, the development of a computer program was made. The development process included steps such as designing a delineation method, and developing an algorithm and modules. DEM(Digital Elevation Model) and FDR(Flow Direction) were used as the major data to automatically delineate catchment areas. The algorithm for the delineation of catchment areas was developed through three stages; catchment area grid extraction, boundary point extraction, and boundary line division. Also, an add-in catchment area delineation module, based on ArcGIS from ESRI, was developed in the consideration of productivity and utility of the program. Using the developed program, the catchment areas were delineated and they were compared to the catchment areas currently used by the government. The results showed that the catchment areas were delineated efficiently using the digital elevation data. Especially, in the regions with clear topographical slopes, they were delineated accurately and swiftly. Although in some regions with flat fields of paddles and downtowns or well-organized drainage facilities, the catchment areas were not segmented accurately, the program definitely reduce the processing time to delineate existing catchment areas. In the future, more efforts should be made to enhance current algorithm to facilitate the use of the higher precision of digital elevation data, and furthermore reducing the calculation time for processing large data volume.

A study of SCM strategic plan: Focusing on the case of LG electronics (공급사슬 관리 구축전략에 관한 연구: LG전자 사례 중심으로)

  • Lee, Gi-Wan;Lee, Sang-Youn
    • Journal of Distribution Science
    • /
    • v.9 no.3
    • /
    • pp.83-94
    • /
    • 2011
  • Most domestic companies, with the exclusion of major firms, are reluctant to implement a supply chain management (SCM) network into their operations. Most small- and medium-sized enterprises are not even aware of SCM. Due to the inherent total-systems efficiency of SCM, it coordinates domestic manufacturers, subcontractors, distributors, and physical distributors and cuts down on cost of inventory control, as well as demand management. Furthermore, a lack of SCM causes a decrease in competitiveness for domestic companies. The reason lies in the fundamentality of SCM, which is the characteristic of information sharing, process innovation throughout SCM, and the vast range of problems the SCM management tool is able to address. This study suggests the contemplation and reformation of the current SCM situation by analyzing the SCM strategic plan, discourses and logical discussions on the topic, and a successful case for adapting SCM; hence, the study plans to productively "process" SCM. First, it is necessary to contemplate the theoretical background of SCM before discussing how to successfully process SCM. I will describe the concept and background of SCM in Chapter 2, with a definition of SCM, types of SCM promotional activities, fields of SCM, necessity of applying SCM, and the effects of SCM. All of the defects in currently processing SCM will be introduced in Chapter 3. Discussion items include the following: the Bullwhip Effect; the breakdown in supply chain and sales networks due to e-business; the issue that even though the key to a successful SCM is cooperation between the production and distribution company, during the process of SCM, the companies, many times, put their profits first, resulting in a possible defect in demands estimation. Furthermore, the problems of processing SCM in a domestic distribution-production company concern Information Technology; for example, the new system introduced to the company is not compatible with the pre-existing document architecture. Second, for effective management, distribution and production companies should cooperate and enhance their partnership in the aspect of the corporation; however, in reality, this seldom occurs. Third, in the aspect of the work process, introducing SCM could provoke corporations during the integration of the distribution-production process. Fourth, to increase the achievement of the SCM strategy process, they need to set up a cross-functional team; however, many times, business partners lack the cooperation and business-information sharing tools necessary to effect the transition to SCM. Chapter 4 will address an SCM strategic plan and a case study of LG Electronics. The purpose of the strategic plan, strategic plans for types of business, adopting SCM in a distribution company, and the global supply chain process of LG Electronics will be introduced. The conclusion of the study is located in Chapter 5, which addresses the issue of the fierce competition that companies currently face in the global market environment and their increased investment in SCM, in order to better cope with short product life cycle and high customer expectations. The SCM management system has evolved through the adaptation of improved information, communication, and transportation technologies; now, it demands the utilization of various strategic resources. The introduction of SCM provides benefits to the management of a network of interconnected businesses by securing customer loyalty with cost and time savings, derived through the consolidation of many distribution systems; additionally, SCM helps enterprises form a wide range of marketing strategies. Thus, we could conclude that not only the distributors but all types of businesses should adopt the systems approach to supply chain strategies. SCM deals with the basic stream of distribution and increases the value of a company by replacing physical distribution with information. By the company obtaining and sharing ready information, it is able to create customer satisfaction at the end point of delivery to the consumer.

  • PDF

A Study on Analysis of consumer perception of YouTube advertising using text mining (텍스트 마이닝을 활용한 Youtube 광고에 대한 소비자 인식 분석)

  • Eum, Seong-Won
    • Management & Information Systems Review
    • /
    • v.39 no.2
    • /
    • pp.181-193
    • /
    • 2020
  • This study is a study that analyzes consumer perception by utilizing text mining, which is a recent issue. we analyzed the consumer's perception of Samsung Galaxy by analyzing consumer reviews of Samsung Galaxy YouTube ads. for analysis, 1,819 consumer reviews of YouTube ads were extracted. through this data pre-processing, keywords for advertisements were classified and extracted into nouns, adjectives, and adverbs. after that, frequency analysis and emotional analysis were performed. Finally, clustering was performed through CONCOR. the summary of this study is as follows. the first most frequently mentioned words were Galaxy Note (n = 217), Good (n = 135), Pen (n = 40), and Function (n = 29). it can be judged through the advertisement that consumers "Galaxy Note", "Good", "Pen", and "Features" have good functional aspects for Samsung mobile phone products and positively recognize the Note Pen. in addition, the recognition of "Samsung Pay", "Innovation", "Design", and "iPhone" shows that Samsung's mobile phone is highly regarded for its innovative design and functional aspects of Samsung Pay. second, it is the result of sentiment analysis on YouTube advertising. As a result of emotional analysis, the ratio of emotional intensity was positive (75.95%) and higher than negative (24.05%). this means that consumers are positively aware of Samsung Galaxy mobile phones. As a result of the emotional keyword analysis, positive keywords were "good", "good", "innovative", "highest", "fast", "pretty", etc., negative keywords were "frightening", "I want to cry", "discomfort", "sorry", "no", etc. were extracted. the implication of this study is that most of the studies by quantitative analysis methods were considered when looking at the consumer perception study of existing advertisements. In this study, we deviated from quantitative research methods for advertising and attempted to analyze consumer perception through qualitative research. this is expected to have a great influence on future research, and I am sure that it will be a starting point for consumer awareness research through qualitative research.

Characterization of the cloned RNA1 gene of Saccharomyces cerevisiae (Cloning된 효모의 RNAI 유전자의 특성에 관하여)

  • Song, Young-Hwan;Kim, Dae-Young;Kim, Jin-Kyung
    • Journal of fish pathology
    • /
    • v.6 no.2
    • /
    • pp.93-101
    • /
    • 1993
  • The RNAI mutation of Saccharomyces cerevisia is a recessive and temperature sensitive lethal mutation which interferes with the production of mRNA, rRNA, and tRNA. However, the precise role of RNAI gene have not been revealed until yet. We have cloned rna1-1 mutant gene from rna1-1 mutant yeast strain(R49 ; trpl, ura3-52, rna1-1). The 3.4kb BglII fragment of wild type RNAI clone(81-2-6) contains whole RNAI gene. The genomic southern blotting with BglII digested R49 genomic DNA as a probe shows the unique and identical band with wild type 3.4kb BglII fragment. Therefore, We prepared partial BglII genomic library(3~4kb BglII fragments) into BamH I site of pUC19. The rna 1-1 mutant clone was screened with Digoxigenin(DIG)-lableled probe by high density colony hybridization. The 5'-flanking region of rna1-1 gene was sequenced by dideoxy chain termination method. The 5'-flanking sequence of RNAI gene contains three TATA-like sequence ; TAATA, TATA and TTTTAA at position of -67, -45, and -36 from first ATG codon respectively. The 5'-flanking region of wild type RNA I gene from ATG codon to -103nt was deleted with Bal31 exonuclease digestion, generating $pUC{\Delta}$/RNA I. After constructing $pYEP{\Delta}RNA$ I (consists of -103nt deleting RNA I gene, URA3 gene, $2{\mu}m$ rep. origin), pYEPrna1-1(consists of Xba I fragment of pUCrna1-1. URA3 gene, $2{\mu}m$ rep. origin), and pYEPRNAI. each plasmid was transformed into host strain(trpl, ura3-52, rna1-1) by electroporation, respectively. Yeast transformant carrying $pYEP{\Delta}RNA$ I did not complement the thermal sensitivity of rna1-1 gene. It means that TATA-like sequences in 5'-flanking region is not TATA sequence for transcribing RNAI gene and there may be other essential sequence in upstream region for the transcription of RNAI gene.

  • PDF

Status and Characteristics of the Newly Established Cooperatives in Agricultural Sector (농업분야 신생 협동조합의 현황과 유형별 특징)

  • Choi, Kyung Sik;Nam, Gi Pou;Hwang, Dae Yong
    • Journal of Agricultural Extension & Community Development
    • /
    • v.21 no.4
    • /
    • pp.967-1006
    • /
    • 2014
  • This study attempted to provide policy recommendations in promoting new cooperatives established in agriculture based on the 2012 Cooperative Act. A questionnaire survey was conducted with 195 newly established cooperatives as the policy target of this study. The new cooperatives were classified as three kinds namely as 'Business' Cooperatives', 'Consumers' Cooperatives', 'Social Cooperatives' based on their member attributes and objectives. Interesting to note that, all of these new cooperatives born by the new Act has taken the marketing business as their main stream business. Among the three types, 'Business Cooperatives' are ranked the highest amount of capital shares per person in average, having about 30 members in size. In categorization, 'Business Cooperatives' include farmer cooperatives as majority and employee cooperatives. They are usually involved in both production and marketing and even in processing activities, and have tried to secure their business performance by e-commerce and stable business contracts. Their diverse activities are highly associated with their local community. Consumers' Cooperatives include consumer cooperatives and stakeholder cooperatives in achieving welfare of members. This type has lower share in capital but has over 30 members in a cooperative, taking marketing (distribution) business as main and often take advantage of their social network and physical store. Regional relationships are less than producer cooperatives. 'Social Cooperatives' are established by public interest and have around 10 members and lowest per capital. their business and community activity is similar to the consumer cooperatives. This study recommends the needs of designing suitable business models by these three types of cooperatives in the future, while appropriating their membership size for their tangible business operations. The government policy direction should aim to develop their new business opportunities and its management stabilization, especially in conjunction with the existing agricultural cooperatives (Nonghyup). It must be rather than to provide simply policy supports for establishment. An in-depth study is recommended in this regard.

A Study on Soviet Constructive Fashion in 1920s (1920년대 소비에트 구성주의 패션에 관한 연구)

  • 조윤경;금기숙
    • Journal of the Korean Society of Costume
    • /
    • v.36
    • /
    • pp.183-203
    • /
    • 1998
  • The wave of Avant-garde swept away all in the unique social background so called 'October Revolution' and the early 1900 Russian society which was able to absorb and accept anything. The Russian avant-garde has been affected by the Cubism and the Futurism those had peculiarly appeared in the early twentieth century, spreaded out to three spheres: the Suprematism, the Rayonism and the Constructivism. The Russian Constructivism has appeared in this background, concretely and ideally ex-pressed the ideology of the revolution into the artistic form and made an huge influence to the whole Russian society. The Constructivist like Tatlin, naum Gabo, Pevaner, Rodchenko, Stepanova, Popova and Exter gave great effect on the Soviet Constructive fashion design in 1920's after the Revolution. The Soviet costume in 1920s hold in common the characteristicss of the Constructive graphic as it is, geometrical and abstractive form, energetic and motility. In fashion design, these graphic qualities have been showed as the application of geometrical form and architectural image, physical distortion and transformation. And in textile design, the simple, dynamical presentation has been appeared. We can classify the Soviet costume at this time into three occasions. The first term is from late 1910 th mid 1920, and it is altered from folk costume design to modern one. With Lamanova as the first on the list, using the folk mitif, the Constructive expression of simple form has been gradually revealed in design. Designers like Makarova, Pribylskaia and Mukhina produced the plane, simple chemise style with the decoration of the Russian traditional motif. From early to late 1920 is the second term, and it is at the pick of the most active processing of the Constructive design. Not only at the costume in daily life but also at the theatrical costume and textile, the con-structive design has been represented all avail-able fields. Many Constructivists including Stepanova, Popova, Exter and Rodchenko took part in the textile design and costume design so as to evlvo their aesthetic concept. The third term is from late 1920 to early 1930. The socialistic realism has dominated over the whole culture and art, the revolutionary dynamic motif has been presented also in textile design. The formative features of Soviet Constructive fashion design are; silhouette, from, motif, color and fabric. The first, the silhouette : a straight rectangular silhouetted has been expressed through the whole period and a volumed one with distorted human body shape has introduced in the theatrical costume design. The second, the form: many lengthened rectangular forms have been made at beginnings, but to the middle period, geometrical, architectural forms have been more showed and there are energy and movement in design. At the last period, only a partial feature-division has been seen. The third, the motif; no pattern or ethnic motif has been partly used at beginnings, a figure like circle, tri-angle has gradually appeared in textile design. At latter period, a real-existent motif like an airplane has been represented with graphing and simplicity. The fourth, the color ; because of insufficient dyeing, neutral color like black or grey color has been mainly covered, but after middle term, a primary color or pastel tone has been seen, contrast of the fabric; without much development of textile industry after the Revolution, thick and durable fabrics have been the main stream, but as time had going to the last period, fabrics such as linen, cotton, velvet and silk have been varously choesn. At the theatrical costume, new materials like plastics and metals that were able to accentuate the form. The pursuit of popularity, simplicity and functionalism that the basic concept of Constructive fashion is one of the "beauty" which has been searching in modern fashion. And now we can appreciate how innovative and epochal this Soviet Constructive fashion movement was.ement was.

  • PDF

Digital Hologram Compression Technique By Hybrid Video Coding (하이브리드 비디오 코팅에 의한 디지털 홀로그램 압축기술)

  • Seo, Young-Ho;Choi, Hyun-Jun;Kang, Hoon-Jong;Lee, Seung-Hyun;Kim, Dong-Wook
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.42 no.5 s.305
    • /
    • pp.29-40
    • /
    • 2005
  • According as base of digital hologram has been magnified, discussion of compression technology is expected as a international standard which defines the compression technique of 3D image and video has been progressed in form of 3DAV which is a part of MPEG. As we can identify in case of 3DAV, the coding technique has high possibility to be formed into the hybrid type which is a merged, refined, or mixid with the various previous technique. Therefore, we wish to present the relationship between various image/video coding techniques and digital hologram In this paper, we propose an efficient coding method of digital hologram using standard compression tools for video and image. At first, we convert fringe patterns into video data using a principle of CGH(Computer Generated Hologram), and then encode it. In this research, we propose a compression algorithm is made up of various method such as pre-processing for transform, local segmentation with global information of object image, frequency transform for coding, scanning to make fringe to video stream, classification of coefficients, and hybrid video coding. Finally the proposed hybrid compression algorithm is all of these methods. The tool for still image coding is JPEG2000, and the toots for video coding include various international compression algorithm such as MPEG-2, MPEG-4, and H.264 and various lossless compression algorithm. The proposed algorithm illustrated that it have better properties for reconstruction than the previous researches on far greater compression rate above from four times to eight times as much. Therefore we expect that the proposed technique for digital hologram coding is to be a good preceding research.

An Importance Analysis on the NCS-Based Skin Care Qualification L3 Level of Education in Life Care (라이프케어의 피부미용 NCS기반 자격 L3수준의 교육 중요도 연구)

  • Park, Chae-Young;Park, Jeong-Yeon
    • Journal of Korea Entertainment Industry Association
    • /
    • v.13 no.5
    • /
    • pp.263-271
    • /
    • 2019
  • The recent phenomenon of job "Miss Match", which is inconsistent with knowledge in the demand of educational training institutes and industries, has spread to an increase in private education costs for reeducation and employment of new hires, resulting in weak individual job competency and poor employment capability, as well as economic and material waste at the national level. To compensate for these problems, the National Competency Standards(NCS), which are available immediately in practice and look for a standard point of national job competency with the aim of fostering human resources sought by industries, were developed, and even the NCS-based qualification system was launched in line with the stream of times. This study is intended to look into the importance and priority of competency units and competency unit elements at the NCS-based qualification L3 level in the skin care field for an overall check of the NCS-based qualification level at a time when educational institutes are organizing and operating the school curriculums according to the NCS and NCS-based qualification level. And it is attempted to provide basic data for the development of curriculum in fostering professional human resources required by industries. To analyze the needs for competency units and competency unit elements at the L3 level, a survey using AHP method was carried out to a group of field experts and a group of education experts. In addition, the SPSS(Statistical Package for Social Science) ver. 21.0 and Expert Choice 2000, an AHP-only solution was used to do statistical processing through the processes of data coding and data cleaning. The findings showed that there was a partial difference of opinion between a group of field experts and a group of education experts. This indicates that the inconsistencies between educational training institutes and industrial sites should be resolved at this time of change with the aim of fostering field customized human resources with professional skills. Consequently, the solution is to combine jobs at industrial sites and standardized educations of educational institutes with human resources required at industrial sites.

Analysis of Twitter for 2012 South Korea Presidential Election by Text Mining Techniques (텍스트 마이닝을 이용한 2012년 한국대선 관련 트위터 분석)

  • Bae, Jung-Hwan;Son, Ji-Eun;Song, Min
    • Journal of Intelligence and Information Systems
    • /
    • v.19 no.3
    • /
    • pp.141-156
    • /
    • 2013
  • Social media is a representative form of the Web 2.0 that shapes the change of a user's information behavior by allowing users to produce their own contents without any expert skills. In particular, as a new communication medium, it has a profound impact on the social change by enabling users to communicate with the masses and acquaintances their opinions and thoughts. Social media data plays a significant role in an emerging Big Data arena. A variety of research areas such as social network analysis, opinion mining, and so on, therefore, have paid attention to discover meaningful information from vast amounts of data buried in social media. Social media has recently become main foci to the field of Information Retrieval and Text Mining because not only it produces massive unstructured textual data in real-time but also it serves as an influential channel for opinion leading. But most of the previous studies have adopted broad-brush and limited approaches. These approaches have made it difficult to find and analyze new information. To overcome these limitations, we developed a real-time Twitter trend mining system to capture the trend in real-time processing big stream datasets of Twitter. The system offers the functions of term co-occurrence retrieval, visualization of Twitter users by query, similarity calculation between two users, topic modeling to keep track of changes of topical trend, and mention-based user network analysis. In addition, we conducted a case study on the 2012 Korean presidential election. We collected 1,737,969 tweets which contain candidates' name and election on Twitter in Korea (http://www.twitter.com/) for one month in 2012 (October 1 to October 31). The case study shows that the system provides useful information and detects the trend of society effectively. The system also retrieves the list of terms co-occurred by given query terms. We compare the results of term co-occurrence retrieval by giving influential candidates' name, 'Geun Hae Park', 'Jae In Moon', and 'Chul Su Ahn' as query terms. General terms which are related to presidential election such as 'Presidential Election', 'Proclamation in Support', Public opinion poll' appear frequently. Also the results show specific terms that differentiate each candidate's feature such as 'Park Jung Hee' and 'Yuk Young Su' from the query 'Guen Hae Park', 'a single candidacy agreement' and 'Time of voting extension' from the query 'Jae In Moon' and 'a single candidacy agreement' and 'down contract' from the query 'Chul Su Ahn'. Our system not only extracts 10 topics along with related terms but also shows topics' dynamic changes over time by employing the multinomial Latent Dirichlet Allocation technique. Each topic can show one of two types of patterns-Rising tendency and Falling tendencydepending on the change of the probability distribution. To determine the relationship between topic trends in Twitter and social issues in the real world, we compare topic trends with related news articles. We are able to identify that Twitter can track the issue faster than the other media, newspapers. The user network in Twitter is different from those of other social media because of distinctive characteristics of making relationships in Twitter. Twitter users can make their relationships by exchanging mentions. We visualize and analyze mention based networks of 136,754 users. We put three candidates' name as query terms-Geun Hae Park', 'Jae In Moon', and 'Chul Su Ahn'. The results show that Twitter users mention all candidates' name regardless of their political tendencies. This case study discloses that Twitter could be an effective tool to detect and predict dynamic changes of social issues, and mention-based user networks could show different aspects of user behavior as a unique network that is uniquely found in Twitter.