• Journal of Intelligence and Information Systems
• /
• v.26 no.1
• /
• pp.1-21
• /
• 2020

With the rapid development of artificial intelligence technology, various techniques have been developed to extract meaningful information from unstructured text data which constitutes a large portion of big data. Over the past decades, text mining technologies have been utilized in various industries for practical applications. In the field of business intelligence, it has been employed to discover new market and/or technology opportunities and support rational decision making of business participants. The market information such as market size, market growth rate, and market share is essential for setting companies' business strategies. There has been a continuous demand in various fields for specific product level-market information. However, the information has been generally provided at industry level or broad categories based on classification standards, making it difficult to obtain specific and proper information. In this regard, we propose a new methodology that can estimate the market sizes of product groups at more detailed levels than that of previously offered. We applied Word2Vec algorithm, a neural network based semantic word embedding model, to enable automatic market size estimation from individual companies' product information in a bottom-up manner. The overall process is as follows: First, the data related to product information is collected, refined, and restructured into suitable form for applying Word2Vec model. Next, the preprocessed data is embedded into vector space by Word2Vec and then the product groups are derived by extracting similar products names based on cosine similarity calculation. Finally, the sales data on the extracted products is summated to estimate the market size of the product groups. As an experimental data, text data of product names from Statistics Korea's microdata (345,103 cases) were mapped in multidimensional vector space by Word2Vec training. We performed parameters optimization for training and then applied vector dimension of 300 and window size of 15 as optimized parameters for further experiments. We employed index words of Korean Standard Industry Classification (KSIC) as a product name dataset to more efficiently cluster product groups. The product names which are similar to KSIC indexes were extracted based on cosine similarity. The market size of extracted products as one product category was calculated from individual companies' sales data. The market sizes of 11,654 specific product lines were automatically estimated by the proposed model. For the performance verification, the results were compared with actual market size of some items. The Pearson's correlation coefficient was 0.513. Our approach has several advantages differing from the previous studies. First, text mining and machine learning techniques were applied for the first time on market size estimation, overcoming the limitations of traditional sampling based- or multiple assumption required-methods. In addition, the level of market category can be easily and efficiently adjusted according to the purpose of information use by changing cosine similarity threshold. Furthermore, it has a high potential of practical applications since it can resolve unmet needs for detailed market size information in public and private sectors. Specifically, it can be utilized in technology evaluation and technology commercialization support program conducted by governmental institutions, as well as business strategies consulting and market analysis report publishing by private firms. The limitation of our study is that the presented model needs to be improved in terms of accuracy and reliability. The semantic-based word embedding module can be advanced by giving a proper order in the preprocessed dataset or by combining another algorithm such as Jaccard similarity with Word2Vec. Also, the methods of product group clustering can be changed to other types of unsupervised machine learning algorithm. Our group is currently working on subsequent studies and we expect that it can further improve the performance of the conceptually proposed basic model in this study.

• Journal of Distribution Research
• /
• v.15 no.1
• /
• pp.49-71
• /
• 2010

Franchise businesses in South Korea have contributed to economic growth and job creation, and its growth potential remains very high. However, despite such virtues, domestic franchise businesses face many problems such as the instability of franchisor's business structure and weak financial conditions. To solve these problems, the government enacted legislation and strengthened franchise related laws. However, the strengthening of laws regulating franchisors had many side effects that interrupted the development of the franchise business. For example, legal regulations regarding franchisors have had the effect of suppressing the franchisor's leadership activities (e.g. activities such as the ability to advocate the franchisor's policies and strategies to the franchisees, in order to facilitate change and innovation). One of the main goals of the franchise business is to build cooperation between the franchisor and the franchisee for their combined success. However, franchisees can refuse to follow the franchisor's strategies because of the current state of franchise-related law and government policy. The purpose of this study to explore the effects of franchisor's leadership style on franchisee's commitment in a franchise system. We classified leadership styles according to the path-goal theory (House & Mitchell, 1974), and it was hypothesized and tested that the four leadership styles proposed by the path-goal theory (i.e. directive, supportive, participative and achievement-oriented leadership) have different effects on franchisee's commitment. Another purpose of this study to explore the how the level of franchisee's self-efficacy influences both the franchisor's leadership style and franchisee's commitment in a franchise system. Results of the present study are expected to provide important theoretical and practical implications as to the role of franchisor's leadership style, as restricted by government regulations and the franchisee's self-efficacy, which could be needed to improve the quality of the long-term relationship between the franchisor and franchisee. Quoted by Northouse(2007), one problem regarding the investigation of leadership is that there are almost as many different definitions of leadership as there are people who have tried to define it. But despite the multitude of ways in which leadership has been conceptualized, the following components can be identified as central to the phenomenon: (a) leadership is a process, (b) leadership involves influence, (c) leadership occurs in a group context, and (d) leadership involves goal attainment. Based on these components, in this study leadership is defined as a process whereby franchisor's influences a group of franchisee' to achieve a common goal. Focusing on this definition, the path-goal theory is about how leaders motivate subordinates to accomplish designated goals. Drawing heavily from research on what motivates employees, path-goal theory first appeared in the leadership literature in the early 1970s in the works of Evans (1970), House (1971), House and Dessler (1974), and House and Mitchell (1974). The stated goal of this leadership theory is to enhance employee performance and employee satisfaction by focusing on employee motivation. In brief, path-goal theory is designed to explain how leaders can help subordinates along the path to their goals by selecting specific behaviors that are best suited to subordinates' needs and to the situation in which subordinates are working (Northouse, 2007). House & Mitchell(1974) predicted that although many different leadership behaviors could have been selected to be a part of path-goal theory, this approach has so far examined directive, supportive, participative, and achievement-oriented leadership behaviors. And they suggested that leaders may exhibit any or all of these four styles with various subordinates and in different situations. However, due to restrictive government regulations, franchisors are not in a position to change their leadership style to suit their circumstances. In addition, quoted by Northouse(2007), ssubordinate characteristics determine how a leader's behavior is interpreted by subordinates in a given work context. Many researchers have focused on subordinates' needs for affiliation, preferences for structure, desires for control, and self-perceived level of task ability. In this study, we have focused on the self-perceived level of task ability, namely, the franchisee's self-efficacy. According to Bandura (1977), self-efficacy is chiefly defined as the personal attitude of one's ability to accomplish concrete tasks. Therefore, it is not an indicator of one's actual abilities, but an opinion of the extent of how one can use that ability. Thus, the judgment of maintain franchisee's commitment depends on the situation (e.g., government regulation and policy and leadership style of franchisor) and how it affects one's ability to mobilize resources to deal with the task, so even if people possess the same ability, there may be differences in self-efficacy. Figure 1 illustrates the model investigated in this study. In this model, it was hypothesized that leadership styles would affect the franchisee's commitment, and self-efficacy would moderate the relationship between leadership style and franchisee's commitment. Theoretically, quoted by Northouse(2007), the path-goal approach suggests that leaders need to choose a leadership style that best fits the needs of subordinates and the work they are doing. According to House & Mitchell (1974), the theory predicts that a directive style of leadership is best in situations in which subordinates are dogmatic and authoritarian, the task demands are ambiguous, and the organizational rule and procedures are unclear. In these situations, franchisor's directive leadership complements the work by providing guidance and psychological structure for franchisees. For work that is structured, unsatisfying, or frustrating, path-goal theory suggests that leaders should use a supportive style. Franchisor's Supportive leadership offers a sense of human touch for franchisees engaged in mundane, mechanized activity. Franchisor's participative leadership is considered best when a task is ambiguous because participation gives greater clarity to how certain paths lead to certain goals; it helps subordinates learn what actions leads to what outcome. Furthermore, House & Mitchell(1974) predicts that achievement-oriented leadership is most effective in settings in which subordinates are required to perform ambiguous tasks. Marsh and O'Neill (1984) tested the idea that organizational members' anger and decline in performance is caused by deficiencies in their level of effort and found that self-efficacy promotes accomplishment, decreases stress and negative consequences like depression and emotional instability. Based on the extant empirical findings and theoretical reasoning, we posit positive and strong relationships between the franchisor's leadership styles and the franchisee's commitment. Furthermore, the level of franchisee's self-efficacy was thought to maintain their commitment. The questionnaires sent to participants consisted of the following measures; leadership style was assessed using a 20 item 7-point likert scale developed by Indvik (1985), self-efficacy was assessed using a 24 item 6-point likert scale developed by Bandura (1977), and commitment was assessed using a 6 item 5-point likert scale developed by Morgan & Hunt (1994). Questionnaires were distributed to Korean optical franchisees in Seoul. It took about 20 days to complete the data collection. A total number of 140 questionnaires were returned and complete data were available from 137 respondents. Results of multiple regression analyses testing the relationships between the each of the four styles of leadership shown by the franchisor as independent variables and franchisee's commitment as the dependent variable showed that the relationship between supportive leadership style and commitment ($\beta$=.13, p<.001),and the relationship between participative leadership style and commitment ($\beta$=.07, p<.001)were significant. However, when participants divided into high and low self-efficacy groups, results of multiple regression analyses showed that only the relationship between achievement-oriented leadership style and commitment ($\beta$=.14, p<.001) was significant in the high self-efficacy group. In the low self-efficacy group, the relationship between supportive leadership style and commitment ($\beta$=.17, p<.001),and the relationship between participative leadership style and commitment ($\beta$=.10, p<.001) were significant. The study focused on the franchisee's self-efficacy in order to explore the possibility that regulation, originally intended to protect the franchisee, may not be the most effective method to maintain the relationships in a franchise business. The key results of the data analysis regarding the moderating role of self-efficacy between leadership behavior style as proposed by path-goal and commitment theory were as follows. First, this study proposed that franchisor should apply the appropriate type of leadership behavior to strengthen the franchisees commitment because the results demonstrated that supportive and participative leadership styles by the franchisors have a positive influence on the franchisee's level of commitment. Second, it is desirable for franchisor to validate the franchisee's efforts, since the franchisee's characteristics such as self-efficacy had a substantial, positive effect on the franchisee's commitment as well as being a meaningful moderator between leadership and commitment. Third, the results as a whole imply that the government should provide institutional support, namely to put the franchisor in a position to clearly identify the characteristics of their franchisees and provide reasonable means to administer the franchisees to achieve the company's goal.

• Journal of Intelligence and Information Systems
• /
• v.23 no.4
• /
• pp.127-146
• /
• 2017

Services using artificial intelligence have begun to emerge in daily life. Artificial intelligence is applied to products in consumer electronics and communications such as artificial intelligence refrigerators and speakers. In the financial sector, using Kensho's artificial intelligence technology, the process of the stock trading system in Goldman Sachs was improved. For example, two stock traders could handle the work of 600 stock traders and the analytical work for 15 people for 4weeks could be processed in 5 minutes. Especially, big data analysis through machine learning among artificial intelligence fields is actively applied throughout the financial industry. The stock market analysis and investment modeling through machine learning theory are also actively studied. The limits of linearity problem existing in financial time series studies are overcome by using machine learning theory such as artificial intelligence prediction model. The study of quantitative financial data based on the past stock market-related numerical data is widely performed using artificial intelligence to forecast future movements of stock price or indices. Various other studies have been conducted to predict the future direction of the market or the stock price of companies by learning based on a large amount of text data such as various news and comments related to the stock market. Investing on commodity asset, one of alternative assets, is usually used for enhancing the stability and safety of traditional stock and bond asset portfolio. There are relatively few researches on the investment model about commodity asset than mainstream assets like equity and bond. Recently machine learning techniques are widely applied on financial world, especially on stock and bond investment model and it makes better trading model on this field and makes the change on the whole financial area. In this study we made investment model using Support Vector Machine among the machine learning models. There are some researches on commodity asset focusing on the price prediction of the specific commodity but it is hard to find the researches about investment model of commodity as asset allocation using machine learning model. We propose a method of forecasting four major commodity indices, portfolio made of commodity futures, and individual commodity futures, using SVM model. The four major commodity indices are Goldman Sachs Commodity Index(GSCI), Dow Jones UBS Commodity Index(DJUI), Thomson Reuters/Core Commodity CRB Index(TRCI), and Rogers International Commodity Index(RI). We selected each two individual futures among three sectors as energy, agriculture, and metals that are actively traded on CME market and have enough liquidity. They are Crude Oil, Natural Gas, Corn, Wheat, Gold and Silver Futures. We made the equally weighted portfolio with six commodity futures for comparing with other commodity indices. We set the 19 macroeconomic indicators including stock market indices, exports & imports trade data, labor market data, and composite leading indicators as the input data of the model because commodity asset is very closely related with the macroeconomic activities. They are 14 US economic indicators, two Chinese economic indicators and two Korean economic indicators. Data period is from January 1990 to May 2017. We set the former 195 monthly data as training data and the latter 125 monthly data as test data. In this study, we verified that the performance of the equally weighted commodity futures portfolio rebalanced by the SVM model is better than that of other commodity indices. The prediction accuracy of the model for the commodity indices does not exceed 50% regardless of the SVM kernel function. On the other hand, the prediction accuracy of equally weighted commodity futures portfolio is 53%. The prediction accuracy of the individual commodity futures model is better than that of commodity indices model especially in agriculture and metal sectors. The individual commodity futures portfolio excluding the energy sector has outperformed the three sectors covered by individual commodity futures portfolio. In order to verify the validity of the model, it is judged that the analysis results should be similar despite variations in data period. So we also examined the odd numbered year data as training data and the even numbered year data as test data and we confirmed that the analysis results are similar. As a result, when we allocate commodity assets to traditional portfolio composed of stock, bond, and cash, we can get more effective investment performance not by investing commodity indices but by investing commodity futures. Especially we can get better performance by rebalanced commodity futures portfolio designed by SVM model.

• Journal of Korea Technology Innovation Society
• /
• v.21 no.1
• /
• pp.130-150
• /
• 2018

Technology valuation refers to the act, procedures, or techniques in evaluating certain technology and its value for commercialization. For this purpose, deadlines and process plans are established based on valuation goals such as technology transfer, investment and financing, investment in kind, and strategy establishment. The technology valuation process involves analyzing and evaluating technology performance, rights, marketability, and business value technology, as well as calculating the monetary value of technology modules based on the results. Analysis and evaluation of each module is performed by a team of experts having knowledge of specific technology. Valuation of technologies is conducted as independent projects by project managers (PM) who integrate and manage modules; they must have expertise in systematic performance of task support and management to ensure objectivity and reliability. Furthermore, the valuation team comprises expert stakeholders having knowledge about each module due to the nature of technology valuation. For smooth knowledge sharing in technology and valuation procedures, communication skills and roles of PMs supporting and managing the valuation are important. Primarily, PMs must resolve conflicts between evaluators participating in different tasks, evaluators and evaluatees, and technology holders and receivers. This study examines technology valuation for four conflicts occurring frequently among stakeholders providing valuation support to PMs, and seeks resolutions. The conflicts and resolutions discussed in this study may lead to more specialized roles of PMs in technology valuation and project management, as well as systemized valuation support and management plans.

• Journal of Distribution Science
• /
• v.10 no.6
• /
• pp.39-53
• /
• 2012

It is widely known that knowledge management plays a facilitating role that contributes to upgrading organizational performance. Knowledge management systems (KMS), especially, support the knowledge management process including the sharing, creating, and using of knowledge within a company, and maximize the value of knowledge resources within an organization. Despite this widely held belief, there are few studies that describe how companies actually develop, share, and practice their knowledge. Companies in the domestic small franchise sector, which are in the early stages in terms of knowledge management, need to improve their KMS to manage their franchisees effectively. From this perspective, this study uses a qualitative approach to explore the actual process of knowledge management implementation. This article presents a case study of PB (Paris Baguette) company, which is the first to build a KMS in the franchise industry. The study was able to confirm the following facts through the analysis of target companies. First, the chief executive's support is a critical success factor and this support can increase the participation of organization members. Second, it is important to build a process and culture that actively creates and leverages information in knowledge management activities. The organizational learning culture should be one where the creation, learning, and sharing of new knowledge is developed continuously. Third, a horizontal network organization is needed in order to make relationships within the organization more close-knit. Fourth, in order to connect the diverse processes such as knowledge acquisition, storage, and utilization of knowledge management activities, information technology (IT) capabilities are essential. Indeed, IT can be a powerful tool for improving the quality of work and maximizing the spread and use of knowledge. However, during the construction of an intranet based KMS, research is required to ensure that the most efficient system is implemented. Finally, proper evaluation and compensation are important success factors. In order to develop knowledge workers, an appropriate program of promotion and compensation should be established. Also, building members' confidence in the benefits of knowledge management should be an ongoing activity. The company developed its original KMS to achieve a flexible and proactive organization, and a new KMS to improve organizational and personal capabilities. The PB case shows that there are differences between participants perceptions and actual performance in managing knowledge; that knowledge management is not a matter of formality but a paradigm that assures the sharing of knowledge; and that IT boosts communication skills, thus creating a mutual relationship to enhance the flow of knowledge and information between people. Knowledge management for building organizational capabilities can be successful when considering its focus and ways to increase its acceptance. This study suggests guidelines for major factors that corporate executives of domestic franchises should consider to improve knowledge management and the higher operating activities that can be used.

• Journal of Korean Society of Transportation
• /
• v.24 no.2 s.88
• /
• pp.91-100
• /
• 2006

This paper examines the situation and tasks of UK rail privatization, especially focusing on after the Hatfield rail accident. Earlier research which focused on the UK's Privatization had little knowledge of the explanations for recent changes. Moreover they had difficulty making a direct comparison between national rail and the privatized rail. Therefore we aye left without a good explanation which has a comprehensive perspective. I attempt to show the change in the rail privatization Process and its outcome, focusing on after the Hatfield rail accident. This Paper argues that the UK's vail privatization process has a regulatory framework which is too complicated with overlapping responsibilities that brought about inefficiency, increasing costs and a superficial safety regime. Especially the planning of rail and infrastructure maintenance did not come to play an appropriate role. However after 2000, the government took charge of setting the strategy for railways, and the Office of Rail Regulation covered safety performance and cost. explain that these changes present a good opportunity to solve the problem of passing the buck for poor performance. Through the analysis, I find that the passenger rail network is well-suited to deliver long distance business and commuters and that the subsidy from the government is decreasing. However, performance, for example punctuality and reliability. should be improved. Especially the Hatfield rail accident caused a reduction in the satisfaction of passengers. In future. the problems of rising costs and monopoly franchise system should be addressed.

• Journal of the Korean Institute of Landscape Architecture
• /
• v.49 no.1
• /
• pp.1-18
• /
• 2021

This study was intended to present measures for the improvement of the apartment house landscaping supervision system by examining the adequacy of landscaping supervision, which is aimed at improving the quality of landscape plants and facilities in apartment house landscaping sites. Additionally, this study aims to identify the problems occurring in the process of the performance of landscaping supervision and to provide the evidence for legislative activities and revision of the laws currently being pushed forward for the mandatory deployment of apartment house landscaping supervision personnel. The results of the analysis showed that no landscaping supervision personnel was deployed to apartment complexes with less than 1,500 households and that the landscaping comprised 19% to 46% of the entire construction process. The civil engineering firm performed the landscaping supervision, which made it impracticable to fully focus on the construction quality in the field of landscaping. The quality control in terms of landscape plants revealed differences in quality control, depending on the competence and experience of the civil engineer supervising the personnel, where the landscaping supervision personnel was not deployed. The apartment houses landscaping supervision activity index was analyzed, and the results showed that the supervision activity index for apartment house A was 72.0, B was 70.4, and apartment houses C to G ranged from 38.7 to 46.9, which suggested that the difference in quality control, process control, and technical support affected the construction quality and occurrence of defects.The improvement of landscaping process quality control and process management will be carried out more smoothly and the rate of defects will be drastically reduced if the landscaping supervision personnel placement threshold is lowered from 1,500 households to 300 households in complexes. The results of this study are expected to be useful in promoting and re-establishing the landscaping industry based on the improvement of construction quality in the field of landscaping in connection with the construction of apartment houses.

• Asia pacific journal of information systems
• /
• v.22 no.1
• /
• pp.29-52
• /
• 2012

Consumers differ in the way they make a purchase. An audio mania would willingly make a bold, yet serious, decision to buy a top-of-the-line home theater system, while he is not interested in replacing his two-decade-old shabby car. On the contrary, an automobile enthusiast wouldn't mind spending forty thousand dollars to buy a new Jaguar convertible, yet cares little about his junky component system. It is product involvement that helps us explain such differences among individuals in the purchase style. Product involvement refers to the extent to which a product is perceived to be important to a consumer (Zaichkowsky, 2001). Product involvement is an important factor that strongly influences consumer's purchase decision-making process, and thus has been of prime interest to consumer behavior researchers. Furthermore, researchers found that involvement is closely related to perceived risk (Dholakia, 2001). While abundant research exists addressing how product involvement relates to overall perceived risk, little attention has been paid to the relationship between involvement and different types of perceived risk in an electronic commerce setting. Given that perceived risk can be a substantial barrier to the online purchase (Jarvenpaa, 2000), research addressing such an issue will offer useful implications on what specific types of perceived risk an online firm should focus on mitigating if it is to increase sales to a fullest potential. Meanwhile, past research has focused on such consumer responses as information search and dissemination as a consequence of involvement, neglecting other behavioral responses like online merchant selection. For one example, will a consumer seriously considering the purchase of a pricey Guzzi bag perceive a great degree of risk associated with online buying and therefore choose to buy it from a digital storefront rather than from an online marketplace to mitigate risk? Will a consumer require greater trust on the part of the online merchant when the perceived risk of online buying is rather high? We intend to find answers to these research questions through an empirical study. This paper explores the impact of enduring product involvement and perceived risks on required trust level, and further on online merchant choice. For the purpose of the research, five types or components of perceived risk are taken into consideration, including financial, performance, delivery, psychological, and social risks. A research model has been built around the constructs under consideration, and 12 hypotheses have been developed based on the research model to examine the relationships between enduring involvement and five components of perceived risk, between five components of perceived risk and required trust level, between enduring involvement and required trust level, and finally between required trust level and preference toward an e-tailer. To attain our research objectives, we conducted an empirical analysis consisting of two phases of data collection: a pilot test and main survey. The pilot test was conducted using 25 college students to ensure that the questionnaire items are clear and straightforward. Then the main survey was conducted using 295 college students at a major university for nine days between December 13, 2010 and December 21, 2010. The measures employed to test the model included eight constructs: (1) enduring involvement, (2) financial risk, (3) performance risk, (4) delivery risk, (5) psychological risk, (6) social risk, (7) required trust level, (8) preference toward an e-tailer. The statistical package, SPSS 17.0, was used to test the internal consistency among the items within the individual measures. Based on the Cronbach's ${\alpha}$ coefficients of the individual measure, the reliability of all the variables is supported. Meanwhile, the Amos 18.0 package was employed to perform a confirmatory factor analysis designed to assess the unidimensionality of the measures. The goodness of fit for the measurement model was satisfied. Unidimensionality was tested using convergent, discriminant, and nomological validity. The statistical evidences proved that the three types of validity were all satisfied. Now the structured equation modeling technique was used to analyze the individual paths along the relationships among the research constructs. The results indicated that enduring involvement has significant positive relationships with all the five components of perceived risk, while only performance risk is significantly related to trust level required by consumers for purchase. It can be inferred from the findings that product performance problems are mostly likely to occur when a merchant behaves in an opportunistic manner. Positive relationships were also found between involvement and required trust level and between required trust level and online merchant choice. Enduring involvement is concerned with the pleasure a consumer derives from a product class and/or with the desire for knowledge for the product class, and thus is likely to motivate the consumer to look for ways of mitigating perceived risk by requiring a higher level of trust on the part of the online merchant. Likewise, a consumer requiring a high level of trust on the merchant will choose a digital storefront rather than an e-marketplace, since a digital storefront is believed to be trustworthier than an e-marketplace, as it fulfills orders by itself rather than acting as an intermediary. The findings of the present research provide both academic and practical implications. The first academic implication is that enduring product involvement is a strong motivator of consumer responses, especially the selection of a merchant, in the context of electronic shopping. Secondly, academicians are advised to pay attention to the finding that an individual component or type of perceived risk can be used as an important research construct, since it would allow one to pinpoint the specific types of risk that are influenced by antecedents or that influence consequents. Meanwhile, our research provides implications useful for online merchants (both online storefronts and e-marketplaces). Merchants may develop strategies to attract consumers by managing perceived performance risk involved in purchase decisions, since it was found to have significant positive relationship with the level of trust required by a consumer on the part of the merchant. One way to manage performance risk would be to thoroughly examine the product before shipping to ensure that it has no deficiencies or flaws. Secondly, digital storefronts are advised to focus on symbolic goods (e.g., cars, cell phones, fashion outfits, and handbags) in which consumers are relatively more involved than others, whereas e- marketplaces should put their emphasis on non-symbolic goods (e.g., drinks, books, MP3 players, and bike accessories).

• Journal of Internet Computing and Services
• /
• v.14 no.6
• /
• pp.71-84
• /
• 2013

Log data, which record the multitude of information created when operating computer systems, are utilized in many processes, from carrying out computer system inspection and process optimization to providing customized user optimization. In this paper, we propose a MongoDB-based unstructured log processing system in a cloud environment for processing the massive amount of log data of banks. Most of the log data generated during banking operations come from handling a client's business. Therefore, in order to gather, store, categorize, and analyze the log data generated while processing the client's business, a separate log data processing system needs to be established. However, the realization of flexible storage expansion functions for processing a massive amount of unstructured log data and executing a considerable number of functions to categorize and analyze the stored unstructured log data is difficult in existing computer environments. Thus, in this study, we use cloud computing technology to realize a cloud-based log data processing system for processing unstructured log data that are difficult to process using the existing computing infrastructure's analysis tools and management system. The proposed system uses the IaaS (Infrastructure as a Service) cloud environment to provide a flexible expansion of computing resources and includes the ability to flexibly expand resources such as storage space and memory under conditions such as extended storage or rapid increase in log data. Moreover, to overcome the processing limits of the existing analysis tool when a real-time analysis of the aggregated unstructured log data is required, the proposed system includes a Hadoop-based analysis module for quick and reliable parallel-distributed processing of the massive amount of log data. Furthermore, because the HDFS (Hadoop Distributed File System) stores data by generating copies of the block units of the aggregated log data, the proposed system offers automatic restore functions for the system to continually operate after it recovers from a malfunction. Finally, by establishing a distributed database using the NoSQL-based Mongo DB, the proposed system provides methods of effectively processing unstructured log data. Relational databases such as the MySQL databases have complex schemas that are inappropriate for processing unstructured log data. Further, strict schemas like those of relational databases cannot expand nodes in the case wherein the stored data are distributed to various nodes when the amount of data rapidly increases. NoSQL does not provide the complex computations that relational databases may provide but can easily expand the database through node dispersion when the amount of data increases rapidly; it is a non-relational database with an appropriate structure for processing unstructured data. The data models of the NoSQL are usually classified as Key-Value, column-oriented, and document-oriented types. Of these, the representative document-oriented data model, MongoDB, which has a free schema structure, is used in the proposed system. MongoDB is introduced to the proposed system because it makes it easy to process unstructured log data through a flexible schema structure, facilitates flexible node expansion when the amount of data is rapidly increasing, and provides an Auto-Sharding function that automatically expands storage. The proposed system is composed of a log collector module, a log graph generator module, a MongoDB module, a Hadoop-based analysis module, and a MySQL module. When the log data generated over the entire client business process of each bank are sent to the cloud server, the log collector module collects and classifies data according to the type of log data and distributes it to the MongoDB module and the MySQL module. The log graph generator module generates the results of the log analysis of the MongoDB module, Hadoop-based analysis module, and the MySQL module per analysis time and type of the aggregated log data, and provides them to the user through a web interface. Log data that require a real-time log data analysis are stored in the MySQL module and provided real-time by the log graph generator module. The aggregated log data per unit time are stored in the MongoDB module and plotted in a graph according to the user's various analysis conditions. The aggregated log data in the MongoDB module are parallel-distributed and processed by the Hadoop-based analysis module. A comparative evaluation is carried out against a log data processing system that uses only MySQL for inserting log data and estimating query performance; this evaluation proves the proposed system's superiority. Moreover, an optimal chunk size is confirmed through the log data insert performance evaluation of MongoDB for various chunk sizes.

• Journal of Intelligence and Information Systems
• /
• v.19 no.4
• /
• pp.55-79
• /
• 2013

In this paper, we propose a hybrid genetic algorithm (HGA) approach to effectively solve the reverse logistics network with centralized centers (RLNCC). For the proposed HGA approach, genetic algorithm (GA) is used as a main algorithm. For implementing GA, a new bit-string representation scheme using 0 and 1 values is suggested, which can easily make initial population of GA. As genetic operators, the elitist strategy in enlarged sampling space developed by Gen and Chang (1997), a new two-point crossover operator, and a new random mutation operator are used for selection, crossover and mutation, respectively. For hybrid concept of GA, an iterative hill climbing method (IHCM) developed by Michalewicz (1994) is inserted into HGA search loop. The IHCM is one of local search techniques and precisely explores the space converged by GA search. The RLNCC is composed of collection centers, remanufacturing centers, redistribution centers, and secondary markets in reverse logistics networks. Of the centers and secondary markets, only one collection center, remanufacturing center, redistribution center, and secondary market should be opened in reverse logistics networks. Some assumptions are considered for effectively implementing the RLNCC The RLNCC is represented by a mixed integer programming (MIP) model using indexes, parameters and decision variables. The objective function of the MIP model is to minimize the total cost which is consisted of transportation cost, fixed cost, and handling cost. The transportation cost is obtained by transporting the returned products between each centers and secondary markets. The fixed cost is calculated by opening or closing decision at each center and secondary markets. That is, if there are three collection centers (the opening costs of collection center 1 2, and 3 are 10.5, 12.1, 8.9, respectively), and the collection center 1 is opened and the remainders are all closed, then the fixed cost is 10.5. The handling cost means the cost of treating the products returned from customers at each center and secondary markets which are opened at each RLNCC stage. The RLNCC is solved by the proposed HGA approach. In numerical experiment, the proposed HGA and a conventional competing approach is compared with each other using various measures of performance. For the conventional competing approach, the GA approach by Yun (2013) is used. The GA approach has not any local search technique such as the IHCM proposed the HGA approach. As measures of performance, CPU time, optimal solution, and optimal setting are used. Two types of the RLNCC with different numbers of customers, collection centers, remanufacturing centers, redistribution centers and secondary markets are presented for comparing the performances of the HGA and GA approaches. The MIP models using the two types of the RLNCC are programmed by Visual Basic Version 6.0, and the computer implementing environment is the IBM compatible PC with 3.06Ghz CPU speed and 1GB RAM on Windows XP. The parameters used in the HGA and GA approaches are that the total number of generations is 10,000, population size 20, crossover rate 0.5, mutation rate 0.1, and the search range for the IHCM is 2.0. Total 20 iterations are made for eliminating the randomness of the searches of the HGA and GA approaches. With performance comparisons, network representations by opening/closing decision, and convergence processes using two types of the RLNCCs, the experimental result shows that the HGA has significantly better performance in terms of the optimal solution than the GA, though the GA is slightly quicker than the HGA in terms of the CPU time. Finally, it has been proved that the proposed HGA approach is more efficient than conventional GA approach in two types of the RLNCC since the former has a GA search process as well as a local search process for additional search scheme, while the latter has a GA search process alone. For a future study, much more large-sized RLNCCs will be tested for robustness of our approach.