A Two-Stage Learning Method of CNN and K-means RGB Cluster for Sentiment Classification of Images (이미지 감성분류를 위한 CNN과 K-means RGB Cluster 이-단계 학습 방안)
-
- Journal of Intelligence and Information Systems
- /
- v.27 no.3
- /
- pp.139-156
- /
- 2021
The biggest reason for using a deep learning model in image classification is that it is possible to consider the relationship between each region by extracting each region's features from the overall information of the image. However, the CNN model may not be suitable for emotional image data without the image's regional features. To solve the difficulty of classifying emotion images, many researchers each year propose a CNN-based architecture suitable for emotion images. Studies on the relationship between color and human emotion were also conducted, and results were derived that different emotions are induced according to color. In studies using deep learning, there have been studies that apply color information to image subtraction classification. The case where the image's color information is additionally used than the case where the classification model is trained with only the image improves the accuracy of classifying image emotions. This study proposes two ways to increase the accuracy by incorporating the result value after the model classifies an image's emotion. Both methods improve accuracy by modifying the result value based on statistics using the color of the picture. When performing the test by finding the two-color combinations most distributed for all training data, the two-color combinations most distributed for each test data image were found. The result values were corrected according to the color combination distribution. This method weights the result value obtained after the model classifies an image's emotion by creating an expression based on the log function and the exponential function. Emotion6, classified into six emotions, and Artphoto classified into eight categories were used for the image data. Densenet169, Mnasnet, Resnet101, Resnet152, and Vgg19 architectures were used for the CNN model, and the performance evaluation was compared before and after applying the two-stage learning to the CNN model. Inspired by color psychology, which deals with the relationship between colors and emotions, when creating a model that classifies an image's sentiment, we studied how to improve accuracy by modifying the result values based on color. Sixteen colors were used: red, orange, yellow, green, blue, indigo, purple, turquoise, pink, magenta, brown, gray, silver, gold, white, and black. It has meaning. Using Scikit-learn's Clustering, the seven colors that are primarily distributed in the image are checked. Then, the RGB coordinate values of the colors from the image are compared with the RGB coordinate values of the 16 colors presented in the above data. That is, it was converted to the closest color. Suppose three or more color combinations are selected. In that case, too many color combinations occur, resulting in a problem in which the distribution is scattered, so a situation fewer influences the result value. Therefore, to solve this problem, two-color combinations were found and weighted to the model. Before training, the most distributed color combinations were found for all training data images. The distribution of color combinations for each class was stored in a Python dictionary format to be used during testing. During the test, the two-color combinations that are most distributed for each test data image are found. After that, we checked how the color combinations were distributed in the training data and corrected the result. We devised several equations to weight the result value from the model based on the extracted color as described above. The data set was randomly divided by 80:20, and the model was verified using 20% of the data as a test set. After splitting the remaining 80% of the data into five divisions to perform 5-fold cross-validation, the model was trained five times using different verification datasets. Finally, the performance was checked using the test dataset that was previously separated. Adam was used as the activation function, and the learning rate was set to 0.01. The training was performed as much as 20 epochs, and if the validation loss value did not decrease during five epochs of learning, the experiment was stopped. Early tapping was set to load the model with the best validation loss value. The classification accuracy was better when the extracted information using color properties was used together than the case using only the CNN architecture.
The flow theory becomes one of the most important frameworks in the internet research arena. Hoffman and Novak proposed a hierarchical flow model showing the antecedents and outcomes of flow and the relationship among these variables in the hyper-media computer circumstances (Hoffman and Novak 1996). This model was further tested after their initial research (Novak, Hoffman, and Yung 2000). At their paper, Hoffman and Novak explained that the balance of challenge and skill leads to flow which means the positive optimal state of mind (Hoffman and Novak 1996). An imbalance between challenge and skill, leads to negative states of mind like anxiety, boredom, apathy (Csikszentmihalyi and Csikszentmihalyi 1988). Almost all research on the flow 4-channel model have been focusingon flow, the positive state of mind (Ellis, Voelkl, and Morris 1994 Mathwick and Rigdon 2004). However, it also needs to examine the formation of the negative states of minds and their outcomes. Flow researchers explain play or playfulness as antecedents or the early state of flow. However, play has been regarded as a distinct concept from flow in the flow literatures (Hoffman and Novak 1996; Novak, Hoffman, and Yung 2000). Mathwick and Rigdon discovered the influences of challenge and skill on play; they also observed the influence of play on web-loyalty and brand loyalty (Mathwick and Rigdon 2004). Unfortunately, they did not go so far as to test the influences of play on state of mind. This study focuses on the relationships between state of mind in the flow 4-channel model and play. Early research has attempted to hypothetically explain state of mind in flow theory, but has not been tested except flow until now. Also the importance of play has been emphasized in the flow theory, but has not been tested in the flow 4-channel model context. This researcher attempts to analyze the relationships among state of mind, skill of play, challenge, state of mind and web loyalty. For this objective, I developed a measure for state of mind and defined the concept of play as a trait. Then, the influences of challenge and skill on the state of mind and play under on-line shopping conditions were tested. Also the influences of play on state of mind were tested and those of flow and play on web loyalty were highlighted. 294 undergraduate students participated in this research survey. They were asked to respond about their perceptions of challenge, skill, state of mind, play, and web-loyalty to on-line shopping mall. Respondents were restricted to students who bought products on-line in a month. In case of buying products at two or more on-line shopping malls, they asked to respond about the shopping mall where they bought the most important one. Construct validity, discriminant validity, and convergent validity were used to check the measurement validations. Also, Cronbach's alpha was used to check scale reliability. A series of exploratory factor analyses was conducted. This researcher conducted confirmatory factor analyses to assess the validity of measurements. All items loaded significantly on their respective constructs. Also, all reliabilities were greater than.70. Chi-square difference tests and goodness of fit tests supported discriminant and convergent validity. The results of clustering and ANOVA showed that high challenge and high skill leaded to flow, low challenge and high skill leaded to boredom, and low challenge and low skill leaded to apathy. But, it was different from my expectation that high challenge and low skill didnot lead to anxiety but leaded to apathy. The results also showed that high challenge and high skill, and high challenge and low skill leaded to the highest play. Low challenge leaded to low play. 4 Structural Equation Models were built by flow, anxiety, boredom, apathy for analyzing not only the impact of play on state of mind and web-loyalty, but also that of state of mind on web-loyalty. According the analyses results of these models, play impacted flow and web-loyalty positively, but impacted anxiety, boredom, and apathy negatively. Results also showed that flow impacted web-loyalty positively, but anxiety, boredom, and apathy impacted web-loyalty negatively. The interpretations and implications of the test results of the hypotheses are as follows. First, respondents belonging to different clusters based on challenge and skill level experienced different states of mind such as flow, anxiety, boredom, apathy. The low challenge and low skill group felt the highest anxiety and apathy. It could be interpreted that this group feeling high anxiety or fear, then avoided attempts to shop on-line. Second, it was found that higher challenge leads to higher levels of play. Test results show that the play level of the high challenge and low skill group (anxiety group) was higher than that of the high challenge and high skill group (flow group). However, this was not significant. Third, play positively impacted flow and negatively impacted boredom. The negative impacts on anxiety and apathy were not significant. This means that the combination of challenge and skill creates different results. Forth, play and flow positively impacted web-loyalty, but anxiety, boredom, apathy had negative impacts. The effect of play on web-loyalty was stronger in case of anxiety, boredom, apathy group than fl ow group. These results show that challenge and skill influences state of mind and play. Results also demonstrate how play and flow influence web-loyalty. It implies that state of mind and play should be the core marketing variables in internet marketing. The flow theory has been focusing on flow and on the positive outcomes of flow experiences. But, this research shows that lots of consumers experience the negative state of mind rather than flow state in the internet shopping circumstance. Results show that the negative state of mind leads to low or negative web-loyalty. Play can have an important role with the web-loyalty when consumers have the negative state of mind. Results of structural equation model analyses show that play influences web-loyalty positively, even though consumers may be in the negative state of mind. This research found the impacts of challenge and skill on state of mind in the flow 4-channel model, not only flow but also anxiety, boredom, apathy. Also, it highlighted the role of play in the flow 4-channel model context and impacts on web-loyalty. However, tests show a few different results from hypothetical expectations such as the highest anxiety level of apathy group and insignificant impacts of play on anxiety and apathy. Further research needs to replicate this research and/or to compare 3-channel model with 4-channel model.
The purpose of this research is to construct research framework for international franchising based on existing literature and to identify research components in the framework. Franchise can be defined as management styles that allow franchisee use various management assets of franchisor in order to make or sell product or service. It can be divided into product distribution franchise that is designed to sell products and business format franchise that is designed for running it as business whatever its form is. International franchising can be defined as a way of internationalization of franchisor to foreign country by providing its business format or package to franchisee of host country. International franchising is growing fast for last four decades but academic research on this is quite limited. Especially in Korea, research about international franchising is carried out on by case study format with single case or empirical study format with survey based on domestic franchise theory. Therefore, this paper tries to review existing literature on international franchising research, providing research framework, and then stimulating new research on this field. International franchising research components include motives and environmental factors for decision of expanding to international franchising, entrance modes and development plan for international franchising, contracts and management strategy of international franchising, and various performance measures from different perspectives. First, motives of international franchising are fee collection from franchisee. Also it provides easier way to expanding to foreign country. The other motives including increase total sales volume, occupying better strategic position, getting quality resources, and improving efficiency. Environmental factors that facilitating international franchising encompasses economic condition, trend, and legal or political factors in host and/or home countries. In addition, control power and risk management capability of franchisor plays critical role in successful franchising contract. Final decision to enter foreign country via franchising is determined by numerous factors like history, size, growth, competitiveness, management system, bonding capability, industry characteristics of franchisor. After deciding to enter into foreign country, franchisor needs to set entrance modes of international franchising. Within contractual mode, there are master franchising and area developing franchising, licensing, direct franchising, and joint venture. Theories about entrance mode selection contain concepts of efficiency, knowledge-based approach, competence-based approach, agent theory, and governance cost. The next step after entrance decision is operation strategy. Operation strategy starts with selecting a target city and a target country for franchising. In order to finding, screening targets, franchisor needs to collect information about candidates. Critical information includes brand patent, commercial laws, regulations, market conditions, country risk, and industry analysis. After selecting a target city in target country, franchisor needs to select franchisee, in other word, partner. The first important criteria for selecting partners are financial credibility and capability, possession of real estate. And cultural similarity and knowledge about franchisor and/or home country are also recognized as critical criteria. The most important element in operating strategy is legal document between franchisor and franchisee with home and host countries. Terms and conditions in legal documents give objective information about characteristics of franchising agreement for academic research. Legal documents have definitions of terminology, territory and exclusivity, agreement of term, initial fee, continuing fees, clearing currency, and rights about sub-franchising. Also, legal documents could have terms about softer elements like training program and operation manual. And harder elements like law competent court and terms of expiration. Next element in operating strategy is about product and service. Especially for business format franchising, product/service deliverable, benefit communicators, system identifiers (architectural features), and format facilitators are listed for product/service strategic elements. Another important decision on product/service is standardization vs. customization. The rationale behind standardization is cost reduction, efficiency, consistency, image congruence, brand awareness, and competitiveness on price. Also standardization enables large scale R&D and innovative change in management style. Another element in operating strategy is control management. The simple way to control franchise contract is relying on legal terms, contractual control system. There are other control systems, administrative control system and ethical control system. Contractual control system is a coercive source of power, but franchisor usually doesn't want to use legal power since it doesn't help to build up positive relationship. Instead, self-regulation is widely used. Administrative control system uses control mechanism from ordinary work relationship. Its main component is supporting activities to franchisee and communication method. For example, franchisor provides advertising, training, manual, and delivery, then franchisee follows franchisor's direction. Another component is building franchisor's brand power. The last research element is performance factor of international franchising. Performance elements can be divided into franchisor's performance and franchisee's performance. The conceptual performance measures of franchisor are simple but not easy to obtain objectively. They are profit, sale, cost, experience, and brand power. The performance measures of franchisee are mostly about benefits of host country. They contain small business development, promotion of employment, introduction of new business model, and level up technology status. There are indirect benefits, like increase of tax, refinement of corporate citizenship, regional economic clustering, and improvement of international balance. In addition to those, host country gets socio-cultural change other than economic effects. It includes demographic change, social trend, customer value change, social communication, and social globalization. Sometimes it is called as westernization or McDonaldization of society. In addition, the paper reviews on theories that have been frequently applied to international franchising research, such as agent theory, resource-based view, transaction cost theory, organizational learning theory, and international expansion theories. Resource based theory is used in strategic decision based on resources, like decision about entrance and cooperation depending on resources of franchisee and franchisor. Transaction cost theory can be applied in determination of mutual trust or satisfaction of franchising players. Agent theory tries to explain strategic decision for reducing problem caused by utilizing agent, for example research on control system in franchising agreements. Organizational Learning theory is relatively new in franchising research. It assumes organization tries to maximize performance and learning of organization. In addition, Internalization theory advocates strategic decision of direct investment for removing inefficiency of market transaction and is applied in research on terms of contract. And oligopolistic competition theory is used to explain various entry modes for international expansion. Competency theory support strategic decision of utilizing key competitive advantage. Furthermore, research methodologies including qualitative and quantitative methodologies are suggested for more rigorous international franchising research. Quantitative research needs more real data other than survey data which is usually respondent's judgment. In order to verify theory more rigorously, research based on real data is essential. However, real quantitative data is quite hard to get. The qualitative research other than single case study is also highly recommended. Since international franchising has limited number of applications, scientific research based on grounded theory and ethnography study can be used. Scientific case study is differentiated with single case study on its data collection method and analysis method. The key concept is triangulation in measurement, logical coding and comparison. Finally, it provides overall research direction for international franchising after summarizing research trend in Korea. International franchising research in Korea has two different types, one is for studying Korean franchisor going overseas and the other is for Korean franchisee of foreign franchisor. Among research on Korean franchisor, two common patterns are observed. First of all, they usually deal with success story of one franchisor. The other common pattern is that they focus on same industry and country. Therefore, international franchise research needs to extend their focus to broader subjects with scientific research methodology as well as development of new theory.