DOI QR코드

DOI QR Code

Development of Music Recommendation System based on Customer Sentiment Analysis

소비자 감성 분석 기반의 음악 추천 알고리즘 개발

  • 이승준 (닐슨 코리아 CPS Input Operation) ;
  • 서봉군 (국민대학교 비즈니스 IT 전문대학원) ;
  • 박도형 (국민대학교 경영정보학부/비즈니스 IT 전문대학원)
  • Received : 2018.12.18
  • Accepted : 2018.12.24
  • Published : 2018.12.31

Abstract

Music is one of the most creative act that can express human sentiment with sound. Also, since music invoke people's sentiment to get empathized with it easily, it can either encourage or discourage people's sentiment with music what they are listening. Thus, sentiment is the primary factor when it comes to searching or recommending music to people. Regard to the music recommendation system, there are still lack of recommendation systems that are based on customer sentiment. An algorithm's that were used in previous music recommendation systems are mostly user based, for example, user's play history and playlists etc. Based on play history or playlists between multiple users, distance between music were calculated refer to basic information such as genre, singer, beat etc. It can filter out similar music to the users as a recommendation system. However those methodology have limitations like filter bubble. For example, if user listen to rock music only, it would be hard to get hip-hop or R&B music which have similar sentiment as a recommendation. In this study, we have focused on sentiment of music itself, and finally developed methodology of defining new index for music recommendation system. Concretely, we are proposing "SWEMS" index and using this index, we also extracted "Sentiment Pattern" for each music which was used for this research. Using this "SWEMS" index and "Sentiment Pattern", we expect that it can be used for a variety of purposes not only the music recommendation system but also as an algorithm which used for buildup predicting model etc. In this study, we had to develop the music recommendation system based on emotional adjectives which people generally feel when they listening to music. For that reason, it was necessary to collect a large amount of emotional adjectives as we can. Emotional adjectives were collected via previous study which is related to them. Also more emotional adjectives has collected via social metrics and qualitative interview. Finally, we could collect 134 individual adjectives. Through several steps, the collected adjectives were selected as the final 60 adjectives. Based on the final adjectives, music survey has taken as each item to evaluated the sentiment of a song. Surveys were taken by expert panels who like to listen to music. During the survey, all survey questions were based on emotional adjectives, no other information were collected. The music which evaluated from the previous step is divided into popular and unpopular songs, and the most relevant variables were derived from the popularity of music. The derived variables were reclassified through factor analysis and assigned a weight to the adjectives which belongs to the factor. We define the extracted factors as "SWEMS" index, which describes sentiment score of music in numeric value. In this study, we attempted to apply Case Based Reasoning method to implement an algorithm. Compare to other methodology, we used Case Based Reasoning because it shows similar problem solving method as what human do. Using "SWEMS" index of each music, an algorithm will be implemented based on the Euclidean distance to recommend a song similar to the emotion value which given by the factor for each music. Also, using "SWEMS" index, we can also draw "Sentiment Pattern" for each song. In this study, we found that the song which gives a similar emotion shows similar "Sentiment Pattern" each other. Through "Sentiment Pattern", we could also suggest a new group of music, which is different from the previous format of genre. This research would help people to quantify qualitative data. Also the algorithms can be used to quantify the content itself, which would help users to search the similar content more quickly.

음악은 인간의 감성을 소리로 표현하는 창조적 예술 행위이다. 음악은 사람들의 기분을 우울하게 혹은 기쁘게 변화시킬 수 있다. 따라서 음악을 감상하는 데 있어 감성은 소비자에게 적합한 음악을 찾고 들려주는 데 매우 중요한 요소인데, 다양한 음원 서비스에서 제공하는 추천 알고리즘은 사용자의 기본적인 정보(성별, 나이, 감상 횟수 등)와 사용자의 플레이 기록에 기반한 음악 추천 방식을 주로 사용하고 있다. 본 연구에서는 음악을 감상하는 개인의 감성을 고려하여 각 음원이 가지는 고유의 감성을 기본으로 한 음악 추천 알고리즘을 제안해 보고자 한다. 구체적으로, 사용자들이 자주 듣는 음악과 그렇지 않은 음악을 기준으로 '감정 패턴'을 추출 후 상관관계를 확인하고자 하며, 앞선 결과를 기반으로 사용자들이 원하는 노래에 대한 검색과 사용자 감성 기반 추천 방법을 도출해내보고자 한다. 이를 위해 본 연구에서는 사례기반추론 기법을 이용하여 사람들이 주로 듣는 음악과 비슷한 '감성 패턴'을 갖는 특정한 곡을 추천해주는 알고리즘을 개발하였다. 먼저, 분석에 필요한 감정 형용사를 정리하여 변수화 시키고, 의미 있는 것끼리 묶어 음악 감성지수를 개발하였고, 분석의 대상이 될 음원에 대해 고유의 감성지수 점수를 측정하였다. 마지막으로 도출된 점수의 결과를 통해 유사한 감정 패턴이 나오는 곡들을 유사 곡 리스트로 분류하고 사용자들에게 추천하는 과정을 거친다. 앞선 일련의 과정을 거처 도출된 결과는 음원 추천 시스템뿐만 아니라, 인기 있는 곡과 아닌 곡에 영향을 미치는 변수 도출 및 음원 출시 전, 해당 곡의 스트리밍 수 예측 모형 구축 등 다양한 용도로 사용될 수 있을 것으로 기대한다.

Keywords

JJSHBB_2018_v24n4_197_f0001.png 이미지

Basic structure of fingerprinting system

JJSHBB_2018_v24n4_197_f0002.png 이미지

Categorization of collected emotional adjectives

JJSHBB_2018_v24n4_197_f0003.png 이미지

SWEMS Pattern by song genre - Dance

JJSHBB_2018_v24n4_197_f0004.png 이미지

SWEMS Pattern by song genre - Dance

JJSHBB_2018_v24n4_197_f0005.png 이미지

SWEMS Pattern by song genre – Girl’s POP

Selection of emotional adjectives through previous research

JJSHBB_2018_v24n4_197_t0001.png 이미지

Melon weekly chart Top 20 (March 21, 2016 - March 27, 2016)

JJSHBB_2018_v24n4_197_t0002.png 이미지

Selection of emotional adjectives through social traffic

JJSHBB_2018_v24n4_197_t0003.png 이미지

List of music charts by genre (Rank: 1~4)

JJSHBB_2018_v24n4_197_t0004.png 이미지

Selection of emotional adjectives through qualitative interview

JJSHBB_2018_v24n4_197_t0005.png 이미지

List of categorized final emotional adjectives

JJSHBB_2018_v24n4_197_t0006.png 이미지

Result of factor analysis

JJSHBB_2018_v24n4_197_t0007.png 이미지

Matrix with principal component formula

JJSHBB_2018_v24n4_197_t0008.png 이미지

Distance Matrix by Euclidian Value

JJSHBB_2018_v24n4_197_t0009.png 이미지

Comparison hit-ratio nearby songs

JJSHBB_2018_v24n4_197_t0010.png 이미지

References

  1. Bae, S.D., and D.-H. Park, "The Effect of Mobile Advertising Platform through Big Data Analytics: Focusing on Advertising, and Media Characteristics," Journal of Intelligence and Information Systems, Vol.24, No.2(2018), 37-57. https://doi.org/10.13088/JIIS.2018.24.2.037
  2. Choi, H., J., Lee, M.-U., Kim, J., Kim, H., Cho, H., Lee, and K., Yoon, "Music Recommendation System Based on User Emotion and Music Mood," Conference of The Korean Institute of Broadcast and Media Engineers, (2010), 142-145.
  3. Choi, Y., and D.-H. Park, "Development of Yóukè Mining System with Yóukè's Travel Demand and Insight Based on Web Search Traffic Information," Journal of Intelligence and Information Systems, Vol.23, No.3(2017), 55-175.
  4. Cohen, J. B., M. T., Pham, and E. B., Andrade, "The Nature and Role of Affect in Consumer Behavior," in Handbook of Consumer Psychology, C.P. Haugtvedt, P. Herr, and F. Kardes, eds. Mahwah, NJ: Lawrence Erlbaum Associates, 2007.
  5. Ha, E., Y. Kim, and E. Hwang, "A Categorization Scheme Tag-based Folksonomy Images for Efficient Image Retrieval," KIISE Transaction on Computing Practices, Vol.22, No.6(2016), 290-295. https://doi.org/10.5626/KTCP.2016.22.6.290
  6. Haitsma, J., and T., Kalker, "A highly robust audio fingerprinting system with an efficient search strategy," Journal of New Music Research, Vol.32, No.2(2003), 211-221. https://doi.org/10.1076/jnmr.32.2.211.16746
  7. Jack, R. E., O. G. Garrod, H. Yu, R. Caldara, and P. G. Schyns, "Facial expressions of emotion are not culturally universal,". Proceedings of the National Academy of Sciences, Vol.109, No.19(2012), 7241-7244. https://doi.org/10.1073/pnas.1200155109
  8. Jang D. and S.-P. Lee "Audio Fingerprint Based on Combining Binary Fingerprints," Journal of broadcast engineering, Vol.17, No.4 (2012), 659-669. https://doi.org/10.5909/JBE.2012.17.4.659
  9. Kang, T., and D.-H. Park, "The Effect of Expert Reviews on Consumer Product Evaluations: A Text Mining Approach," Journal of Intelligence and Information Systems, Vol.22, No.1(2016), 63-82. https://doi.org/10.13088/jiis.2016.22.1.063
  10. Kang, T., D.-H. Park, and I. Han, "Beyond the numbers: The effect of 10-K tone on firms' performance predictions using text analytics," Telematics and Informatics, Vol.35, No.2 (2018), 370-381. https://doi.org/10.1016/j.tele.2017.12.014
  11. Kim, K.-W., and D.-H. Park, "Design Evaluation Model Based on Consumer Values : Three-step Approach from Product Attributes, Perceived Attributes, to Consumer Values," Journal of Intelligence and Information Systems, Vol.23, No.4(2017), 57-76. https://doi.org/10.13088/JIIS.2017.23.4.057
  12. Kim, K.-W., and D.-H. Park, "Emoticon by Emotions: The Development of an Emoticon Recommendation System Based on Consumer Emotions," Journal of Intelligence and Information Systems, Vol.24, No.1(2018), 227-252. https://doi.org/10.13088/JIIS.2018.24.1.227
  13. Kim, S., "A Study on the expression aspect in emoticon," Korean Semantics, Vol.38(2012), 1-25.
  14. Kim, Y., and D.-H. Park, "A Study on the Consumers' Knowledge Structure of Innovative Products through Product Category Concept Map: Focusing on 3D and Smart TV," Entrue Journal of Information Technology, Vol.12, No.3(2013), 181-197.
  15. Kiu, C. C. and Tsui, E. "TaxoFolk: A hybrid taxonomy-folksonomy structure for knowledge classification and navigation," Expert Systems with Applications, Vol.38, No.5(2011), 6049-6058. https://doi.org/10.1016/j.eswa.2010.11.014
  16. Laniado, D., D. Eynard and M. Colombetti, "Using WordNet to turn a folksonomy into a hierarchy of concepts," In Semantic Web application and perspectives - fourth italian semantic Web workshop, (2007), 192-201.
  17. Lee, D., T. Kang, and D.-H. Park, "The Research on PC-based Versus Mobile Device-based Shopping Behavior Depending on Consumer Purchase Decision Process: Focusing on Task-Technology Fit Theory," Entrue Journal of Information Technology, Vol.13, No.3(2014), 107-122.
  18. Park, D.-H., "The Development of Travel Demand Nowcasting Model Based on Travelers' Attention: Focusing on Web Search Traffic Information," The Journal of Information Systems, Vol.26, No.3(2017a), 171-185. https://doi.org/10.5859/KAIS.2017.26.1.171
  19. Park, D.-H., "Virtuality as a Psychological Distance: The Strategy for Advertisement Message Appeal Depending on Virtuality," Journal of Information Technology Applications & Management, Vol.24, No.2 (2017b), 39-54. https://doi.org/10.21219/jitam.2017.24.2.039
  20. Park, D.-H., "Virtuality as a Psychological Distance and Temporal Distance: Focusing on the Effect of Product Information Type on Product Attitude," Knowledge Management Research, Vol.18, No.3(2017c), 163-178. https://doi.org/10.15813/kmr.2017.18.3.008
  21. Seo, B.-G., and D.-H. Park, "The Effect of Message Framing Depending on Psychological Ownership: Focusing on Information Security Behavior in Online Service," Knowledge Management Research, Vol.19, No.1(2018), 1-18. https://doi.org/10.15813/kmr.2018.19.1.001
  22. Sinclair, J., and M., Cardew-Hall, "The folksonomy tag cloud: when is it useful?," Journal of Information Science, Vol.34, No.1(2008), 15-29. https://doi.org/10.1177/0165551506078083
  23. Yoo, I.-J., B.-G. Seo, and D.-H. Park, "Smart Store in Smart City: The Development of Smart Trade Area Analysis System Based on Consumer Sentiments," Journal of Intelligence and Information Systems, Vol.24, No.1(2018), 25-52. https://doi.org/10.13088/JIIS.2018.24.1.025

Cited by

  1. 웹툰 콘텐츠 추천을 위한 소비자 감성 패턴 맵 개발 vol.25, pp.4, 2018, https://doi.org/10.13088/jiis.2019.25.4.067
  2. BERT를 활용한 속성기반 감성분석: 속성카테고리 감성분류 모델 개발 vol.26, pp.4, 2020, https://doi.org/10.13088/jiis.2020.26.4.001
  3. Research on Intelligent Recognition and Classification Algorithm of Music Emotion in Complex System of Music Performance vol.2021, pp.None, 2018, https://doi.org/10.1155/2021/4251827