DOI QR코드

DOI QR Code

Digital Signage System Based on Intelligent Recommendation Model in Edge Environment: The Case of Unmanned Store

  • Lee, Kihoon (Dept. of Computer Science and Engineering, Hoseo University) ;
  • Moon, Nammee (Dept. of Computer Science and Engineering, Hoseo University)
  • Received : 2020.03.19
  • Accepted : 2020.11.08
  • Published : 2021.06.30

Abstract

This paper proposes a digital signage system based on an intelligent recommendation model. The proposed system consists of a server and an edge. The server manages the data, learns the advertisement recommendation model, and uses the trained advertisement recommendation model to determine the advertisements to be promoted in real time. The advertisement recommendation model provides predictions for various products and probabilities. The purchase index between the product and weather data was extracted and reflected using correlation analysis to improve the accuracy of predicting the probability of purchasing a product. First, the user information and product information are input to a deep neural network as a vector through an embedding process. With this information, the product candidate group generation model reduces the product candidates that can be purchased by a certain user. The advertisement recommendation model uses a wide and deep recommendation model to derive the recommendation list by predicting the probability of purchase for the selected products. Finally, the most suitable advertisements are selected using the predicted probability of purchase for all the users within the advertisement range. The proposed system does not communicate with the server. Therefore, it determines the advertisements using a model trained at the edge. It can also be applied to digital signage that requires immediate response from several users.

Keywords

Acknowledgement

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (No. NRF-2021R1A2C2011966).

References

  1. K. S. Han, "Influence of brand experience by digital signage advertising types on engagement," Advertising Research, vol. 98, pp. 43-84, 2013.
  2. I. G. Shin and S. W. Shim, "The study on interactive outdoor advertising acceptance digital signage Stikus Wall case," The Korean Journal of Advertising and Public Relations, vol. 13, no. 4, pp. 390-432, 2011.
  3. Korea Creative Content Agency, "Digital signage based contents industry status and prospect," 2012 [Online]. Available: http://www.kocca.kr/knowledge/publication/focus/__icsFiles/afieldfile/2012/06/21/WacVcTyH2fFT.pdf.
  4. E. Y. Kim and H. Sung, "Consumer emotional experience and approach/avoidance behavior in the store environment with digital signage: moderating effect of perceived surprise," Journal of the Korean Society of Clothing and Textiles, vol. 41, no. 2, pp. 266-280, 2017. https://doi.org/10.5850/JKSCT.2017.41.2.266
  5. S. J. Choi, Y. Jo, and I. Sohn, "Intelligent digital signage system implementation based on emotion recognition algorithm," Journal of the Institute of Electronics and Information Engineers, vol. 56, no. 3, pp. 63-72, 2019. https://doi.org/10.5573/ieie.2019.56.3.63
  6. H. N. Lee, "A study on a plan of digital signage activation as an advertising medium," Journal of the Korean Society of Design Culture, vol. 17, no. 2, pp. 502-517, 2011.
  7. J. P. Hong, E. J. Kim, and H. Y. Park, "An analysis of determinants for artificial intelligence industry competitiveness," Journal of the Korea Institute of Information and Communication Engineering, vol. 21, no. 4, pp. 663-671, 2017. https://doi.org/10.6109/jkiice.2017.21.4.663
  8. Y. Xu and A. Helal, "Scalable cloud-sensor architecture for the Internet of Things," IEEE Internet of Things Journal, vol. 3, no. 3, pp. 285-298, 2016. https://doi.org/10.1109/JIOT.2015.2455555
  9. J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, "Internet of Things (IoT): a vision, architectural elements, and future directions," Future Generation Computer Systems, vol. 29, no. 7, pp. 1645-1660, 2013. https://doi.org/10.1016/j.future.2013.01.010
  10. K. Dolui and S. K. Datta, "Comparison of edge computing implementations: for computing, cloudlet and mobile edge computing," in Proceedings of 2017 Global Internet of Things Summit (GIoTS), Geneva, Switzerland, 2017, pp. 1-6.
  11. W. B. Daoud, M. S. Obaidat, A. Meddeb-Makhlouf, F. Zarai, and K. F. Hsiao, "TACRM: trust access control and resource management mechanism in fog computing," Human-centric Computing and Information Sciences, vol. 9, article no. 28, 2019. https://doi.org/10.1186/s13673-019-0188-3
  12. J. Choi and S. Ahn, "Scalable service placement in the fog computing environment for the IoT-based smart city," Journal of Information Processing Systems, vol. 15, no. 2, pp. 440-448, 2019. https://doi.org/10.3745/JIPS.03.0113
  13. P. K. Sharma, J. H. Ryu, K. Y. Park, J. H. Park, and J. H. Park, "Li-Fi based on security cloud framework for future IT environment," Human-centric Computing and Information Sciences, vol. 8, article no. 23, 2018. https://doi.org/10.1186/s13673-018-0146-5
  14. M. J. Kim, "The effects of tendency at digital natives on the adoption of digital signage: types of digital signage," Journal of Outdoor Advertising Research, vol. 12, no. 2, pp. 5-23, 2015. https://doi.org/10.16914/ar.2015.106.5
  15. R. E. Abraham and M. R. Kennedy, "Intelligent digital signage system based on gender identification," in Intelligent Embedded Systems. Singapore: Springer, 2018, pp. 251-262.
  16. U. Paquet and N. Koenigstein, "One-class collaborative filtering with random graphs," in Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil, 2013, pp. 999-1008.
  17. B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, "Item-based collaborative filtering recommendation algorithms," in Proceedings of the 10th International Conference on World Wide Web, Hong Kong, 2001, pp. 285-295).
  18. P. Vilakone, D. S. Park, K. Xinchang, and F. Hao, "An efficient movie recommendation algorithm based on improved k-clique," Human-centric Computing and Information Sciences, vol. 8, article no. 38, 2018. https://doi.org/10.1186/s13673-018-0161-6
  19. B. Yi, X. Shen, H. Liu, Z. Zhang, W. Zhang, S. Liu, and N. Xiong, "Deep matrix factorization with implicit feedback embedding for recommendation system," IEEE Transactions on Industrial Informatics, vol. 15, no. 8, pp. 4591-4601, 2019. https://doi.org/10.1109/tii.2019.2893714
  20. K. S. Park and N. M. Moon, "Multidimensional optimization model of music recommender systems," The KIPS Transactions: Part B, vol. 19, no. 3, pp. 155-164, 2012.
  21. M. H. Kwon, S. E. Kong, and Y. S. Choi, "Improving recurrent neural network based recommendations by utilizing embedding matrix," Journal of KIISE, vol. 45, no. 7, pp. 659-666, 2018. https://doi.org/10.5626/jok.2018.45.7.659
  22. G. Adomavicius and A. Tuzhilin, "Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions," IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 6, pp. 734-749, 2005. https://doi.org/10.1109/TKDE.2005.99
  23. X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T. S. Chua, "Neural collaborative filtering," in Proceedings of the 26th International Conference on World Wide Web, Perth, Australia, 2017, pp. 173-182.
  24. S. C. Oh and M. Choi, "A simple and effective combination of user-based and item-based recommendation methods," Journal of Information Processing Systems, vol. 15, no. 1, pp. 127-136, 2019. https://doi.org/10.3745/JIPS.01.0036
  25. F. R. Ribeiro and R. Jose, "Autonomous and context-aware scheduling for public displays using place-based tag clouds," in Ambient Intelligence and Future Trends-International Symposium on Ambient Intelligence (ISAmI 2010). Heidelberg: Springer, 2010, pp. 131-138.
  26. A. Rogers, E. David, T. R. Payne, and N. R. Jennings, "An advanced bidding agent for advertisement selection on public displays," in Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, Honolulu, HI, 2007, pp. 1-8.
  27. I. Elhart, N. Memarovic, M. Langheinrich, and E. Rubegni, "Control and scheduling interface for public displays," in Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, Zurich, Switzerland, 2013, pp. 51-54.
  28. Y. Taniguchi, "Content scheduling and adaptation for networked and context-aware digital signage: a literature survey," ITE Transactions on Media Technology and Applications, vol. 6, no. 1, pp. 18-29, 2018. https://doi.org/10.3169/mta.6.18
  29. H. T. Cheng, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, et al., "Wide & deep learning for recommender systems," in Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, 2016, pp. 7-10.
  30. Z. Huang, G. Shan, J. Cheng, and J. Sun, "TRec: an efficient recommendation system for hunting passengers with deep neural networks," Neural Computing and Applications, vol. 31, no. 1, pp. 209-222, 2019. https://doi.org/10.1007/s00521-018-3728-2
  31. G. Burel, H. Saif, and H. Alani, "Semantic wide and deep learning for detecting crisis-information categories on social media," in The Semantic Web - ISWC 2017. Cham, Switzerland: Springer, 2017, pp. 138-155.
  32. IDC, "IDC FutureScape: Worldwide Internet of Things 2016 Predictions," 2015 [Online]. Available: https://disruptivetechasean.com/big_news/idc-futurescape-worldwide-internet-of-things-2016-predictionson-demand/.
  33. PR Newswire, "Edge computing market worth 6.72 billion USD by 2022," 2017 [Online]. Available: https://www.prnewswire.com/news-releases/edge-computing-market-worth-672-billion-usd-by-2022-654465673.html.
  34. K. Panetta, "Gartner top 10 strategic technology trends for 2018," 2017 [Online]. Available: https://www.gartner.com/smarterwithgartner/gartner-top-10-strategic-technology-trends-for-2018/.
  35. D. Newman, "Top 10 trends for digital transformation in 2018," 2017 [Online]. Available: https://www.forbes.com/sites/danielnewman/2017/09/26/top-10-trends-for-digital-transformation-in2018/?sh=283e89a7293a.
  36. I. S. Yoo and J. Y. Lee, "Impact of fine dust on domestic retail sales," 2017 [Online]. Available: https://www.kiet.re.kr/kiet_web/?sub_num=9&state=view&idx=53547&ord=0&pageNo=10.
  37. J. H. Cho, E. J. Cha, and Y. J. Kim, "The effect on the participatory action of leisure activity participants cognition on fine dust problem," Journal of Leisure Studies, vol. 16, no. 3, pp. 1-19, 2018. https://doi.org/10.22879/SLOS.2018.16.3.1
  38. National Center for Biotechnology Information [Online]. Available: http://www.ncbi.nlm.nih.gov.
  39. A. Kennedy and D. Inkpen, "Sentiment classification of movie reviews using contextual valence shifters," Computational Intelligence, vol. 22, no. 2, pp. 110-125, 2006. https://doi.org/10.1111/j.1467-8640.2006.00277.x
  40. J. S. Song and S. W. Lee, "Automatic construction of positive/negative feature-predicate dictionary for polarity classification of product reviews," Journal of KIISE: Software and Applications, vol. 38, no. 3, pp. 157-168, 2011.
  41. O. Barkan and N. Koenigstein, "Item2vec: neural item embedding for collaborative filtering," in Proceedings of 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP), Vietri sul Mare, Italy, 2016, pp. 1-6.
  42. Q. Le and T. Mikolov, "Distributed representations of sentences and documents," in Proceedings of the 31th International Conference on Machine Learning (ICML), Beijing, China, 2014, pp. 1188-1196.