IEMEK Journal of Embedded Systems and Applications (대한임베디드공학회논문지)

Institute of Embedded Engineering of Korea (대한임베디드공학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Implementation of Parking Guidance System Based on Internet of Things(IoT) Using Q-learning Model

Q-learning 모델을 이용한 IoT 기반 주차유도 시스템의 설계 및 구현

  • Received : 2016.05.02
  • Accepted : 2016.05.27
  • Published : 2016.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes an optimal dynamic resource allocation method in IoT (Internet of Things) parking guidance system using Q-learning resource allocation model. In the proposed method, a resource allocation using a forecasting model based on Q-learning is employed for optimal utilization of parking guidance system. To demonstrate efficiency and availability of the proposed method, it is verified by computer simulation and practical testbed. Through simulation results, this paper proves that the proposed method can enhance total throughput, decrease penalty fee issued by SLA (Service Level Agreement) and reduce response time with the dynamic number of users.

Keywords

References

  1. K.S. Song, J.C. Yoo, "A Design and Implementation of Parking Guidance and Information System in U-city," Journal of The Korean Institute of Communications and Information Sciences, Vol. 35, No. 6, pp. 940-947, 2010 (in Korean).
  2. J. Belissent, "Getting Clever about Smart Cities: New Opportunities Require New Business Models," Forrester Research Incorporation, 2010.
  3. S.A. Mahmud, G.M. Khan, M. Rahman, H. Zafar, "A Servey of Intelligent Car Parking System," Journal of Applied Research and Technology, Vol. 11, No. 5, pp. 714-726, 2013. https://doi.org/10.1016/S1665-6423(13)71580-3
  4. T. Rajabioun, P.A. Ioannou, "On-street and Off-street Parking Availability Prediction Using Multivariate Spatiotemporal Models," IEEE Transactions on Intelligent Transportation Systems, Vol. 16, No. 5, pp. 2913-2924, 2015. https://doi.org/10.1109/TITS.2015.2428705
  5. G. Yan, W. Yang, D.B. Rawat, S. Olariu, "Smartparking: A Secure and Intelligent Parking System," IEEE Intelligent Transportation Systems Magazine, Vol. 3, No. 1, pp. 18-30, 2011. https://doi.org/10.1109/MITS.2011.940473
  6. Y.H. Choi, Y.J. Lim, J.S. Park "Reinforcement Learning Approach for Resource Allocation in Cloud Computing," Journal of The Korean Institute of Communications and Information Sciences, Vol. 40, No. 4 pp. 653-658, 2015 (in Korean). https://doi.org/10.7840/kics.2015.40.4.653
  7. Y. Geng, C.G. Cassandras, "New "Smart Parking" System Based on Resource Allocation and Reservations," IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 3, pp. 1129-1139, 2013. https://doi.org/10.1109/TITS.2013.2252428
  8. A. Kianpisheh, N. Mustaffa, P. Limtrairut, P. Keikhosrokiani, "Smart Parking System (SPS) Architecture Using Ultrasonic Detector," Journal of Software Engineering and Its Applications, Vol. 6, No. 3, 2012.
  9. J. Yick, B. Mukherjee, D. Ghosal, "Wireless Sensor Network Survey," Computer Networks, Vol. 52, pp. 2292-2330, 2008. https://doi.org/10.1016/j.comnet.2008.04.002
  10. A. Dunkels, F. Osterlind, Z. He, "An Adaptive Communication Architecture for Wireless Sensor Networks," Proceeding of 5th ACM Conference Networked Embedded Sensor System, pp. 335-349, 2007.
  11. "Guidelines for Construction of Cloud Data Centers," Telecommunications Technology Association, 2013 (in Korean).
  12. J. Hui, D. Culler, "IP is Dead, Long Live IP for Wireless Sensor Networks," Proceeding of 6th ACM Conference Networked Embedded Sensor System, pp. 15-28, 2008.
  13. H.T. Kim, H.N. Kim, "Control Algorithm for Virtual Machine-level Fairness in Virtualized Cloud Data Center," Journal of The Korean Institute of Communications and Information Sciences, Vol. 38, No. 6, pp. 512-520, 2013 (in Korean).
  14. R.E. Parr, "Hierarchical Control and Learning for Markov Decision Processes," Ph.D. dissertation, University of California, 1998.
  15. C.J.C.H. Watkins, P. Dayan, "Q-Learning," Machine Learning, Vol. 8, pp. 279-292, 1992.
  16. Y. Chen, C. Chang, F. Ren, "Q-learning-based Multirate Transmission Control Scheme for RRM in Multimedia WCDMA Systems," IEEE Transactions on Vehicular Technology, Vol. 53, No. 1, pp. 38-48, 2004. https://doi.org/10.1109/TVT.2003.822330
  17. L. Hu, X.L. Che, S.Q. Zheng, "Online System for Grid Resource Monitoring and Machine Learning-based Prediction," IEEE Transactions Parallel Distributed Systems, Vol. 23, No. 1, 518 pp. 134-145, 2012. https://doi.org/10.1109/TPDS.2011.108
  18. Y.J. Kim, "Modified Q-learning for Intelligent System," Journal of The Korean Institute of Communications and Information Sciences, Vol. 33, No. 2, pp. 82-87, 2008 (in Korean).
  19. J. Rao, X. Bu, C.Z. Xu, K. Wang, "A Distributed Self-learning Approach for Elastic Provisioning of Virtualized Cloud Resources," IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 45-54, 2011.
  20. Y. Jiang, C. Perng, T. Li, R.N. Chang, "Cloud Analytics for Capacity Planning and Instant VM Provisioning," IEEE Transactions Network and Service Management, Vol. 10, No. 3, pp. 312-325, 2013. https://doi.org/10.1109/TNSM.2013.051913.120278
  21. H.H. Kim, W.S. Kim, Y.W. Kim, "A Pattern-based Prediction Model for Dynamic Resource Provisioning in Cloud Environment," Korean Society for Internet Information, Vol. 5, No. 10, pp. 1712-1732, 2011 (in Korean).
  22. M. Riedl, H. Zipper, T. Bangemann, M. Meier, "Distributed automation system supports process monitoring and control," Industrial Electronics, 2011 IEEE International Symposium on Industrial Electronics, pp. 711-1715, 2011.