A Localized Adaptive QoS Routing using TD(${\lambda}$) method

TD(${\lambda}$) 기법을 사용한 지역적이며 적응적인 QoS 라우팅 기법

  • 한정수 (신구대학 인터넷정보과)
  • Published : 2005.05.01


In this paper, we propose a localized Adaptive QoS Routing using TD method and evaluate performance of various exploration methods when path is selected. Expecially, through extensive simulation, the proposed routing algorithm and exploration method using Exploration Bonus are shown to be effective in significantly reducing the overall blocking probability, when compared to the other path selection method(exploration method), because the proposed exploration method is more adaptive to network environments than others when path is selected.


  1. X.Yuan and A.Saifee, 'Path Selection Methods for Localized Quality of Service Routing', Technical Report, TR-010801, Dept of Computer Science, Florida State University, July, 2001
  2. Srihari Nelakuditi, Zhi-Li Zhang and Rose P.Tsang, 'Adaptive Proportional Routing: A Localized QoS Routing Approach', In IEEE Infocom, April 2000
  3. Srihari Nelakuditi, Zhi-Li Zhang, 'A Localized Adaptive Proportioning Approach to QoS Routing', IEEE Communications Magazine, June 2002
  4. Y.Liu, C.K. Tham and TCK. Hui, 'MAPS: A Localized and Distributed Adaptive Path Selection in MPLS Networks' in Proceedings of 2003 IEEE Workshop on High Performance Switching and Routing, Torino, Italy, June 2003, pp.24-28
  5. Yvn Tpac Valdivia, Marley M. Vellasco, Marco A. Pacheco 'An Adaptive Network Routing Strategy with Temporal Differences', Inteligencia Artificial, Revista Lberoamericana de Inteligencia Aritificial, No 12(2001), pp. 85-91
  6. Leslie Pack Kaelbling, Michael L. Littman, Andrew W.Moore, 'Reinforcement Learning: A Survey', Journal of Artificial Intelligence Research 4, 1996, pp 237-285
  7. P.Marbach, O.Mihatsch, and J.N. Tsitsildis, 'Call Admission Control and Routing in Integrated Service Networks Using Neuro-Dynamic Programming', IEEE Journal on Selected Areas in Communications, Vol. 18, No.2, Feb 2000, pp.197-208 https://doi.org/10.1109/49.824797
  8. Sutton, R.S. 'Learning to predict by the method of temporal differences' Machine Learning 3. 1988, pp.9-44