Efficient Content-based Load Distribution for Web Server Clusters

웹 서버 클러스터를 위한 효율적인 내용 기반의 부하 분배

  • 정지영 (명지전문대학 컴퓨터정보과) ;
  • 김성수 (아주대학교 정보및컴퓨터공학부)
  • Published : 2005.02.01

Abstract

A cluster consists of a collection of interconnected stand-alone computers working together and provides a high-availability solution in application area such as web services or information systems. Content-based load distribution for web server clusters uses the detailed data found in the application layer to intelligently route user requests among web servers. In this paper, we propose a content-based load distribution algorithm that considers cache hit and load information of the web servers under the web server clusters. In addition, we expand this algorithm in order to manage user requests for dynamic file. Specially, our algorithm does not keep track of any frequency of access information or try to model the contents of the caches of the web servers.

클러스터 구조는 고가용도와 고성능 그리고 확장성을 요구하는 웹 서비스나 정보시스템 같은 응용 분야에서 저 비용으로 유용하게 사용 가능하다. 웹 서버 클러스터의 내용 기반 분배는 각각의 웹 서버들 사이에서 지능적으로 사용자 요구를 전달하기 위해 애플리케이션 계층에서 알려진 상세한 데이터를 이용한다. 본 논문에서는 웰 서버 클러스터 시스템을 대상으로 캐시의 적중과 각 서버의 부하 상태를 고려한 효율적인 내용 기반의 부하 분배를 수행하고 사용자의 동적인 문서 요구를 수용할 수 있도록 하는 알고리즘을 제안하였다. 특히 제안된 알고리즘은 부하 분배기로 하여금 각 서버에 있는 캐쉬의 내용을 모델링 하기 위한 시도나 웹 문서에 대한 사용자 접근 확률을 계산하기 위한 오버헤드가 없다.

Keywords

References

  1. R. Buyya, High Performance Cluster Computing: Architectures and Systems, Chapter 1, Prentice-Hall, 1999
  2. J.Y. Chung and S. Kim, 'Efficient Memory Page Peplacement on Web Server Clusters,' Lecture Notes in Computer Science, Vol. 2331, pp, 1042-1050, Apr. 2002
  3. G. Hunt, E, Nahum, and J. Tracey. Enabling Content-based Load Distribution for Scalable Services. Technical report, IBM T.J. Watson Research Center, May 1997.
  4. 유찬수, '리눅스 클러스터링', 정보과학회지, 제 18권, 제2호, pp. 33-39, 2000. 2
  5. V. Cardellini, M. Colajanni and P.S. Yu, 'Dynamic Load Balancing on Web-server Systems,' IEEE Internet Computing, pp. 28-39, May 1999 https://doi.org/10.1109/4236.769420
  6. H. Zhu, T Yang, Q. Zheng, D. Watson, O.H. Ibarra and T Smith, 'Adaptive Load Sharing for Clustered Digital Library Servers,' Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing, pp. 28-31, July 1998 https://doi.org/10.1109/HPDC.1998.709977
  7. A. Wong and T. Dillon, 'Load Balancing to Improve Dependability and Performance for Program Objects in Distributed Real-time Co-operation over the Internet,' The 3rd IEEE International Symposium on Object-Oriented Real-time Distributed Computing, Mar. 2000
  8. 김성수, 정지영, '웹서버 클러스터를 위한 효율적인 부하분배 알고리즘,' 한국정보과학회논문지(정보통신), 한국정보과학회, 제 28권, 제 4호, pp. 550-558, 2001. 12
  9. C.-S. Yang and M.-Y. Luo, 'Efficient Support for Content-based Routing in Web Server Clusters,' Proceedings of the 2nd USENIX Symposium on Internet Technologies and Systems, Oct. 1999
  10. T. Schroeder, S. Goddard and B. Ramamurthy, 'Scalable Web Server Clustering Technologies,' IEEE Network, pp. 38-45, May 2000 https://doi.org/10.1109/65.844499
  11. V.S. Pai, M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel and E. Nahum, 'Locality-aware Request Distribution in Cluster-based Network Servers,' Proceedings of the 8th ACM Conference on Architecture Support for Programming Languages, Oct. 1998 https://doi.org/10.1145/291069.291048
  12. A. Cohen, S. Rangarajan and H. Slye, 'On the Performance of TCP Splicing for URL-aware Redirection,' Proceedings of the 2nd USENIX Symposium on Internet Technologies and Systems, Oct. 1999
  13. M. Aron, et aI., 'Scalable Content-based Network Servers,' Proceedings of the 2000 Anual USENIX Technical Conference, June 2000
  14. O.P. Damani, et aI., 'ONE-IP: Techniques for Hosting a Service on a Cluster of Machines,' Proceedings of the 6th International World Wide Web Conference, Apr. 1997 https://doi.org/10.1016/S0169-7552(97)00030-5
  15. G.D.H. Hunt et aI., 'Network Dispatcher: A connection Router for Scalable Internet Services,' Proceedings of the 7th International World Wide Web Conference, Apr. 1998 https://doi.org/10.1016/S0169-7552(98)00088-9
  16. E. Anderson et aI., 'The Magicrouter: an Application of Fast Packet Interposing,' The 2nd Symposium Operational System Design and Implementation, May 1996
  17. Cisco Systems Inc. LocalDirector, http://www.cisco.com
  18. E. Levy- Abegnoli et aI., 'Design and Performance of a Web Server Accelelator,' IEEE INFOCOM, 1999 https://doi.org/10.1109/INFCOM.1999.749261
  19. V. Cardellini et al., 'The State of the Art in Locally Distributed Web-server Systems,' ACM Computing Surveys, Vol. 34, No.2, June 2002 https://doi.org/10.1145/508352.508355
  20. M. Andreolini, M. Colajanni and M. Nuccio, 'Scalability of content-aware Server Switches for Cluster-based Web Information Systems,' Proceedings of the 12th International World Wide Web Conference, May 2003
  21. A. Carzaniga and A.L. Wolf, 'Content-based Networking: A New Communication Infrastructure,' Lecture Notes in Computer Science, Vol. 2538, pp. 59-68, 2002 https://doi.org/10.1007/3-540-36257-6_6
  22. X. Zhang, M. Barrientos, J.B. Chen and M. Seltzer, 'HACC: An Architecture for Clusterbased Web Servers,' Proceedings of the 3rd USENIX Windows NT Symposium, July 1999
  23. E. Casalicchio and M. Colaianni, 'A Client-aware Dispatching Algorithm for Web Clusters Providing Multiple Services,' Proceedings of the 10th International World Wide Web Conference, May 2001 https://doi.org/10.1145/371920.372155
  24. S. Venkataraman, M. Livny and J. Naughton, 'Memory Management for Scalable Web Data Servers,' 13th International Conference on Data Engineering, Apr. 1997