Parallelization of A Load balancing Algorithm for Parallel Computations

병렬계산을 위한 부하분산 알고리즘의 병렬화

  • Published : 2004.07.01

Abstract

In this paper, we propose an approach to parallelize a load balancing algorithm that was shown to be very effective in distributing workload for parallel computations. Load balancing algorithms are required in executing parallel program efficiently As a parallel computation model, we used dynamically growing tree structure that can be found in many application problems. The load balancing algorithm tries to balance the workload among processors while keeping the communication cost under certain limit. We show how the load balancing algorithm is effectively parallelized on mesh and hypercube interconnection networks, and analyzed the time complexity for each case to show that parallel algorithm actually reduced the various overhead.

본 논문에서는 병렬프로그램을 효율적으로 수행하는데 필수적인 부하분산을 위한 기존 알고리즘의 부하분산 오버헤드를 최소화하기 위하여 이 알고리즘의 병렬화 방법을 제시한다. 병렬계산 모델로는 동적으로 변하는 트리구조를 들었으며 이러한 계산은 많은 응용분야에서 찾아볼 수 있다. 부하분산 알고리즘은 통신비용을 정해진 한도 이내로 유지하면서 프로세서간 계산부하를 최대한 균등하게 분산시키고자 시도한다. 이 알고리즘이 메쉬와 하이퍼큐브 구조에서 어떻게 병렬화 될 수 있는가를 상세히 보이고 각각의 경우에 대하여 시간상 복잡도를 분석하여 기존의 알고리즘보다 여러가지 오버헤드가 개선되었음을 증명한다.

Keywords

References

  1. Parallel and Distributed Computation D. P. Bertsekas;J. N. Tsitsiklis
  2. Proceedings of the International Parallel and Distributed Processign Symposium Load Balancing Scatter Operations for Grid Computing S. Genaud;A. Giersch;F. Vivien
  3. Korea Information Processing Society Journal v.8-A no.4 An Efficient Dynamic Load Balancing Strategy for Tree-structured Computations I. Hwang;D. Hong
  4. IEEE Transactions on Parallel and Distributed Systems v.15 no.6 Mapping and Load Balancing Iterative Computations A. Legrand;H. Renard;Y. Robert
  5. IEEE Transactions on Parallel and Distributed Systems v.7 no.3 Dynamic Partitioning of Non-Uniform Structured Workloads with Spacefilling Curves J. R. Pilkington;S. B. Baden
  6. IEEE Transactions on Parallel and Distributed Systems v.13 no.2 Efficient parallel execution of irregular recursive programs L. Prechelt;S. U. Hanssgen
  7. Journal of Parallel and Distributed Computing v.47 no.2 Parallel Dynamic Graph Partitioning for Adaptive Unstructured Meshes C. Walshaw;M. Cross;M. G. Everett