DOI QR코드

DOI QR Code

대용량 LiDAR 데이터 보간을 위한 MPI 격자처리 과정의 작업량 발란싱 기법

Task Balancing Scheme of MPI Gridding for Large-scale LiDAR Data Interpolation

  • 투고 : 2014.07.09
  • 심사 : 2014.08.11
  • 발행 : 2014.09.30

초록

본 논문은 MPI를 이용하여 LiDAR 데이터를 처리하는 방식에서 각 코어간의 통신을 최소화하고 작업량 발란싱을 위해 격자크기를 다양하게 하여 LiDAR 데이터의 보간 처리 성능을 향상시키는 기법을 제안한다. 항공기 등을 통해 얻어진 LiDAR 데이터는 3차원 공간정보로서 정밀한 관측 성능과 거리 정보를 포함하여 지리정보, 기상관측 등 다양한 분야에 활용되고 있다. 하지만 필요보다 높은 해상도의 데이터를 사용하거나, 비지표정보를 포함하는 경우를 위해 획득된 LiDAR 데이터를 필터링 하여 사용하게 되며, 필터링된 데이터를 사용하기 위해서는 주변을 탐색할 수 있는 자료구조를 이용해서 보간법을 수행하여야만 데이터가 재구성된다. 데이터의 규모에 비례하여 처리시간도 증가하기 때문에 이를 해결하기 위해 MPI를 이용한 고성능 병렬 처리 방식 연구가 활발히 진행되고 있다. 그러나 기존에 병렬 처리를 사용한 기존의 방식은 각 노드에 할당된 데이터의 밀도가 달라 성능 저하가 생길 수 있으며, 경계값 불일치를 해결하기 위해 노드간의 통신이 많아지는 단점을 가진다. 제안한 방법의 효과를 검증하기 위해 기존 연구에서 제안된 방식들과 처리 성능을 비교하였으며, 데이터에 따라 최대 4.2배의 실행시간 단축되는 것을 확인하였다.

In this paper, we propose MPI gridding algorithm of LiDAR data that minimizes the communication between the cores. The LiDAR data collected from aircraft is a 3D spatial information which is used in various applications. Since there are many cases where the LiDAR data has too high resolution than actually required or non-surface information is included in the data, filtering the raw LiDAR data is required. In order to use the filtered data, the interpolation using the data structure to search adjacent locations is conducted to reconstruct the data. Since the processing time of LiDAR data is directly proportional to the size of it, there have been many studies on the high performance parallel processing system using MPI. However, previously proposed methods in parallel approach possess possible performance degradations such as imbalanced data size among cores or communication overhead for resolving boundary condition inconsistency. We conduct empirical experiments to verify the effectiveness of our proposed algorithm. The results show that the total execution time of the proposed method decreased up to 4.2 times than that of the conventional method on heterogeneous clusters.

키워드

참고문헌

  1. Arya Sunil, David M. Mount, and Onuttom Narayan, "Accounting for boundary effects in nearest-neighbor searching," Discrete & Computational Geometry, Vol. 16, No. 2, pp. 155-176, February 1996. https://doi.org/10.1007/BF02716805
  2. Choe Jonggeun. "Geostatistics," Sigma Press, p.139, 2007.
  3. Finkel Raphael A. and Jon Louis Bentley. "Quad trees a data structure for retrieval on composite keys," Acta informatica, Vol. 4, No. 1 pp.1-9, April 1974. https://doi.org/10.1007/BF00288933
  4. Friedman Jerome H., Jon Louis Bentley and Raphael Ari Finkel, "An algorithm for finding best matches in logarithmic expected time," ACM Transactions on Mathematical Software, Vol. 3, No. 3, pp.209-226, September 1977. https://doi.org/10.1145/355744.355745
  5. Han S. H., Heo J., Sohn H. G. and Yu K, "Parallel processing method for airborne laser scanning data using a pc cluster and a virtual grid," Sensors, Vol. 9, No. 4, pp.2555-2573, April 2009. https://doi.org/10.3390/s90402555
  6. He Fei, Jinyun Fang and Wan Zou, An effective method for interpolation, Geoinformatics, 19th International Conference on. IEEE, pp.1-6, Shanghai, China, June 2011.
  7. MPI Standard Version 3.0, http://www.mpi -forum.org/docs/mpi-3.0/mpi30-report.pdf
  8. Hongchao Ma and Zongyue Wang. "Distributed data organization and parallel data retrieval methods for huge laser scanner point clouds," Computers & Geosciences, Vol. 37, No. 2, pp.193-201, February 2011. https://doi.org/10.1016/j.cageo.2010.05.017
  9. Huang F., Liu D., Tan X., Wang J., Chen Y. and He B., "Explorations of the implementation of a parallel IDW interpolation algorithm in a Linux cluster-based parallel GIS," Computers & Geosciences, Vol. 37, No. 4, pp.426-434, April 2011. https://doi.org/10.1016/j.cageo.2010.05.024
  10. Oliver Margaret, Richard Webster and John Gerrard. "Geostatistics in physical geography. Part I: theory," Transactions of the Institute of British Geographers, Vol. 14, No. 3, pp.259-269, April 1989. https://doi.org/10.2307/622687
  11. Protopopov Boris V. and Anthony Skjellum., "A multithreaded message passing interface (MPI) architecture: Performance and program issues," Journal of Parallel and Distributed Computing, Vol. 61, No. 4, pp.449-466, April 2001. https://doi.org/10.1006/jpdc.2000.1674
  12. Welch Terry A., "Bounds on information retrieval efficiency in static file structures," Project MAC, Massachusetts Institute of Technology, pp. 140, 1971.