Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Survey on 3D Surface Reconstruction

  • Khatamian, Alireza (Dept. of Computer Science, The University of Georgia) ;
  • Arabnia, Hamid R. (Dept. of Computer Science, The University of Georgia)
  • Received : 2016.09.05
  • Accepted : 2016.09.23
  • Published : 2016.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The recent advent of increasingly affordable and powerful 3D scanning devices capable of capturing high resolution range data about real-world objects and environments has fueled research into effective 3D surface reconstruction techniques for rendering the raw point cloud data produced by many of these devices into a form that would make it usable in a variety of application domains. This paper, therefore, provides an overview of the existing literature on surface reconstruction from 3D point clouds. It explains some of the basic surface reconstruction concepts, describes the various factors used to evaluate surface reconstruction methods, highlights some commonly encountered issues in dealing with the raw 3D point cloud data and delineates the tradeoffs between data resolution/accuracy and processing speed. It also categorizes the various techniques for this task and briefly analyzes their empirical evaluation results demarcating their advantages and disadvantages. The paper concludes with a cross-comparison of methods which have been evaluated on the same benchmark data sets along with a discussion of the overall trends reported in the literature. The objective is to provide an overview of the state of the art on surface reconstruction from point cloud data in order to facilitate and inspire further research in this area.

Keywords

References

  1. D. Kim and S. Lee, "Advances in 3D camera: time-of-flight vs. active triangulation," in Intelligent Autonomous Systems 12. Heidelberg: Springer, 2013, pp. 301-309.
  2. D. Lu, H. Zhao, M. Jiang, S. Zhou, and T. Zhou, "A surface reconstruction method for highly noisy point clouds," in Variational, Geometric, and Level Set Methods in Computer Vision. Heidelberg: Springer, 2005, pp. 283-294.
  3. T. K. Dey, Curve and Surface Reconstruction: Algorithms with Mathematical Analysis. New York: Cambridge University Press, 2006.
  4. M. Berger, A. Tagliasacchi, L. Seversky, P. Alliez, J. Levine, A. Sharf, and C. Silva, "State of the art in surface reconstruction from point clouds," EUROGRAPHICS Star Reports, vol. 1, no. 1, pp. 161-185, 2014.
  5. J. Digne, D. Cohen-Steiner, P. Alliez, F. De Goes, and M. Desbrun, "Feature-preserving surface reconstruction and simplification from defect-laden point sets," Journal of Mathematical Imaging and Vision, vol. 48, no. 2, pp. 369-382, 2014. https://doi.org/10.1007/s10851-013-0414-y
  6. H. Hoppe, T. DeRose, T. Duchamp, J. McDonald, and W. Stuetzle, "Surface reconstruction from unorganized points," ACM SIGGRAPH Computer Graphics, vol. 26, no. 2, pp. 71-78, 1992. https://doi.org/10.1145/142920.134011
  7. W. E. Lorensen and H. E. Cline, "Marching cubes: a high resolution 3D surface construction algorithm," ACM SIGGRAPH Computer Graphics, vol. 21, no. 4, pp. 163-169, 1987. https://doi.org/10.1145/37402.37422
  8. H. Q. Dinh, G.Turk, and G. Slabaugh, "Reconstructing surfaces using anisotropic basis functions," in Proceedings of 8th IEEE International Conference on Computer Vision, Vancouver, Canada, 2001, pp. 606-613.
  9. S. Fortune, "Voronoi diagrams and Delaunay triangulations," in Computing in Euclidean Geometry. Singapore: World Scientific Publishing, 1992, pp. 193-233.
  10. L. Guibas and J. Stolfi, "Primitives for the manipulation of general subdivisions and the computation of Voronoi," ACM Transactions on Graphics, vol. 4, no. 2, pp. 74-123, 1985. https://doi.org/10.1145/282918.282923
  11. J. Katajainen, "Bucketing and filtering in computational geometry," Ph.D. dissertation, Department of Computer Science, University of Turku, Finland, 1987.
  12. R. A. Dwyer, "Higher-dimensional Voronoi diagrams in linear expected time," Discrete & Computational Geometry, vol. 6, no. 3, pp. 343-367, 1991. https://doi.org/10.1007/BF02574694
  13. N. Amenta, M. Bern, and M. Kamvysselis, "A new Voronoi-based surface reconstruction algorithm," in Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, 1998, pp. 415-421.
  14. F. Bernardini, J. Mittleman, H. Rushmeier, C. Silva, and G. Taubin, "The ball-pivoting algorithm for surface reconstruction," IEEE Transactions on Visualization and Computer Graphics, vol. 5, no. 4, pp. 349-359, 1999. https://doi.org/10.1109/2945.817351
  15. J. D. Boissonnat, "Geometric structures for three-dimensional shape representation," ACM Transactions on Graphics, vol. 3, no. 4, pp. 266-286, 1984. https://doi.org/10.1145/357346.357349
  16. R. Mencl, "A graph-based approach to surface reconstruction," Computer Graphics Forum, vol. 14, no. 3, pp. 445-456, 1995. https://doi.org/10.1111/j.1467-8659.1995.cgf143_0445.x
  17. N. Amenta and M. Bern, "Surface reconstruction by Voronoi filtering," Discrete & Computational Geometry, vol. 22, no. 4, pp. 481-504, 1999. https://doi.org/10.1007/PL00009475
  18. M. Gopi, S. Krishnan, and C. T. Silva, "Surface reconstruction based on lower dimensional localized Delaunay triangulation," Computer Graphics Forum, vol. 19, no. 3, pp. 467-478, 2000. https://doi.org/10.1111/1467-8659.00439
  19. P. Crossno and E. Angel, "Spiraling edge: fast surface reconstruction from partially organized sample points," in Proceedings of the Conference on Visualization, San Francisco, CA, 1999, pp. 317-324.
  20. N. Amenta, S. Choi, T. K. Dey, and N. Leekha, "A simple algorithm for homeomorphic surface reconstruction," in Proceedings of the 16th annual Symposium on Computational Geometry, Hong Kong, 2000, pp. 213-222.
  21. N. Amenta, S. Choi, and R. K. Kolluri, "The power crust," in Proceedings of the 6th ACM Symposium on Solid Modeling and Applications, Ann Arbor, MI, 2001, pp. 249-266.
  22. M. Gopi and S. Krishnan, "A fast and efficient projection-based approach for surface reconstruction," in Proceedings of 15th Brazilian Symposium on Computer Graphics and Image Processing, Fortaleza-CE, Brazil, 2002, pp. 179-186.
  23. T. K. Dey, J. Giesen, S. Goswami, and W. Zhao, "Shape dimension and approximation from samples," in Proceedings of the 13th Annual ACM-SIAM Symposium on Discrete Algorithms, San Francisco, CA, 2002, pp. 772-780.
  24. T. K. Dey and S. Goswami, "Tight cocone: a water-tight surface reconstructor," in Proceedings of the 8th ACM Symposium on Solid Modeling and Applications, Seattle, WA, 2003, pp. 127-134.
  25. D. Cohen-Steiner and F. Da, "A greedy Delaunay-based surface reconstruction algorithm," The Visual Computer, vol. 20, no. 1, pp. 4-16, 2004. https://doi.org/10.1007/s00371-003-0217-z
  26. R. Kolluri, J. R. Shewchuk, and J. F. O'Brien, "Spectral surface reconstruction from noisy point clouds," in Proceedings of the Eurographics Symposium on Geometry Processing, Nice, France, 2004, pp. 11-21.
  27. H. W. Lin, C. L. Tai, and G. J. Wang, "A mesh reconstruction algorithm driven by an intrinsic property of a point cloud," Computer-Aided Design, vol. 36, no. 1, pp. 1-9, 2004. https://doi.org/10.1016/S0010-4485(03)00064-2
  28. B. Mederos, N. Amenta, L. Velho, and L. H. De Figueiredo, "Surface reconstruction for noisy point clouds," in Proceedings of the 3rd Eurographics Symposium on Geometry Processing, Vienna, Austria, 2005, pp. 53-62.
  29. R. Allegre, R. Chaine, and S. Akkouche, "A dynamic surface reconstruction framework for large unstructured point sets," in Proceedings of Symposium on Point-Based Graphics, Prague, Czech Republic, 2006, pp. 17-26.
  30. R. Allegre, R. Chaine, and S. Akkouche, "Convection-driven dynamic surface reconstruction," in Proceedings of International Conference on Shape Modeling and Application, 2005, pp. 33-42.
  31. D. DeCarlo and D. Metaxas, "Blended deformable models," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 4, pp. 443-448, 1996. https://doi.org/10.1109/34.491626
  32. D. Marr and H. K. Nishihara, "Representation and recognition of the spatial organization of three-dimensional shapes," Proceedings of the Royal Society of London B: Biological Sciences, vol. 200, no. 1140, pp. 269-294, 1978. https://doi.org/10.1098/rspb.1978.0020
  33. T. O'Donnell, T. E. Boult, X. S. Fang, and A. Gupta, "The extruded generalized cylinder: a deformable model for object recovery," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, 1994, pp. 174-181.
  34. A. H. Barr, "Superquadrics and angle-preserving transformations," IEEE Computer Graphics and Applications, vol. 1, no. 1, pp. 11-23, 1981. https://doi.org/10.1109/MCG.1981.1673799
  35. D. Terzopoulos and D. Metaxas, "Dynamic 3D models with local and global deformations: deformable superquadrics," in Proceedings of 3rd International Conference on Computer Vision, Osaka, Japan, 1990, pp. 606-615.
  36. A. J. Hanson, "Hyperquadrics: smoothly deformable shapes with convex polyhedral bounds," Computer Vision, Graphics, and Image Processing, vol. 44, no. 2, pp. 191-210, 1988. https://doi.org/10.1016/S0734-189X(88)80005-7
  37. S. Muraki, "Volumetric shape description of range data using 'blobby model'," ACM SIGGRAPH Computer Graphics, vol. 25, no. 4, pp. 227-235, 1991. https://doi.org/10.1145/127719.122743
  38. C. Hoffmann and J. Hopcroft, "The geometry of projective blending surfaces," Artificial Intelligence, vol. 37, no. 1-3, pp. 357-376, 1988. https://doi.org/10.1016/0004-3702(88)90060-4
  39. R. Szeliski, D. Tonnesen, and D. Terzopoulos, "Modeling surfaces of arbitrary topology with dynamic particles," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY, 1993, pp. 82-87.
  40. G. Taubin, "An improved algorithm for algebraic curve and surface fitting," in Proceedings of 4th International Conference on Computer Vision, Berlin, Germany, 1993, pp. 658-665.
  41. D. Terzopoulos, A. Witkin, and M. Kass, "Constraints on deformable models: recovering 3D shape and nonrigid motion," Artificial Intelligence, vol. 36, no. 1, pp. 91-123, 1988. https://doi.org/10.1016/0004-3702(88)90080-X
  42. J. C. Carr, R. K. Beatson, J. B.Cherrie, T. J. Mitchell, W. R. Fright, B. C. McCallum, and T. R. Evans, "Reconstruction and representation of 3D objects with radial basis functions," in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, 2001, pp. 67-76.
  43. H. K. Zhao, S. Osher, and R. Fedkiw, "Fast surface reconstruction using the level set method," in IEEE Workshop on Variational and Level Set Methods in Computer Vision, Vancouver, Canada, 2001, pp. 194-201.
  44. M. Alexa, J. Behr, D. Cohen-Or, S. Fleishman, D. Levin, and C. T. Silva, "Computing and rendering point set surfaces," IEEE Transactions on Visualization and Computer Graphics, vol. 9, no. 1, pp. 3-15, 2003. https://doi.org/10.1109/TVCG.2003.1175093
  45. J. C. Carr, R. K. Beatson, B. C. McCallum, W. R. Fright, T. J. McLennan, and T. J. Mitchell, "Smooth surface reconstruction from noisy range data," in Proceedings of the 1st International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, Melbourne, Australia, 2003, pp. 119-126.
  46. Y. Duan, L. Yang, H. Qin, and D. Samaras, "Shape reconstruction from 3D and 2D data using PDE-based deformable surfaces," in Proceedings of 8th European Conference on Computer Vision, Prague, Czech Republic, 2004, pp. 238-251.
  47. A. Hornung and L. Kobbelt, "Robust reconstruction of watertight 3 D models from non-uniformly sampled point clouds without normal information," in Proceedings of the 4th Eurographics Symposium on Geometry Processing, Sardinia, Italy, 2006, pp. 41-50.
  48. P. Alliez, D. Cohen-Steiner, Y. Tong, and M. Desbrun, "Voronoi-based variational reconstruction of unoriented point sets," in Proceedings of the 5th Eurographics Symposium on Geometry Processing, Barcelona, Spain, 2007, pp. 39-48.
  49. H. Huang, D. Li, H. Zhang, U. Ascher, and D. Cohen-Or, "Consolidation of unorganized point clouds for surface reconstruction," ACM Transactions on Graphics, vol. 28, no. 5, article no. 176, 2009.
  50. A. C. Oztireli, G. Guennebaud, and M. Gross, "Feature preserving point set surfaces based on non-linear kernel regression," Computer Graphics Forum, vol. 28, no. 2, pp. 493-501, 2009. https://doi.org/10.1111/j.1467-8659.2009.01388.x
  51. M. Kazhdan, M. Bolitho, and H. Hoppe, "Poisson surface reconstruction," in Proceedings of the 4th Eurographics Symposium on Geometry Processing, Sardinia, Italy, 2006, pp. 1-10.
  52. M. Bolitho, M. Kazhdan, R. Burns, and H. Hoppe, "Parallel Poisson surface reconstruction," in Advances in Visual Computing. Heidelberg: Springer, 2009, pp. 678-689.
  53. X. Li, W. Wan, X. Cheng, and B. Cui, "An improved Poisson surface reconstruction algorithm," in Proceedings of International Conference on Audio Language and Image Processing (ICALIP), Shanghai, China, 2010, pp. 1134-1138.
  54. J. F. Blinn, "A generalization of algebraic surface drawing," ACM Transactions on Graphics, vol. 1, no. 3, pp. 235-256, 1982. https://doi.org/10.1145/357306.357310
  55. G. Yngve and G. Turk, "Creating smooth implicit surfaces from polygonal meshes," Georgia Institute of Technology, Atlanta, GA, 1999.