ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Template-Based Reconstruction of Surface Mesh Animation from Point Cloud Animation

  • Received : 2013.11.25
  • Accepted : 2014.06.24
  • Published : 2014.12.01
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we present a method for reconstructing a surface mesh animation sequence from point cloud animation data. We mainly focus on the articulated body of a subject - the motion of which can be roughly described by its internal skeletal structure. The point cloud data is assumed to be captured independently without any inter-frame correspondence information. Using a template model that resembles the given subject, our basic idea for reconstructing the mesh animation is to deform the template model to fit to the point cloud (on a frame-by-frame basis) while maintaining inter-frame coherence. We first estimate the skeletal motion from the point cloud data. After applying the skeletal motion to the template surface, we refine it to fit to the point cloud data. We demonstrate the viability of the method by applying it to reconstruct a fast dancing motion.

Keywords

References

  1. D.L. James and C.D. Twigg, "Skinning Mesh Animations," ACM Trans. Graph., vol. 24, no. 3, July 2005, pp. 399-407. https://doi.org/10.1145/1073204.1073206
  2. S. Kircher and M. Garland, "Editing Arbitrarily Deforming Surface Animations," ACM Trans. Graph., vol. 25, no. 3, July 2006, pp. 1098-1107. https://doi.org/10.1145/1141911.1142000
  3. E. de Aguiar et al., "Performance Capture from Sparse Multiview Video," ACM Trans. Graph., vol. 27, no. 3, 2008, pp. 98:1-98:10.
  4. D. Vlasic et al., "Articulated Mesh Animation from Multi-view Silhouettes," ACM Trans. Graph., vol. 27, no. 3, 2008, pp. 97:1-97:9.
  5. P. Sand, L. McMillan, and J. Popovic, "Continuous Capture of Skin Deformation," ACM Trans. Graph., vol. 22, no. 3, July 2003, pp. 578-586. https://doi.org/10.1145/882262.882310
  6. B. Allen, B. Curless, and Z. Popovic, "The Space of Human Body Shapes," ACM Trans. Graph., vol. 22, no. 3, July 2003, pp. 587-594. https://doi.org/10.1145/882262.882311
  7. D. Anguelov et al., "Recovering Articulated Object Models from 3D Range Data," Proc. Conf. Uncertainty Artif. Intell., Banff, Canada, 2004, pp. 18-26.
  8. D. Anguelov et al., "Scape: Shape Completion and Animation of People," ACM Trans. Graph., vol. 24, no. 3, July 2005, pp. 408-416. https://doi.org/10.1145/1073204.1073207
  9. A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Generalized Multidimensional Scaling: A Framework for Insometry-Invariant Partial Surface Matching," Proc. National Academy Sci., vol. 103, no. 5, 2006, pp. 1168-1172. https://doi.org/10.1073/pnas.0508601103
  10. H. Li et al., "Robust Singleview Geometry and Motion Reconstruction," ACM Trans. Graph., vol. 28, no. 5, Dec. 2009, pp. 174:1-175:10.
  11. N.J. Mitra et al., "Dynamic Geometry Registration," Proc. Eurographics Symp. Geometry Process., Barcelona, Spain, 2007, pp. 173-182.
  12. J. Sussmuth, M. Winter, and G. Greiner, "Reconstructing Animated Meshes from Time-Varying Point Clouds," Proc. Symp. Geometry Process., Copenhagen, Denmark, 2008, pp. 1469-1476.
  13. M. Wand et al., "Efficient Reconstruction of Non-rigid Shape and Motion from Real-Time 3D Scanner Data," ACM Trans. Graph., vol. 28, no. 2, Apr. 2009, pp. 15:1-15:15.
  14. M. Wand et al., "Reconstruction of Deforming Geometry from Time-Varying Point Clouds," Proc. Symp. Geometry Process., Barcelona, Spain, 2007, pp. 49-58.
  15. A. Tevs et al., "Animation Cartography - Intrinsic Reconstruction of Shape and Motion," ACM Trans. Graph., vol. 31, no. 2, Apr. 2012, pp. 12:1-12:15.
  16. CGHuman, CGCharacter, 2013. Accessed Aug. 26, 2013. http://www.cgcharacter.com/cghuman.html
  17. M. Pauly, L. Kobbelt, and M.H. Gross, "Multi-resolution Modeling of Point-Sampled Geometry," ETH CS Technical Report, no. 373, 2002.
  18. B. Horn, "Closed-Form Solution of Absolute Orientation Using Unit Quaternions," J. Opt. Soc. America, vol. 4, no. 4, Apr. 1, 1987, pp. 629-642.
  19. M. Sung, "Fast Motion Synthesis of Quadrupedal Animals Using a Minimum Amount of Motion Capture Data," ETRI J., vol. 35, no. 6, Dec. 2013, pp. 1029-1037. https://doi.org/10.4218/etrij.13.2013.0059

Cited by

  1. Robotic vision system for random bin picking with dual-arm robots vol.75, pp.None, 2014, https://doi.org/10.1051/matecconf/20167507003