그림 1. 비디오로부터의 3차원 인체 복원 파이프라인 Fig. 1. Pipeline of 3D human reconstruction from video
그림 2. 단일 영상에 대한 3차원 인체 복원 Fig. 2. 3D human reconstruction from single image
그림 3. 자세 매개변수에 대한 분위 회귀 분석 Fig. 3. Quantile regression for pose parameters
그림 4. 비디오로부터 추출한 연속적인 입력 프레임 영상과 복원된 움직임을 갖는 3차원 인체 모델 Fig. 4. 3D human body reconstruction results with continuous input frame image and motion extracted from video in order
그림 5. 오류 프레임에 대한 3차원 인체 움직임 복원 결과. 위로부터 입력영상, 오류 프레임이 포함된 3차원 인체 복원 영상(중앙 3번째 프레임), 제시된 기법으로 움직임 보정된 복원 영상 Fig 5. 3D Human motion reconstruction result on error frame. From up to down: input, 3D reconstruction including error frame, motion compensated result
표 1. 기존의 기법과 제안하는 기법의 3차원 관절 위치 비교 Table 1. 3D joints distance between existing technique and proposed technique
표 2. 입력 영상에 대한 오류 프레임 검출 비율 Table 2. Error frame detection rate for input video
References
- M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, and M. J. Black, "SMPL: A skinned multi-person linear model," ACM Trans. on Graphics, vol. 34, no. 6, pp. 248, November 2015.
- L. Pishchulin, E. Insafutdinov, S. Tang, and B. Andress, "DeepCut: Joint subset partition and labeling for multi person pose estimation," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 4929-4937, June 2016.
- K. Grauman and T. Darrell, "Fast contour matching using approximate earth mover's distance," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 2004.
- J. S. Han, M. R. Cho, and I. K. Park, "Moving human shape and pose reconstruction from video," Proceedings of Korean Society of Broadcast and Media Engineers Fall Conference, pp. 66-68, November 2018.
- L. Sigal, A. Balan, and M. J. Black, "HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion," International Journal of Computer Vision, vol. 87, no. 1-2, pp. 4-27, March 2010. https://doi.org/10.1007/s11263-009-0273-6
- C. Ionescu, D. Papva, V. Olaru, and C. Sminchisescu," Human3.6M: Large scale datasets and predictive methods for 3D human sensing in natural environments," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 36, no. 7, pp. 1325-1339, July 2014. https://doi.org/10.1109/TPAMI.2013.248
- K. He, G. Gkioxari, P. Dollar, and R. Girshick, "Mask R-CNN," Proceedings of IEEE International Conference on Computer Vision, pp.2980-2988, October 2017.
- P. Guan, A. Weiss, A. O. Balan, and M. J. Black, "Estimating human shape and pose from a single image," Proceedings of IEEE International Conference on Computer Vision, pp. 1381-1388, September 2009.
- F. Bogo, A. Kanazawa, C. Lassner, and P. Gehler, "Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image," Proceedings of European Conference on Computer Vision, pp. 561-578, October 2016.
- N. Meinshausen, "Quantile regression forests," Journal of Machine Learning Research, vol. 7, no. 6, pp. 983-999, June 2006.
- M. Lopez-Quintero, M. Marin-jimenez, et al. "Stereo pictorial structure for 2D articulated human pose estimation," Machine Vision and Applications, vol. 27, no. 2, pp. 157-174, February 2016. https://doi.org/10.1007/s00138-015-0742-6
- C. Zhang, S. Pujades, M. J. Black, and G. Pons-Moll, "Detailed, accurate, human shape estimation from clothed 3D scan sequences," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, July 2017.