Journal of Broadcast Engineering (방송공학회논문지)

The Korean Institute of Broadcast and Media Engineers (한국방송∙미디어공학회)
권호 표지
DOI QR코드

DOI QR Code

Development of Photogrammetric Rectification Method Applying Bayesian Approach for High Quality 3D Contents Production

고품질의 3D 콘텐츠 제작을 위한 베이지안 접근방식의 사진측량기반 편위수정기법 개발

  • Kim, Jae-In (Dept. of Geoinformatic Engineering Inha University) ;
  • Kim, Taejung (Dept. of Geoinformatic Engineering Inha University)
  • 김재인 (인하대학교 지리정보공학과) ;
  • 김태정 (인하대학교 지리정보공학과)
  • Received : 2012.09.13
  • Accepted : 2012.12.12
  • Published : 2013.01.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a photogrammetric rectification method based on Bayesian approach as a method that eliminates vertical parallax between stereo images to minimize visual fatigue of 3D contents. The image rectification consists of two phases; geometry estimation and epipolar transformation. For geometry estimation, coplanarity-based relative orientation algorithm was used in this paper. To ensure robustness for mismatch and localization error occurred by automation of tie point extraction, Bayesian approach was applied by introducing several prior constraints. As epipolar transformation perspective transformation was used based on condition of collinearity to minimize distortion of result images and modification for input images. Other algorithms were compared to evaluate performance. For geometry estimation, traditional relative orientation algorithm, 8-points algorithm and stereo calibration algorithm were employed. For epipolar transformation, Hartley algorithm and Bouguet algorithm were employed. The evaluation results showed that the proposed algorithm produced results with high accuracy, robustness about error sources and minimum image modification.

본 논문에서는 고품질의 3D 콘텐츠 제작에 있어 입체피로를 최소화하기 위한 영상의 수직시차 교정방법으로, 베이지안 접근방식을 적용한 사진측량기반의 강인 편위수정 기법을 제안하고자 한다. 영상의 수직시차 제거 과정은 크게 기하추정 단계와 에피폴라 변환 단계로 구성된다. 본 논문에서는 기하추정을 위해 사진측량에서 널리 활용되고 있는 공면조건 기반의 상대표정 알고리즘을 적용한다. 이때 상대표정 알고리즘에는 자동 정합점 추출에 따른 오정합과 위치오차에 강인성을 확보하기 위해 제약조건을 도입한 베이지안 접근방식을 적용하고자 하며, 이를 바탕으로 수행되는 에피폴라 변환에는 영상의 왜곡과 원 영상 대비 변형을 최소화하기 위한 공선조건기반의 중심투영변환기법을 적용하고자 한다. 알고리즘의 성능검증을 위한 비교 알고리즘으로, 기하추정에는 일반적인 상대표정 알고리즘과 컴퓨터비전분야의 8점 알고리즘 및 스테레오 캘리브레이션 기법이 사용되었으며, 에피폴라 변환에는 Hartley 방법과 Bouguet 방법이 사용되었다. 실험결과는 제안 알고리즘의 높은 정확도와 여러 오차요인들에 대한 강인성, 그리고 최소화된 영상변형의 결과를 보여주었다.

Keywords

References

  1. H. Kim, H. Kim, H. Jang, S. Nam, 2011. Technical trend of stereoscopic content production, Electronics and Telecommunications Trends, 26(1):13-24.
  2. Y.-S. Kang and Y.-S. Ho, 2011. An efficient image rectification method for parallel multi-camera arrangement, IEEE Trans. Consumer Electronics, 57(3):1041-1048. https://doi.org/10.1109/TCE.2011.6018853
  3. Z. Zhang, 2000. A flexible new technique for camera calibration, IEEE Transaction on Pattern Analysis and Machine Intelligence, 22(11):1330-1334. https://doi.org/10.1109/34.888718
  4. D. C. Brown, 1971. Close-range camera calibration, Photogrammetric Engineering, 37(8):855-866.
  5. R. I. Hartley, 1999. Theory and practice of projective rectification, International Journal of Computer Vision, 35(2):115-127. https://doi.org/10.1023/A:1008115206617
  6. C. Loop, Z. Zhang, 1999. Computing rectifying homographies for stereo vision, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 125-131.
  7. K. A. Al-Shalfan, J. G. B. Haigh, S. S. Ipson, 2000. Direct algorithm for rectifying pairs of uncalibrated images, Electronics Letters, 36(5):419-420. https://doi.org/10.1049/el:20000362
  8. R. I. Hartley, A. Zisserman, 2003. Multiple View Geometry in Computer Vision, 2nd Edition, New York: Cambridge University Press.
  9. J. Mallon and P. F. Whelan, 2005. Projective rectification from the fundamental matrix, 23(7):643-650. https://doi.org/10.1016/j.imavis.2005.03.002
  10. J. Kim, T. Kim, 2012. Precise rectification of misaligned stereo images for 3D image generation, Journal of Broadcast Engineering, 17(2):411-421. https://doi.org/10.5909/JEB.2012.17.2.411
  11. J. Grodecki and G. Dial, 2003. Block adjustment of high-resolution satellite images described by rational polynomials, Photogrammetric Engineering & Remote Sensing, 69(1):59-68. https://doi.org/10.14358/PERS.69.1.59
  12. B. Yeu, T. Schenk, 2003. Modern Digital Photogrammetry, Seoul: Pearson Education Korea.
  13. R. I. Hartley, 1995. In defence of the eight-point algorithm, Proc. of IEEE International Conference on Computer Vision, pp.1064-1070.
  14. OpenCV library, http://sourceforge.net/projects/opencvlibrary.
  15. D. G. Lowe, 2004. Distinctive image features from scale-invariant keypoints, International Journal of Computer Vistion, 60(2):91-110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  16. M. A. Fischler and R. C. Bolles, 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography, Comm. of the ACM 24(6):381-395. https://doi.org/10.1145/358669.358692

Cited by

  1. Automated Image Alignment and Monitoring Method for Efficient Stereoscopic 3D Contents Production vol.19, pp.2, 2014, https://doi.org/10.5909/JBE.2014.19.2.205
  2. Hybrid Camera System with a TOF and DSLR Cameras vol.19, pp.4, 2014, https://doi.org/10.5909/JBE.2014.19.4.533