Multiple Camera Based Imaging System with Wide-view and High Resolution and Real-time Image Registration Algorithm

다중 카메라 기반 대영역 고해상도 영상획득 시스템과 실시간 영상 정합 알고리즘

  • 이승현 (경북대학교 IT대학 전자공학부) ;
  • 김민영 (경북대학교 IT대학 전자공학부)
  • Received : 2011.12.03
  • Accepted : 2012.06.25
  • Published : 2012.07.25

Abstract

For high speed visual inspection in semiconductor industries, it is essential to acquire two-dimensional images on regions of interests with a large field of view (FOV) and a high resolution simultaneously. In this paper, an imaging system is newly proposed to achieve high quality image in terms of precision and FOV, which is composed of single lens, a beam splitter, two camera sensors, and stereo image grabbing board. For simultaneously acquired object images from two camera sensors, Zhang's camera calibration method is applied to calibrate each camera first of all. Secondly, to find a mathematical mapping function between two images acquired from different view cameras, the matching matrix from multiview camera geometry is calculated based on their image homography. Through the image homography, two images are finally registered to secure a large inspection FOV. Here the inspection system of using multiple images from multiple cameras need very fast processing unit for real-time image matching. For this purpose, parallel processing hardware and software are utilized, such as Compute Unified Device Architecture (CUDA). As a result, we can obtain a matched image from two separated images in real-time. Finally, the acquired homography is evaluated in term of accuracy through a series of experiments, and the obtained results shows the effectiveness of the proposed system and method.

Acknowledgement

Grant : 고속 3차원 표면실장 검사로봇 시스템 개발

Supported by : 한국연구재단, 지식경제부

References

  1. 김경수, 이진학, 나종범, "정밀한 다중센서 영상정합을 위한 통계적 상관성의 증대기법", 전자공학회논문지, 제 42권, 제 4호, 1-12쪽, 2005년 7월
  2. 정용한, 박은수, 김학일, 허욱열, "Planeconverging Belief Propagation을 이용한 고속 스테레오 매칭", 전자공학회 논문지, 제 48권, 제 2호, 88-75쪽, 2011년 3월
  3. Z. Zhang, "A flexible new technique for camera calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, 2000. https://doi.org/10.1109/34.888718
  4. 최학남, 박은수, 김준철, 정용한, 김학일, "GPU를 이용한 고속 영상 보간법 개발," KIEE 2008 CICS 정보 및 제어 학술대회 논문집, pp. 300-301, 2008년 10월
  5. 김성수, 김동헌, 우상규, 임인성, "최적화된 CUDA 소프트웨어 제작을 위한 프로그래밍 기법 분석," 정보과학회논문지 : 컴퓨팅의 실제 및 레터, 제16권, 제7호, pp. 775-787, 2010년 7월.
  6. NVIDIA, NVIDIA CUDA C Best Practices Guide 3.2, 2010.
  7. NVIDIA, NVIDIA CUDA C Programming Guide 3.2, 2010.
  8. R. Chandra et al., Parallel programming in OpenMP, Morgan Kaufmann Publishers, 2000.
  9. R. C. Gonzalez, R. E. Woods and S. L. Eddins, Digital Image Processing Using MATLAB, Gatesmark Publishing, 2009.