Journal of the Semiconductor & Display Technology (반도체디스플레이기술학회지)

The Korean Society Of Semiconductor & Display Technology (한국반도체디스플레이기술학회)
권호 표지

Enhancing Depth Measurements in Depth From Focus based on Mutual Structures

상호 구조에 기반한 초점으로부터의 깊이 측정 방법 개선

  • Mahmood, Muhammad Tariq (Korea University of Technology and Education, School of Computer Science and Engineering) ;
  • Choi, Young Kyu (Korea University of Technology and Education, School of Computer Science and Engineering)
  • Received : 2022.08.02
  • Accepted : 2022.09.19
  • Published : 2022.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

A variety of techniques have been proposed in the literature for depth improvement in depth from focus method. Unfortunately, these techniques over-smooth the depth maps over the regions of depth discontinuities. In this paper, we propose a robust technique for improving the depth map by employing a nonconvex smoothness function that preserves the depth edges. In addition, the proposed technique exploits the mutual structures between the depth map and a guidance map. This guidance map is designed by taking the mean of image intensities in the image sequence. The depth map is updated iteratively till the nonconvex objective function converges. Experiments performed on real complex image sequences revealed the effectiveness of the proposed technique.

Keywords

Acknowledgement

이 논문은 2022년도 한국기술교육대학교 교수 교육연구진흥과제 지원에 의하여 연구되었음.

References

  1. M. T. Mahmood and Y. K. Choi, "3D Shape Recovery from Image Focus using Gaussian Process Regression," Journal of the Semiconductor & Display Technonogy, vol. 11, no. 3, pp. 19-25, 2012.
  2. S. K. Nayar and Y. Nakagawa, "Shape from focus," IEEE Transactions on Pattern analysis and machine intelligence, vol. 16, no. 8, pp. 824-831, 1994. https://doi.org/10.1109/34.308479
  3. U. Ali and M. T. Mahmood, "3d shape recovery by aggregating 3d wavelet transform-based image focus volumes through 3d weighted least squares," Journal of Mathematical Imaging and Vision, pp. 1-19, 2019.
  4. U. Ali and M. T. Mahmood, "Energy minimization for image focus volume in shape from focus," Pattern Recognition, vol. 126, no. p. 108559, 2022. https://doi.org/10.1016/j.patcog.2022.108559
  5. K. He, J. Sun and X. Tang, "Guided image filtering," IEEE Transactions on pattern analysis and machine intelligence, vol. 35, no. 6, pp. 1397-1409, 2012. https://doi.org/10.1109/TPAMI.2012.213
  6. B. Ham, M. Cho and J. Ponce, "Robust guided image filtering using nonconvex potentials," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 40, no. 1, pp. 192-207, 2018. https://doi.org/10.1109/TPAMI.2017.2669034
  7. X. Guo, Y. Li, J. Ma and H. Ling, "Mutually guided image filtering," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 3, pp. 694-707, 2020. https://doi.org/10.1109/tpami.2018.2883553
  8. U. Ali, I. H. Lee and M. T. Mahmood, "Guided image filtering in shape-from-focus: A comparative analysis," Pattern Recognition, vol. 111, no. p. 107670, 2021. https://doi.org/10.1016/j.patcog.2020.107670
  9. Q. Zhang, X. Shen, L. Xu and J. Jia, "Rolling guidance filter," in ECCV, pp. 815-830, 2014
  10. U. Ali and M. T. Mahmood, "Robust focus volume regularization in shape from focus," IEEE Transactions on Image Processing, vol. 30, no. pp. 7215-7227, 2021. https://doi.org/10.1109/TIP.2021.3100268
  11. M. T. Mahmood, Usman Ali, and Y. K. Choi, "Enhancing Focus Measurements in Shape From Focus through 3D Weighted Least Square," Journal of the Semiconductor & Display Technonogy, vol. 18, no. 3, pp. 66-71, 2019.
  12. C. F. J. Wu, "On the convergence properties of the em algorithm," The Annals of statistics, pp. 95-103, 1983.
  13. S. Suwajanakorn, C. Hernandez and S. M. Seitz, "Depth from focus with your mobile phone," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3497-3506, 2015
  14. G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. Hoppe et al., "Digital photography with flash and noflash image pairs," ACM Transactions on Graphics, vol. 23, no. 3, pp. 664-672, 2004. https://doi.org/10.1145/1015706.1015777