Journal of Institute of Control, Robotics and Systems (제어로봇시스템학회논문지)

Institute of Control, Robotics and Systems (제어로봇시스템학회)
권호 표지
DOI QR코드

DOI QR Code

3D Orientation and Position Tracking System of Surgical Instrument with Optical Tracker and Internal Vision Sensor

광추적기와 내부 비전센서를 이용한 수술도구의 3차원 자세 및 위치 추적 시스템

  • Joe, Young Jin (School of Electronics Engineering, Kyungpook National University) ;
  • Oh, Hyun Min (School of Electronics Engineering, Kyungpook National University) ;
  • Kim, Min Young (School of Electronics Engineering, Kyungpook National University)
  • Received : 2016.05.24
  • Accepted : 2016.07.25
  • Published : 2016.08.01
Download PDF
⟨ Previous Next ⟩

Abstract

When surgical instruments are tracked in an image-guided surgical navigation system, a stereo vision system with high accuracy is generally used, which is called optical tracker. However, this optical tracker has the disadvantage that a line-of-sight between the tracker and surgical instrument must be maintained. Therefore, to complement the disadvantage of optical tracking systems, an internal vision sensor is attached to a surgical instrument in this paper. Monitoring the target marker pattern attached on patient with this vision sensor, this surgical instrument is possible to be tracked even when the line-of-sight of the optical tracker is occluded. To verify the system's effectiveness, a series of basic experiments is carried out. Lastly, an integration experiment is conducted. The experimental results show that rotational error is bounded to max $1.32^{\circ}$ and mean $0.35^{\circ}$, and translation error is in max 1.72mm and mean 0.58mm. Finally, it is confirmed that the proposed tool tracking method using an internal vision sensor is useful and effective to overcome the occlusion problem of the optical tracker.

Keywords

References

  1. M. Y. Kim and H. S. Cho, "Technological trend of endoscopic robots," Journal of Institute of Control, Robotics and Systems, vol. 20, no. 3, pp. 345-355, 2014. https://doi.org/10.5302/J.ICROS.2014.14.9021
  2. S. M. Yoon, W. J. Kim, and M. C. Lee, "Impedance 584 Young Jin Joe, Hyun Min Oh, and Min Young Kim model based bilateral control for force reflection of a laproscopic surgery robot," Journal of Institute of Control, Robotics and Systems, vol. 20, no. 8, pp. 801-806, 2014. https://doi.org/10.5302/J.ICROS.2014.14.9038
  3. D. J. Mirota, M. Ishii, and G. D. Hager, "Vision-based navigation in image-guided interventions," Annual Review of Biomedical Engineering, vol. 13, pp. 297-319, 2011. https://doi.org/10.1146/annurev-bioeng-071910-124757
  4. U. Mezger, C. Jendrewski, and M. Bartels, "Navigation in surgery," Langenbeck's Archives of Surgery, vol. 398, no. 4, pp. 501-514, 2013. https://doi.org/10.1007/s00423-013-1059-4
  5. K. Cleary, H. Zhang, N. Glossop, and E. Levy, "Electromagnetic tracking for image-guided abdominal procedures: Overall system and technical issues," Proceedings of 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, pp. 6748-6753, 2005.
  6. W. Birkfellner, J. Hummel, E. Wilcon, and K. Cleary, "Tracking devices," Image-Guided Interventions: Technology and Applications, Springer, pp. 23-44, 2008.
  7. Z. Yaniv, E. Wilson, D. Lindisch, and K. Cleary, "Electromagnetic tracking in the clinical environment," Medical Physics, vol. 36, no. 3, pp. 876-892, 2009. https://doi.org/10.1118/1.3075829
  8. G. Widmann, "Image-guided surgery and medical robotics in the cranial area," Biomed Imaging Intervention Journal, vol. 3, no. 1, e11, 2007.
  9. J. Wang, M. Q. H Meng, and H. Ren, "Towards occlusion-free surgical instrument tracking: A modular monocular approach and an agile calibration method," Automation Science and Engineering, IEEE Transactions on, vol. 12, no. 2, pp. 588-595, 2015. https://doi.org/10.1109/TASE.2015.2388537
  10. M. Shah, R. D. Eastman, and T. Hong, "An overview of robot-sensor calibration methods for evaluation of perception systems," Proceedings of the Workshop on Performance Metrics for Intelligent Systems, ACM, 2012.
  11. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Cambridge University Press, 2003.
  12. Z. Zhang, "A flexible new technique for camera calibration," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 22, no. 11, pp. 1330-1334, Nov. 2000. https://doi.org/10.1109/34.888718
  13. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," Proceedings of International Joint Conference on Artificial Intelligence, vol. 81. 1981.
  14. J. B. Gao and C. J. Harris, "Some remarks on Kalman filters for the multisensor fusion," Information Fusion, vol. 3, no. 3, pp. 191-201, 2002. https://doi.org/10.1016/S1566-2535(02)00070-2