DOI QR코드

DOI QR Code

DentalRegiformer: A Fully Automated Deep Learning Framework for Coarse-to-Fine Registration between Intraoral Scan and CBCT Image

  • Heejin Yun (Interdisciplinary Program in Bioengineering, Graduate School of Engineering, Seoul National University) ;
  • Yubin Lee (Department of Dentistry, School of Dentistry, Seoul National University) ;
  • Jimin Sun (Department of Dentistry, School of Dentistry, Seoul National University) ;
  • Whaeum Lee (Department of Dentistry, School of Dentistry, Seoul National University) ;
  • Dahee Kim (Department of Applied Bioengineering, Graduate School of Convergence Science and Technology, Seoul National University) ;
  • Won-Jin Yi (Interdisciplinary Program in Bioengineering, Graduate School of Engineering, Seoul National University)
  • Received : 2025.11.03
  • Accepted : 2025.12.11
  • Published : 2025.12.31

Abstract

Purpose: Precise registration between intraoral scans (IOSs) and CBCT images is essential for many digital dentistry applications. The purpose of this study was to develop DentalRegiformer, a fully automated, end-to-end deep learning framework that ensures accurate registration between IOS and CBCT images. Materials and Methods: The network was trained on 88 paired CBCT-IOS datasets from 44 patients, with ground-truth alignments obtained through manual registration performed by trained dental students. To enhance clinical accuracy and efficiency, a multi-stage coarse-to-fine strategy is proposed to integrate segmentation, classification, and registration into a unified pipeline. First, tooth segmentation is performed on CBCT volumes using 3D nnU-Net to generate segmented tooth regions for alignment. Simultaneously, IOS datasets are classified as maxillary or mandibular dentition using a hybrid representation that combines geometric descriptors with point cloud features extracted via a DGCNN network. Registration is then conducted in two phases: coarse alignment using a DCP framework for feature encoding and probabilistic correspondence estimation to compute the initial rigid transformation, followed by fine alignment using GeoTransformer's local-to-global iterative refinement, which alternates between local feature aggregation and global context integration to progressively enhance correspondence accuracy and achieve precise rigid registration. Results: The segmentation model achieved robust results, with a Dice coefficient of 0.924, precision of 0.916, and recall of 0.934. The DGCNN classifier perfectly distinguished maxillary and mandibular arches, achieving sensitivity, specificity, ROC, and accuracy of 1.000. For registration, DentalRegiformer accurately predicted transformation between IOS and CBCT images, yielding an overall RMSE of 0.556 mm; MAEs of 0.231mm, 0.329 mm, and 0.283 mm along the x-, y-, and z-axes, respectively; and inference time of 19.623 seconds. In comparison, the manual method based on combined pair-points and ICP had an RMSE of 0.615 mm; MAEs of 0.244 mm, 0.347 mm, and 0.298 mm along the x-, y-, and z-axes, respectively; and processing time of 431.6 seconds. Discussion and Conclusion: Therefore, DentalRegiformer is a fully automated, deep learning-based solution that minimizes manual intervention and improves clinical efficiency. The framework streamlines digital dental workflows, reduces operator-dependent errors, and facilitates automated, personalized dental care.

Keywords

Acknowledgement

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. 2023R1A2C200532611). This work was also supported by the Technology Innovation Program (or Industrial Strategic Technology Development Program-Advanced Biomaterials) (RS-2025-14322975) funded by the Ministry of Trade, Industry, & Energy.

References

  1. Gawali N, Shah PP, Gowdar IM, Bhavsar KA, Giri D, Laddha R. The Evolution of Digital Dentistry: A Comprehensive Review. J Pharm Bioallied Sci. 2024;16(Suppl 3):S1920-2. https://doi.org/10.4103/jpbs.jpbs_11_24
  2. Mizumoto RM, Yilmaz B. Intraoral scan bodies in implant dentistry: A systematic review. J Prosthet Dent. 2018;120:343-52. https://doi.org/10.1016/j.prosdent.2017.10.029
  3. Nasseh I, Al-Rawi W. Cone Beam Computed Tomography. Dent Clin North Am. 2018;62:361-91. https://doi.org/10.1016/j.cden.2018.03.002
  4. Mangano F, Gandolfi A, Luongo G, Logozzo S. Intraoral scanners in dentistry: a review of the current literature. BMC Oral Health. 2017;17:149. https://doi.org/10.1186/s12903-017-0442-x
  5. Aswani K, Wankhade S, Khalikar A, Deogade S. Accuracy of an intraoral digital impression: A review. J Indian Prosthodont Soc. 2020;20:27-37. https://doi.org/10.4103/jips.jips_327_19
  6. Alkadi L. A Comprehensive Review of Factors That Influence the Accuracy of Intraoral Scanners. Diagnostics (Basel). 2023;13:3291. https://doi.org/10.3390/diagnostics13213291
  7. Ahmad M, Jenny J, Downie M. Application of cone beam computed tomography in oral and maxillofacial surgery. Aust Dent J. 2012;57(Suppl 1):82-94. https://doi.org/10.1111/adj.2012.57.issue-s1
  8. Zaman MU. Comparing Radiation Doses in CBCT and Medical CT Imaging for Dental Applications. J Pharm Bioallied Sci. 2024;16(Suppl 1):S883-5. https://doi.org/10.4103/jpbs.jpbs_1077_23
  9. Kaasalainen T, Ekholm M, Siiskonen T, Kortesniemi M. Dental cone beam CT: An updated review. Phys Med. 2021;88:193-217. https://doi.org/10.1016/j.ejmp.2021.07.007
  10. Affendi NHK, Babiker J, Mohd Yusof MYP. CBCT assessment of alveolar bone wall morphology and its correlation with tooth angulation in the anterior mandible: a new classification for immediate implant placement. J Periodontal Implant Sci. 2023;53:453-66. https://doi.org/10.5051/jpis.2105000250
  11. Liu J, Hao J, Lin H, Pan W, Yang J, Feng Y, Wang G, Li J, Jin Z, Zhao Z, Liu Z. Deep learning-enabled 3D multimodal fusion of cone-beam CT and intraoral mesh scans for clinically applicable tooth-bone reconstruction. Patterns (N Y). 2023;4:100825.
  12. Preda F, Nogueira-Reis F, Stanciu EM, Smolders A, Jacobs R, Shaheen E. Validation of automated registration of intraoral scan onto Cone Beam Computed Tomography for an efficient digital dental workflow. J Dent. 2024;149:105282. https://doi.org/10.1016/j.jdent.2024.105282
  13. Lee YJ, Oh JH, Kim SG. Virtual surgical plan with custom surgical guide for orthognathic surgery: systematic review and meta-analysis. Maxillofac Plast Reconstr Surg. 2024;46:39. https://doi.org/10.1186/s40902-024-00449-2
  14. Shujaat S, Bornstein MM, Price JB, Jacobs R. Integration of imaging modalities in digital dental workflows possibilities, limitations, and potential future developments. Dentomaxillofac Radiol. 2021;50:20210268. https://doi.org/10.1259/dmfr.20210268
  15. Risholm P, Golby AJ, Wells W 3rd. Multimodal image registration for preoperative planning and image-guided neurosurgical procedures. Neurosurg Clin N Am. 2011;22:197-206, viii. https://doi.org/10.1016/j.nec.2010.12.001
  16. Elgarba BM, Fontenele RC, Ali S, Swaity A, Meeus J, Shujaat S, Jacobs R. Validation of a novel AI-based automated multimodal image registration of CBCT and intraoral scan aiding presurgical implant planning. Clin Oral Implants Res. 2024;35:1506-17. https://doi.org/10.1111/clr.v35.11
  17. Baldini B, Papasratorn D, Fagundes FB, Fontenele RC, Jacobs R. Validation of a novel tool for automated tooth modelling by fusion of CBCT-derived roots with the respective IOS-derived crowns. J Dent. 2025;153:105546. https://doi.org/10.1016/j.jdent.2024.105546
  18. Yang J, Li H, Campbell D, Jia Y. Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration. IEEE Trans Pattern Anal Mach Intell. 2016;38:2241-54. https://doi.org/10.1109/TPAMI.2015.2513405
  19. Zou B, Kim JH, Kim SH, Choi TH, Shin Y, Kook YA, Lee NK. Accuracy of a surface-based fusion method when integrating digital models and the cone beam computed tomography scans with metal artifacts. Sci Rep. 2022;12:8034. https://doi.org/10.1038/s41598-022-11677-9
  20. Chrisochoides N, Liu Y, Drakopoulos F, Kot A, Foteinos P, Tsolakis C, Billias E, Clatz O, Ayache N, Fedorov A, Golby A, Black P, Kikinis R. Comparison of physics-based deformable registration methods for image-guided neurosurgery. Front Digit Health. 2023;5:1283726.
  21. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI. A survey on deep learning in medical image analysis. Med Image Anal. 2017;42:60-88. https://doi.org/10.1016/j.media.2017.07.005
  22. Wu Y, Yan H, Ding K. Transformer based 3D tooth segmentation via point cloud region partition. Sci Rep. 2024;14:28513. https://doi.org/10.1038/s41598-024-79485-x
  23. Huang W, Yang H, Liu X, Li C, Zhang I, Wang R, Zheng H, Wang S. A Coarse-to-Fine Deformable Transformation Framework for Unsupervised Multi-Contrast MR Image Registration with Dual Consistency Constraint. IEEE Trans Med Imaging. 2021;40:2589-99. https://doi.org/10.1109/TMI.2021.3059282
  24. Isensee F, Jaeger PF, Kohl SAA, Petersen J, Maier-Hein KH. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat Methods. 2021;18:203-11. https://doi.org/10.1038/s41592-020-01008-z
  25. Phan AV, Nguyen ML, Nguyen YLH, Bui LT. DGCNN: A convolutional neural network over large scale labeled graphs. Neural Netw. 2018;108:533-43. https://doi.org/10.1016/j.neunet.2018.09.001
  26. Qin Z, Yu H, Wang C, Guo Y, Peng Y, Ilic S, Hu D, Xu K. GeoTransformer: Fast and Robust Point Cloud Registration With Geometric Transformer. IEEE Trans Pattern Anal Mach Intell. 2023;45:9806-21. https://doi.org/10.1109/TPAMI.2023.3259038
  27. Srisuradetchai P, Suksrikran K. Random kernel k-nearest neighbors regression. Front Big Data. 2024;7:1402384. https://doi.org/10.3389/fdata.2024.1402384
  28. Lawrence J, Bernal J, Witzgall C. A Purely Algebraic Justification of the Kabsch-Umeyama Algorithm. J Res Natl Inst Stand Technol. 2019;124:1-6. https://doi.org/10.6028/jres.124.028
  29. Li Y, Yan B, Hou J, Bai B, Huang X, Xu C, Fang L. UNet based on dynamic convolution decomposition and triplet attention. Sci Rep. 2024;14:271. https://doi.org/10.1038/s41598-023-50989-2
  30. Eldar Y, Lindenbaum M, Porat M, Zeevi YY. The farthest point strategy for progressive image sampling. IEEE Trans Image Process. 1997;6:1305-15. https://doi.org/10.1109/TIP.83
  31. Shamir RR, Joskowicz L, Shoshan Y. Fiducial optimization for minimal target registration error in image-guided neurosurgery. IEEE Trans Med Imaging. 2012;31:725-37. https://doi.org/10.1109/TMI.2011.2175939
  32. Dot G, Chaurasia A, Dubois G, Savoldelli C, Haghighat S, Azimian S, Taramsari AR, Sivaramakrishnan G, Issa J, Dubey A, Schouman T, Gajny L. DentalSegmentator: Robust open source deep learning-based CT and CBCT image segmentation. J Dent. 2024;147:105130. https://doi.org/10.1016/j.jdent.2024.105130
  33. Haylaz E, Gumussoy I, Duman SB, Kalabalik F, Eren MC, Demirsoy MS, Celik O, Bayrakdar IS. Automatic Segmentation of the Nasolacrimal Canal: Application of the nnU-Net v2 Model in CBCT Imaging. J Clin Med. 2025;14:778. https://doi.org/10.3390/jcm14030778
  34. Yang J, Li Z, Zhan P, Li X, Wang K, Han J, Yang P. Proximal femur parameter measurement via improved PointNet+. Int J Med Robot. 2023;19:e2494. https://doi.org/10.1002/rcs.v19.3
  35. Shou Y, Chen Z, Feng P, Wei Y, Qi B, Dong R, Yu H, Li H. Integrating PointNet-Based Model and Machine Learning Algorithms for Classification of Rupture Status of IAs. Bioengineering (Basel). 2024;11:660. https://doi.org/10.3390/bioengineering11070660
  36. Yan J, Wang X, Cai J, Qin Q, Yang H, Wang Q, Cheng Y, Gan T, Jiang H, Deng J, Chen B. Medical image segmentation model based on triple gate MultiLayer perceptron. Sci Rep. 2022;12:6103. https://doi.org/10.1038/s41598-022-09452-x
  37. Wang Y, Solomon JM. Deep Closest Point: Learning Representations for Point Cloud Registration. Available from URL: https://openaccess.thecvf.com/content_ICCV_2019/papers/Wang_Deep_Closest_Point_Learning_Representations_for_Point_Cloud_Registration_ICCV_2019_paper.pdf (Accessed on December 13, 2025).
  38. Krithika Alias AnbuDevi M, Suganthi K. Review of Semantic Segmentation of Medical Images Using Modified Architectures of UNET. Diagnostics (Basel). 2022;12:3064. https://doi.org/10.3390/diagnostics12123064
  39. Kim YJ, Ahn JH, Lim HK, Nguyen TP, Jha N, Kim A, Yoon J. Novel Procedure for Automatic Registration between Cone-Beam Computed Tomography and Intraoral Scan Data Supported with 3D Segmentation. Bioengineering (Basel). 2023;10:1326. https://doi.org/10.3390/bioengineering10111326
  40. Flügge T, Derksen W, Te Poel J, Hassan B, Nelson K, Wismeijer D. Registration of cone beam computed tomography data and intraoral surface scans - A prerequisite for guided implant surgery with CAD/CAM drilling guides. Clin Oral Implants Res. 2017;28:1113-8. https://doi.org/10.1111/clr.2017.28.issue-9
  41. Zheng Q, Wu Y, Chen J, Wang X, Zhou M, Li H, Lin J, Zhang W, Chen X. Automatic multimodal registration of cone-beam computed tomography and intraoral scans: a systematic review and meta-analysis. Clin Oral Investig. 2025;29:97. https://doi.org/10.1007/s00784-025-06183-x
  42. Naik RR, Hoblidar A, Bhat SN, Ampar N, Kundangar R. A Hybrid 3D-2D Image Registration Framework for Pedicle Screw Trajectory Registration between Intraoperative X-ray Image and Preoperative CT Image. J Imaging. 2022;8:185. https://doi.org/10.3390/jimaging8070185
  43. Mojica M, Pop M, Ebrahimi M. Medical image alignment based on landmark- and approximate contour-matching. J Med Imaging (Bellingham). 2021;8:064003. https://doi.org/10.1117/1.JMI.8.6.064003
  44. Darzi F, Bocklitz T. A Review of Medical Image Registration for Different Modalities. Bioengineering (Basel). 2024;11:786.
  45. Shokri A, Jamalpour MR, Khavid A, Mohseni Z, Sadeghi M. Effect of exposure parameters of cone beam computed tomography on metal artifact reduction around the dental implants in various bone densities. BMC Med Imaging. 2019;19:34. https://doi.org/10.1186/s12880-019-0334-4
  46. Ferrario VF, Sforza C, Miani A Jr, Tartaglia G. Maxillary versus mandibular arch form differences in human permanent dentition assessed by Euclidean-distance matrix analysis. Arch Oral Biol. 1994;39:135-9. https://doi.org/10.1016/0003-9969(94)90108-2