Journal of Radiation Protection and Research

The Korean Association for Radiation Protection (대한방사선방어학회)
권호 표지
DOI QR코드

DOI QR Code

Preliminary Application of Synthetic Computed Tomography Image Generation from Magnetic Resonance Image Using Deep-Learning in Breast Cancer Patients

  • Jeon, Wan (Department of Radiation Oncology, Dongnam Institute of Radiological and Medical Sciences) ;
  • An, Hyun Joon (Department of Radiation Oncology, Seoul National University Hospital) ;
  • Kim, Jung-in (Department of Radiation Oncology, Seoul National University Hospital) ;
  • Park, Jong Min (Department of Radiation Oncology, Seoul National University Hospital) ;
  • Kim, Hyoungnyoun (GenAI Inc.) ;
  • Shin, Kyung Hwan (Department of Radiation Oncology, Seoul National University Hospital) ;
  • Chie, Eui Kyu (Department of Radiation Oncology, Seoul National University Hospital)
  • Received : 2019.05.27
  • Accepted : 2019.12.13
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Background: Magnetic resonance (MR) image guided radiation therapy system, enables real time MR guided radiotherapy (RT) without additional radiation exposure to patients during treatment. However, MR image lacks electron density information required for dose calculation. Image fusion algorithm with deformable registration between MR and computed tomography (CT) was developed to solve this issue. However, delivered dose may be different due to volumetric changes during image registration process. In this respect, synthetic CT generated from the MR image would provide more accurate information required for the real time RT. Materials and Methods: We analyzed 1,209 MR images from 16 patients who underwent MR guided RT. Structures were divided into five tissue types, air, lung, fat, soft tissue and bone, according to the Hounsfield unit of deformed CT. Using the deep learning model (U-NET model), synthetic CT images were generated from the MR images acquired during RT. This synthetic CT images were compared to deformed CT generated using the deformable registration. Pixel-to-pixel match was conducted to compare the synthetic and deformed CT images. Results and Discussion: In two test image sets, average pixel match rate per section was more than 70% (67.9 to 80.3% and 60.1 to 79%; synthetic CT pixel/deformed planning CT pixel) and the average pixel match rate in the entire patient image set was 69.8%. Conclusion: The synthetic CT generated from the MR images were comparable to deformed CT, suggesting possible use for real time RT. Deep learning model may further improve match rate of synthetic CT with larger MR imaging data.

Keywords

References

  1. Park JM, Park SY, Kim HJ, Wu HG, Carlson J, Kim JI. A comparative planning study for lung SABR between tri-Co-60 magnetic resonance image guided radiation therapy system and volumetric modulated arc therapy. Radiother. Oncol. 2016;120(2):279-285. https://doi.org/10.1016/j.radonc.2016.06.013
  2. Choi CH, Park SY, Kim JI, Kim JH, Kim K, Carlson J, Park JM. Quality of tri-Co-60 MR-IGRT treatment plans in comparison with VMAT treatment plans for spine SABR. Br. J. Radiol. 2017;90(1070):20160652. https://doi.org/10.1259/bjr.20160652
  3. Khoo VS, Joon DL. New developments in MRI for target volume delineation in radiotherapy. Br. J. Radiol. 2006;79(1):S2-S15. https://doi.org/10.1259/bjr/41321492
  4. Schultheiss TE, Tome WA, Orton CG. Point/counterpoint: it is not appropriate to "deform" dose along with deformable image registration in adaptive radiotherapy. Med. Phys. 2012;39(11):6531-6533. https://doi.org/10.1118/1.4722968
  5. Han X. MR-based synthetic CT generation using a deep convolutional neural network method. Med. Phys. 2017;44(4):1408-1419. https://doi.org/10.1002/mp.12155
  6. Dreiseitl S, Ohno-Machado L, Kittler H, Vinterbo S, Billhardt H, Binder M. A comparison of machine learning methods for the diagnosis of pigmented skin lesions. J. Biomed. Inform. 2001;34(1):28-36. https://doi.org/10.1006/jbin.2001.1004
  7. Wei L, Yang Y, Nishikawa R, Jiang Y. A Study on Several Machine-Learning Methods for Classification of Malignant and Benign Clustered Microcalcifications. IEEE Trans. Med. Imaging. 2005;24(3):371-380. https://doi.org/10.1109/TMI.2004.842457
  8. Jones N. Computer science: The learning machines. Nature. 2014;505(7482):146-148. https://doi.org/10.1038/505146a
  9. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention. Springer, Cham. 2015:234-241.
  10. Seregni M, Paganelli C, Summers P, Bellomi M, Baroni G, Riboldi M. A Hybrid Image Registration and Matching Framework for Real-Time Motion Tracking in MRI-Guided Radiotherapy. IEEE Trans. Biomed. Eng. 2018;65(1):131-139. https://doi.org/10.1109/TBME.2017.2696361
  11. McPartlin AJ, et al. MRI-guided prostate adaptive radiotherapy - A systematic review. Radiother. Oncol. 2016;119(3):371-380. https://doi.org/10.1016/j.radonc.2016.04.014
  12. Vestergaard A, et al. The potential of MRI-guided online adaptive re-optimisation in radiotherapy of urinary bladder cancer. Radiother. Oncol. 2016;118(1):154-159. https://doi.org/10.1016/j.radonc.2015.11.003
  13. Abedi I, Tavakkoli MB, Jabbari K, Amouheidari A, Yadegarfard G. Dosimetric and Radiobiological Evaluation of Multiparametric MRI-Guided Dose Painting in Radiotherapy of Prostate Cancer. J. Med. Signals Sens. 2017;7(2):114-121. https://doi.org/10.4103/2228-7477.205504
  14. Jeon SH, Shin KH, Park SY, Kim JI, Park JM, Kim JH, Chie EK, Wu H. Seroma changes during magnetic resonance imaging-guided partial breast irradiation and its clinical implications. Radiat. Oncol. 2017;12(1):103. https://doi.org/10.1186/s13014-017-0843-7
  15. Chen AM, Hsu S, Lamb J, Yang Y, Agazaryan N, Steinberg ML, Low DA, Cao M. MRI-guided radiotherapy for head and neck cancer: initial clinical experience. Clin. Transl. Oncol. 2018;20(2):160-168. https://doi.org/10.1007/s12094-017-1704-4
  16. Lee HJ, Kadbi M, Bosco G, Ibbott GS. Real-time volumetric relative dosimetry for magnetic resonance-image-guided radiation therapy (MR-IGRT). Phys. Med. Biol. 2018;63(4):045021. https://doi.org/10.1088/1361-6560/aaac22

Cited by

  1. Deep learning methods to generate synthetic CT from MRI in radiotherapy: A literature review vol.89, 2019, https://doi.org/10.1016/j.ejmp.2021.07.027
  2. Deep learning based synthetic‐CT generation in radiotherapy and PET: A review vol.48, pp.11, 2019, https://doi.org/10.1002/mp.15150