Investigative Magnetic Resonance Imaging

Korean Society of Magnetic Resonance in Medicine (대한자기공명의과학회)
권호 표지
DOI QR코드

DOI QR Code

Radiomics and Deep Learning in Brain Metastases: Current Trends and Roadmap to Future Applications

  • Received : 2021.02.08
  • Accepted : 2021.05.03
  • Published : 2021.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

Advances in radiomics and deep learning (DL) hold great potential to be at the forefront of precision medicine for the treatment of patients with brain metastases. Radiomics and DL can aid clinical decision-making by enabling accurate diagnosis, facilitating the identification of molecular markers, providing accurate prognoses, and monitoring treatment response. In this review, we summarize the clinical background, unmet needs, and current state of research of radiomics and DL for the treatment of brain metastases. The promises, pitfalls, and future roadmap of radiomics and DL in brain metastases are addressed as well.

Keywords

Acknowledgement

This research received funding from the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, Information and Communication Technologies & Future Planning (2020R1A2C1003886). This research was also supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2020R1I1A1A01071648). This study was financially supported by the Faculty Research Grant of Yonsei University College of Medicine (6-2020-0149).

References

  1. Nayak L, Lee EQ, Wen PY. Epidemiology of brain metastases. Curr Oncol Rep 2012;14:48-54 https://doi.org/10.1007/s11912-011-0203-y
  2. Loeffler JS, Patchell RA, Sawaya R. Metastatic brain cancer. In Davita VT, Hellman S, Rosenberg SA, eds. Cancer: principles and practice of oncology. Philadelphia: JP Lippincott, 1997:2523
  3. Kondziolka D, Patel A, Lunsford LD, Kassam A, Flickinger JC. Stereotactic radiosurgery plus whole brain radiotherapy versus radiotherapy alone for patients with multiple brain metastases. Int J Radiat Oncol Biol Phys 1999;45:427-434
  4. Patchell RA, Tibbs PA, Walsh JW, et al. A randomized trial of surgery in the treatment of single metastases to the brain. N Engl J Med 1990;322:494-500 https://doi.org/10.1056/NEJM199002223220802
  5. Mehta MP, Rodrigus P, Terhaard CH, et al. Survival and neurologic outcomes in a randomized trial of motexafin gadolinium and whole-brain radiation therapy in brain metastases. J Clin Oncol 2003;21:2529-2536 https://doi.org/10.1200/JCO.2003.12.122
  6. Sperduto PW, Kased N, Roberge D, et al. Summary report on the graded prognostic assessment: an accurate and facile diagnosis-specific tool to estimate survival for patients with brain metastases. J Clin Oncol 2012;30:419-425 https://doi.org/10.1200/JCO.2011.38.0527
  7. An C, Park YW, Ahn SS, Han K, Kim H, Lee S-K. Radiomics machine learning study with a small sample size: single random training-test set split may result in unreliable results. https://www.researchsquare.com/article/rs-105766/v2. Accessed June 9, 2021
  8. Anzalone N, Essig M, Lee SK, et al. Optimizing contrast-enhanced magnetic resonance imaging characterization of brain metastases: relevance to stereotactic radiosurgery. Neurosurgery 2013;72:691-701 https://doi.org/10.1227/NEU.0b013e3182889ddf
  9. Nagao E, Yoshiura T, Hiwatashi A, et al. 3D turbo spin-echo sequence with motion-sensitized driven-equilibrium preparation for detection of brain metastases on 3T MR imaging. AJNR Am J Neuroradiol 2011;32:664-670 https://doi.org/10.3174/ajnr.A2343
  10. Park YW, Ahn SJ. Comparison of contrast-enhanced T2 FLAIR and 3D T1 black-blood fast spin-echo for detection of leptomeningeal metastases. Investig Magn Reson Imaging 2018;22:86-93 https://doi.org/10.13104/imri.2018.22.2.86
  11. Lin NU, Lee EQ, Aoyama H, et al. Response assessment criteria for brain metastases: proposal from the RANO group. Lancet Oncol 2015;16:e270-278 https://doi.org/10.1016/S1470-2045(15)70057-4
  12. Growcott S, Dembrey T, Patel R, Eaton D, Cameron A. Inter-observer variability in target volume delineations of benign and metastatic brain tumours for stereotactic radiosurgery: results of a national quality assurance programme. Clin Oncol (R Coll Radiol) 2020;32:13-25 https://doi.org/10.1016/j.clon.2019.06.015
  13. Cho SJ, Sunwoo L, Baik SH, Bae YJ, Choi BS, Kim JH. Brain metastasis detection using machine learning: a systematic review and meta-analysis. Neuro Oncol 2021;23:214-225 https://doi.org/10.1093/neuonc/noaa232
  14. Kamnitsas K, Ledig C, Newcombe VFJ, et al. Efficient multiscale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 2017;36:61-78 https://doi.org/10.1016/j.media.2016.10.004
  15. Charron O, Lallement A, Jarnet D, Noblet V, Clavier JB, Meyer P. Automatic detection and segmentation of brain metastases on multimodal MR images with a deep convolutional neural network. Comput Biol Med 2018;95:43-54 https://doi.org/10.1016/j.compbiomed.2018.02.004
  16. Grovik E, Yi D, Iv M, Tong E, Rubin D, Zaharchuk G. Deep learning enables automatic detection and segmentation of brain metastases on multisequence MRI. J Magn Reson Imaging 2020;51:175-182 https://doi.org/10.1002/jmri.26766
  17. Zhang M, Young GS, Chen H, et al. Deep-learning detection of cancer metastases to the brain on MRI. J Magn Reson Imaging 2020;52:1227-1236 https://doi.org/10.1002/jmri.27129
  18. Bousabarah K, Ruge M, Brand JS, et al. Deep convolutional neural networks for automated segmentation of brain metastases trained on clinical data. Radiat Oncol 2020;15:87 https://doi.org/10.1186/s13014-020-01514-6
  19. Dikici E, Ryu JL, Demirer M, et al. Automated brain metastases detection framework for T1-weighted contrast-enhanced 3D MRI. IEEE J Biomed Health Inform 2020;24:2883-2893 https://doi.org/10.1109/jbhi.2020.2982103
  20. Xue J, Wang B, Ming Y, et al. Deep learning-based detection and segmentation-assisted management of brain metastases. Neuro Oncol 2020;22:505-514 https://doi.org/10.1093/neuonc/noz234
  21. Zhou Z, Sanders JW, Johnson JM, et al. Computer-aided detection of brain metastases in T1-weighted MRI for stereotactic radiosurgery using deep learning single-shot detectors. Radiology 2020;295:407-415 https://doi.org/10.1148/radiol.2020191479
  22. Suh CH, Jung SC, Kim KW, Pyo J. The detectability of brain metastases using contrast-enhanced spin-echo or gradient-echo images: a systematic review and meta-analysis. J Neurooncol 2016;129:363-371 https://doi.org/10.1007/s11060-016-2185-y
  23. Park YW, Jun Y, Lee Y, et al. Robust performance of deep learning for automatic detection and segmentation of brain metastases using three-dimensional black-blood and three-dimensional gradient echo imaging. Eur Radiol 2021;31:6686-6695 https://doi.org/10.1007/s00330-021-07783-3
  24. Woo I, Lee A, Jung SC, et al. Fully automatic segmentation of acute ischemic lesions on diffusion-weighted imaging using convolutional neural networks: comparison with conventional algorithms. Korean J Radiol 2019;20:1275-1284 https://doi.org/10.3348/kjr.2018.0615
  25. Xue Y, Farhat FG, Boukrina O, et al. A multi-path 2.5 dimensional convolutional neural network system for segmenting stroke lesions in brain MRI images. Neuroimage Clin 2020;25:102118 https://doi.org/10.1016/j.nicl.2019.102118
  26. Isensee F, Kickingereder P, Wick W, Bendszus M, Maier-Hein KH. No new-net. International MICCAI Brainlesion Workshop, 2018:234-244
  27. Ostrom QT, Cioffi G, Gittleman H, et al. CBTRUS statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2012-2016. Neuro Oncol 2019;21:v1-v100 https://doi.org/10.1093/neuonc/noz150
  28. Kim YE, Choi SH, Lee ST, et al. Differentiation between glioblastoma and primary central nervous system lymphoma using dynamic susceptibility contrast-enhanced perfusion MR imaging: comparison study of the manual versus semiautomatic segmentation method. Investig Magn Reson Imaging 2017;21:9-19 https://doi.org/10.13104/imri.2017.21.1.9
  29. Kwon YW, Moon W-J, Park M, et al. Dynamic susceptibility contrast (DSC) perfusion MR in the prediction of long-term survival of glioblastomas (GBM): correlation with MGMT promoter methylation and 1p/19q deletions. Investig Magn Reson Imaging 2018;22:158-167 https://doi.org/10.13104/imri.2018.22.3.158
  30. Cagney DN, Martin AM, Catalano PJ, et al. Incidence and prognosis of patients with brain metastases at diagnosis of systemic malignancy: a population-based study. Neuro Oncol 2017;19:1511-1521 https://doi.org/10.1093/neuonc/nox077
  31. Qian Z, Li Y, Wang Y, et al. Differentiation of glioblastoma from solitary brain metastases using radiomic machine-learning classifiers. Cancer Lett 2019;451:128-135 https://doi.org/10.1016/j.canlet.2019.02.054
  32. Dong F, Li Q, Jiang B, et al. Differentiation of supratentorial single brain metastasis and glioblastoma by using perienhancing oedema region-derived radiomic features and multiple classifiers. Eur Radiol 2020;30:3015-3022 https://doi.org/10.1007/s00330-019-06460-w
  33. Chen C, Ou X, Wang J, Guo W, Ma X. Radiomics-based machine learning in differentiation between glioblastoma and metastatic brain tumors. Front Oncol 2019;9:806 https://doi.org/10.3389/fonc.2019.00806
  34. Artzi M, Bressler I, Ben Bashat D. Differentiation between glioblastoma, brain metastasis and subtypes using radiomics analysis. J Magn Reson Imaging 2019;50:519-528 https://doi.org/10.1002/jmri.26643
  35. Ortiz-Ramon R, Ruiz-Espana S, Molla-Olmos E, Moratal D. Glioblastomas and brain metastases differentiation following an MRI texture analysis-based radiomics approach. Phys Med 2020;76:44-54 https://doi.org/10.1016/j.ejmp.2020.06.016
  36. Bae S, An C, Ahn SS, et al. Robust performance of deep learning for distinguishing glioblastoma from single brain metastasis using radiomic features: model development and validation. Sci Rep 2020;10:12110 https://doi.org/10.1038/s41598-020-68980-6
  37. Shin I, Kim H, Ahn SS, et al. Development and validation of a deep learning-based model to distinguish glioblastoma from solitary brain metastasis using conventional MR images. AJNR Am J Neuroradiol 2021;42:838-844 https://doi.org/10.3174/ajnr.A7003
  38. Hughes RAC, Brainin M, Gilhus NE. European handbook of neurological management. Wiley-Blackwell, 2008
  39. Ortiz-Ramon R, Larroza A, Ruiz-Espana S, Arana E, Moratal D. Classifying brain metastases by their primary site of origin using a radiomics approach based on texture analysis: a feasibility study. Eur Radiol 2018;28:4514-4523 https://doi.org/10.1007/s00330-018-5463-6
  40. Kniep HC, Madesta F, Schneider T, et al. Radiomics of brain MRI: utility in prediction of metastatic tumor type. Radiology 2019;290:479-487 https://doi.org/10.1148/radiol.2018180946
  41. Ballard P, Yates JW, Yang Z, et al. Preclinical comparison of osimertinib with other EGFR-TKIs in EGFR-mutant NSCLC brain metastases models, and early evidence of clinical brain metastases activity. Clin Cancer Res 2016;22:5130-5140 https://doi.org/10.1158/1078-0432.CCR-16-0399
  42. Soffietti R, Ahluwalia M, Lin N, Ruda R. Management of brain metastases according to molecular subtypes. Nat Rev Neurol 2020;16:557-574 https://doi.org/10.1038/s41582-020-0391-x
  43. Long GV, Trefzer U, Davies MA, et al. Dabrafenib in patients with Val600Glu or Val600Lys BRAF-mutant melanoma metastatic to the brain (BREAK-MB): a multicentre, open-label, phase 2 trial. Lancet Oncol 2012;13:1087-1095 https://doi.org/10.1016/S1470-2045(12)70431-X
  44. Sloot S, Chen YA, Zhao X, et al. Improved survival of patients with melanoma brain metastases in the era of targeted BRAF and immune checkpoint therapies. Cancer 2018;124:297-305 https://doi.org/10.1002/cncr.30946
  45. Brastianos PK, Carter SL, Santagata S, et al. Genomic characterization of brain metastases reveals branched evolution and potential therapeutic targets. Cancer Discov 2015;5:1164-1177 https://doi.org/10.1158/2159-8290.CD-15-0369
  46. Alderton GK. Tumour evolution: epigenetic and genetic heterogeneity in metastasis. Nat Rev Cancer 2017;17:141 https://doi.org/10.1038/nrc.2017.11
  47. Soffietti R, Abacioglu U, Baumert B, et al. Diagnosis and treatment of brain metastases from solid tumors: guidelines from the European Association of Neuro-Oncology (EANO). Neuro Oncol 2017;19:162-174 https://doi.org/10.1093/neuonc/now241
  48. Ahn SJ, Kwon H, Yang JJ, et al. Contrast-enhanced T1-weighted image radiomics of brain metastases may predict EGFR mutation status in primary lung cancer. Sci Rep 2020;10:8905 https://doi.org/10.1038/s41598-020-65470-7
  49. Park YW, An C, Lee J, et al. Diffusion tensor and postcontrast T1-weighted imaging radiomics to differentiate the epidermal growth factor receptor mutation status of brain metastases from non-small cell lung cancer. Neuroradiology 2021;63:343-352 https://doi.org/10.1007/s00234-020-02529-2
  50. Chen BT, Jin T, Ye N, et al. Radiomic prediction of mutation status based on MR imaging of lung cancer brain metastases. Magn Reson Imaging 2020;69:49-56 https://doi.org/10.1016/j.mri.2020.03.002
  51. Wang G, Wang B, Wang Z, et al. Radiomics signature of brain metastasis: prediction of EGFR mutation status. Eur Radiol 2021;31:4538-4547 https://doi.org/10.1007/s00330-020-07614-x
  52. Shofty B, Artzi M, Shtrozberg S, et al. Virtual biopsy using MRI radiomics for prediction of BRAF status in melanoma brain metastasis. Sci Rep 2020;10:6623 https://doi.org/10.1038/s41598-020-63821-y
  53. Graber JJ, Cobbs CS, Olson JJ. Congress of neurological surgeons systematic review and evidence-based guidelines on the use of stereotactic radiosurgery in the treatment of adults with metastatic brain tumors. Neurosurgery 2019;84:E168-E170 https://doi.org/10.1093/neuros/nyy543
  54. Jaboin JJ, Ferraro DJ, DeWees TA, et al. Survival following gamma knife radiosurgery for brain metastasis from breast cancer. Radiat Oncol 2013;8:131 https://doi.org/10.1186/1748-717X-8-131
  55. Huang CY, Lee CC, Yang HC, et al. Radiomics as prognostic factor in brain metastases treated with Gamma Knife radiosurgery. J Neurooncol 2020;146:439-449 https://doi.org/10.1007/s11060-019-03343-4
  56. Zheng Y, Geng D, Yu T, et al. Prognostic value of pretreatment MRI texture features in breast cancer brain metastasis treated with Gamma Knife radiosurgery. Acta Radiol 2021;62:1208-1216 https://doi.org/10.1177/0284185120956296
  57. Della Seta M, Collettini F, Chapiro J, et al. A 3D quantitative imaging biomarker in pre-treatment MRI predicts overall survival after stereotactic radiation therapy of patients with a singular brain metastasis. Acta Radiol 2019;60:1496-1503 https://doi.org/10.1177/0284185119831692
  58. Tawbi HA, Forsyth PA, Algazi A, et al. Combined nivolumab and ipilimumab in melanoma metastatic to the brain. N Engl J Med 2018;379:722-730 https://doi.org/10.1056/NEJMoa1805453
  59. Bhatia A, Birger M, Veeraraghavan H, et al. MRI radiomic features are associated with survival in melanoma brain metastases treated with immune checkpoint inhibitors. Neuro Oncol 2019;21:1578-1586 https://doi.org/10.1093/neuonc/noz141
  60. Brown PD, Brown CA, Pollock BE, Gorman DA, Foote RL. Stereotactic radiosurgery for patients with "radioresistant" brain metastases. Neurosurgery 2002;51:656-665; discussion 665-657 https://doi.org/10.1097/00006123-200209000-00009
  61. Le Rhun E, Dhermain F, Vogin G, Reyns N, Metellus P. Radionecrosis after stereotactic radiotherapy for brain metastases. Expert Rev Neurother 2016;16:903-914 https://doi.org/10.1080/14737175.2016.1184572
  62. Lohmann P, Kocher M, Ceccon G, et al. Combined FET PET/MRI radiomics differentiates radiation injury from recurrent brain metastasis. Neuroimage Clin 2018;20:537-542 https://doi.org/10.1016/j.nicl.2018.08.024
  63. Lohmann P, Stoffels G, Ceccon G, et al. Radiation injury vs. recurrent brain metastasis: combining textural feature radiomics analysis and standard parameters may increase (18)F-FET PET accuracy without dynamic scans. Eur Radiol 2017;27:2916-2927 https://doi.org/10.1007/s00330-016-4638-2
  64. Hotta M, Minamimoto R, Miwa K. 11C-methionine-PET for differentiating recurrent brain tumor from radiation necrosis: radiomics approach with random forest classifier. Sci Rep 2019;9:15666 https://doi.org/10.1038/s41598-019-52279-2
  65. Zhang Z, Yang J, Ho A, et al. A predictive model for distinguishing radiation necrosis from tumour progression after gamma knife radiosurgery based on radiomic features from MR images. Eur Radiol 2018;28:2255-2263 https://doi.org/10.1007/s00330-017-5154-8
  66. Peng L, Parekh V, Huang P, et al. Distinguishing true progression from radionecrosis after stereotactic radiation therapy for brain metastases with machine learning and radiomics. Int J Radiat Oncol Biol Phys 2018;102:1236-1243 https://doi.org/10.1016/j.ijrobp.2018.05.041
  67. Aoyama H, Shirato H, Tago M, et al. Stereotactic radiosurgery plus whole-brain radiation therapy vs stereotactic radiosurgery alone for treatment of brain metastases: a randomized controlled trial. JAMA 2006;295:2483-2491 https://doi.org/10.1001/jama.295.21.2483
  68. Chang EL, Wefel JS, Hess KR, et al. Neurocognition in patients with brain metastases treated with radiosurgery or radiosurgery plus whole-brain irradiation: a randomised controlled trial. Lancet Oncol 2009;10:1037-1044 https://doi.org/10.1016/S1470-2045(09)70263-3
  69. Kocher M, Soffietti R, Abacioglu U, et al. Adjuvant whole-brain radiotherapy versus observation after radiosurgery or surgical resection of one to three cerebral metastases: results of the EORTC 22952-26001 study. J Clin Oncol 2011;29:134-141
  70. Brown PD, Jaeckle K, Ballman KV, et al. Effect of radiosurgery alone vs radiosurgery with whole brain radiation therapy on cognitive function in patients with 1 to 3 brain metastases: a randomized clinical trial. JAMA 2016;316:401-409 https://doi.org/10.1001/jama.2016.9839
  71. Arvold ND, Lee EQ, Mehta MP, et al. Updates in the management of brain metastases. Neuro Oncol 2016;18:1043-1065 https://doi.org/10.1093/neuonc/now127
  72. Gondi V, Pugh SL, Tome WA, et al. Preservation of memory with conformal avoidance of the hippocampal neural stem-cell compartment during whole-brain radiotherapy for brain metastases (RTOG 0933): a phase II multi-institutional trial. J Clin Oncol 2014;32:3810-3816 https://doi.org/10.1200/JCO.2014.57.2909
  73. Mouraviev A, Detsky J, Sahgal A, et al. Use of radiomics for the prediction of local control of brain metastases after stereotactic radiosurgery. Neuro Oncol 2020;22:797-805 https://doi.org/10.1093/neuonc/noaa007
  74. Cha YJ, Jang WI, Kim MS, et al. Prediction of response to stereotactic radiosurgery for brain metastases using convolutional neural networks. Anticancer Res 2018;38:5437-5445 https://doi.org/10.21873/anticanres.12875
  75. Stefano A, Comelli A, Bravata V, et al. A preliminary PET radiomics study of brain metastases using a fully automatic segmentation method. BMC Bioinformatics 2020;21:325 https://doi.org/10.1186/s12859-020-03647-7
  76. Okada H, Kalinski P, Ueda R, et al. Induction of CD8+ T-cell responses against novel glioma-associated antigen peptides and clinical activity by vaccinations with {alpha}-type 1 polarized dendritic cells and polyinosinic-polycytidylic acid stabilized by lysine and carboxymethylcellulose in patients with recurrent malignant glioma. J Clin Oncol 2011;29:330-336
  77. Nishino M, Hatabu H, Hodi FS. Imaging of cancer immunotherapy: current approaches and future directions. Radiology 2019;290:9-22 https://doi.org/10.1148/radiol.2018181349
  78. Okada H, Weller M, Huang R, et al. Immunotherapy response assessment in neuro-oncology: a report of the RANO working group. Lancet Oncol 2015;16:e534-e542 https://doi.org/10.1016/S1470-2045(15)00088-1
  79. Basler L, Gabrys HS, Hogan SA, et al. Radiomics, tumor volume, and blood biomarkers for early prediction of pseudoprogression in patients with metastatic melanoma treated with immune checkpoint inhibition. Clin Cancer Res 2020;26:4414-4425 https://doi.org/10.1158/1078-0432.ccr-20-0020
  80. Yu B, Wang Y, Wang L, Shen D, Zhou L. Medical image synthesis via deep learning. Adv Exp Med Biol 2020;1213:23-44. https://doi.org/10.1007/978-3-030-33128-3_2
  81. Jun Y, Eo T, Kim T, et al. Deep-learned 3D black-blood imaging using automatic labelling technique and 3D convolutional neural networks for detecting metastatic brain tumors. Sci Rep 2018;8:9450 https://doi.org/10.1038/s41598-018-27742-1
  82. Kleesiek J, Morshuis JN, Isensee F, et al. Can virtual contrast enhancement in brain MRI replace gadolinium?: a feasibility study. Invest Radiol 2019;54:653-660 https://doi.org/10.1097/rli.0000000000000583
  83. England JR, Cheng PM. Artificial intelligence for medical image analysis: a guide for authors and reviewers. AJR Am J Roentgenol 2019;212:513-519 https://doi.org/10.2214/AJR.18.20490
  84. Bluemke DA, Moy L, Bredella MA, et al. Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers-from the Radiology Editorial Board. Radiology 2020;294:487-489 https://doi.org/10.1148/radiol.2019192515
  85. Sounderajah V, Ashrafian H, Aggarwal R, et al. Developing specific reporting guidelines for diagnostic accuracy studies assessing AI interventions: the STARD-AI Steering Group. Nat Med 2020;26:807-808 https://doi.org/10.1038/s41591-020-0941-1
  86. Collins GS, Moons KGM. Reporting of artificial intelligence prediction models. Lancet 2019;393:1577-1579 https://doi.org/10.1016/S0140-6736(19)30037-6
  87. Zwanenburg A, Vallieres M, Abdalah MA, et al. The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 2020;295:328-338 https://doi.org/10.1148/radiol.2020191145
  88. Park JE, Kim D, Kim HS, et al. Quality of science and reporting of radiomics in oncologic studies: room for improvement according to radiomics quality score and TRIPOD statement. Eur Radiol 2020;30:523-536 https://doi.org/10.1007/s00330-019-06360-z
  89. Won SY, Park YW, Park M, Ahn SS, Kim J, Lee SK. Quality reporting of radiomics analysis in mild cognitive impairment and Alzheimer's disease: a roadmap for moving forward. Korean J Radiol 2020;21:1345-1354 https://doi.org/10.3348/kjr.2020.0715
  90. Carre A, Klausner G, Edjlali M, et al. Standardization of brain MR images across machines and protocols: bridging the gap for MRI-based radiomics. Sci Rep 2020;10:12340 https://doi.org/10.1038/s41598-020-69298-z
  91. Park JE, Park SY, Kim HJ, Kim HS. Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol 2019;20:1124-1137 https://doi.org/10.3348/kjr.2018.0070
  92. Shin HC, Roth HR, Gao M, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 2016;35:1285-1298 https://doi.org/10.1109/TMI.2016.2528162
  93. Sharma S, Mehra R. Breast cancer histology images classification: training from scratch or transfer learning? ICT Express 2018;4:247-254 https://doi.org/10.1016/j.icte.2018.10.007
  94. Nichol A, Achiam J, Schulman J. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999, 2018
  95. Sun Q, Liu Y, Chua T-S, Schiele B. Meta-transfer learning for few-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019:403-412
  96. Dalca AV, Guttag J, Sabuncu MR. Anatomical priors in convolutional networks for unsupervised biomedical segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018:9290-9299
  97. Han C, Hayashi H, Rundo L, et al. GAN-based synthetic brain MR image generation. 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) 2018:734-738
  98. Samangouei P, Kabkab M, Chellappa R. Defense-gan: protecting classifiers against adversarial attacks using generative models. arXiv preprint arXiv:1805.06605 2018
  99. Yi X, Walia E, Babyn P. Generative adversarial network in medical imaging: a review. Med Image Anal 2019;58:101552 https://doi.org/10.1016/j.media.2019.101552
  100. Samek W, Muller K-R. Towards explainable artificial intelligence. In Samek W, Montavon G, Vedaldi A, Hansen LK, Muller K-R, eds. Explainable AI: interpreting, explaining and visualizing deep learning. Springer Nature, 2019:5-22
  101. Mishra S, Sturm BL, Dixon S. Local interpretable model-agnostic explanations for music content analysis. ISMIR 2017:537-543
  102. Lundberg S, Lee S-I. A unified approach to interpreting model predictions. arXiv preprint arXiv:1705.07874, 2017
  103. Selvaraju RR, Das A, Vedantam R, Cogswell M, Parikh D, Batra D. Grad-cam: Why did you say that? arXiv preprint arXiv:1611.07450, 2016
  104. Petsiuk V, Das A, Saenko K. Rise: randomized input sampling for explanation of black-box models. arXiv preprint arXiv:1806.07421, 2018