Korean Journal of Radiology

The Korean Society of Radiology (대한영상의학회)
권호 표지
DOI QR코드

DOI QR Code

Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part II. Statistical Methods of Meta-Analysis

  • Lee, Juneyoung (Department of Biostatistics, Korea University College of Medicine) ;
  • Kim, Kyung Won (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center) ;
  • Choi, Sang Hyun (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center) ;
  • Huh, Jimi (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center) ;
  • Park, Seong Ho (Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center)
  • Received : 2015.07.07
  • Accepted : 2015.08.28
  • Published : 2015.11.01
⟨ Previous Next ⟩

Abstract

Meta-analysis of diagnostic test accuracy studies differs from the usual meta-analysis of therapeutic/interventional studies in that, it is required to simultaneously analyze a pair of two outcome measures such as sensitivity and specificity, instead of a single outcome. Since sensitivity and specificity are generally inversely correlated and could be affected by a threshold effect, more sophisticated statistical methods are required for the meta-analysis of diagnostic test accuracy. Hierarchical models including the bivariate model and the hierarchical summary receiver operating characteristic model are increasingly being accepted as standard methods for meta-analysis of diagnostic test accuracy studies. We provide a conceptual review of statistical methods currently used and recommended for meta-analysis of diagnostic test accuracy studies. This article could serve as a methodological reference for those who perform systematic review and meta-analysis of diagnostic test accuracy studies.

Keywords

References

  1. Dinnes J, Deeks J, Kirby J, Roderick P. A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess 2005;9:1-113, iii
  2. Irwig L, Tosteson AN, Gatsonis C, Lau J, Colditz G, Chalmers TC, et al. Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med 1994;120:667-676 https://doi.org/10.7326/0003-4819-120-8-199404150-00008
  3. Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005;58:982-990 https://doi.org/10.1016/j.jclinepi.2005.02.022
  4. Zamora J, Abraira V, Muriel A, Khan K, Coomarasamy A. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 2006;6:31 https://doi.org/10.1186/1471-2288-6-31
  5. Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: dataanalytic approaches and some additional considerations. Stat Med 1993;12:1293-1316 https://doi.org/10.1002/sim.4780121403
  6. Littenberg B, Moses LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making 1993;13:313-321 https://doi.org/10.1177/0272989X9301300408
  7. Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med 2001;20:2865-2884 https://doi.org/10.1002/sim.942
  8. Harbord RM, Whiting P, Sterne JA, Egger M, Deeks JJ, Shang A, et al. An empirical comparison of methods for metaanalysis of diagnostic accuracy showed hierarchical models are necessary. J Clin Epidemiol 2008;61:1095-1103 https://doi.org/10.1016/j.jclinepi.2007.09.013
  9. Kim KW, Lee J, Choi SH, Huh J, Park SH. Systematic review and meta-analysis of studies evaluating diagnostic test accuracy: a practical review for clinical researchers--part i. general guidance and tips. Korean J Radiol 2015;16:1175-1187 https://doi.org/10.3348/kjr.2015.16.6.1175
  10. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-560 https://doi.org/10.1136/bmj.327.7414.557
  11. Ochodo EA, Reitsma JB, Bossuyt PM, Leeflang MM. Survey revealed a lack of clarity about recommended methods for meta-analysis of diagnostic accuracy data. J Clin Epidemiol 2013;66:1281-1288 https://doi.org/10.1016/j.jclinepi.2013.05.015
  12. Devillé WL, Buntinx F, Bouter LM, Montori VM, de Vet HC, van der Windt DA, et al. Conducting systematic reviews of diagnostic studies: didactic guidelines. BMC Med Res Methodol 2002;2:9 https://doi.org/10.1186/1471-2288-2-9
  13. Dodd JD. Evidence-based practice in radiology: steps 3 and 4--appraise and apply diagnostic radiology literature. Radiology 2007;242:342-354 https://doi.org/10.1148/radiol.2422051679
  14. Leeflang MM, Deeks JJ, Gatsonis C, Bossuyt PM; Cochrane Diagnostic Test Accuracy Working Group. Systematic reviews of diagnostic test accuracy. Ann Intern Med 2008;149:889-897 https://doi.org/10.7326/0003-4819-149-12-200812160-00008
  15. Macaskill P, Gatsonis C, Deeks JJ, Harbord RM, Takwoingi Y. Chapter 10: Analysing and Presenting Results. In: Deeks JJ, Bossuyt PM, Gatsonis C, eds. Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy Version 1.0. The Cochrane Collaboration, 2010. Available from: http://srdta.cochrane.org/
  16. Trikalinos TA, Balion CM, Coleman CI, Griffith L, Santaguida PL, Vandermeer B, et al. Chapter 8: meta-analysis of test performance when there is a "gold standard". J Gen Intern Med 2012;27 Suppl 1:S56-S66 https://doi.org/10.1007/s11606-012-2029-1
  17. DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177-188 https://doi.org/10.1016/0197-2456(86)90046-2
  18. Bossuyt P, Davenport C, Deeks J, Hyde C, Leeflang M, Scholten R. Chapter 11: Interpreting results and drawing conclusions. In: Deeks JJ, Bossuyt PM, Gatsonis C, eds. Cochrane handbook for systematic reviews of diagnostic test accuracy version 0.9. The Cochrane Collaboration, 2013. Available from: http://srdta.cochrane.org/
  19. Kim KW, Park SH, Pyo J, Yoon SH, Byun JH, Lee MG, et al. Imaging features to distinguish malignant and benign branch-duct type intraductal papillary mucinous neoplasms of the pancreas: a meta-analysis. Ann Surg 2014;259:72-81 https://doi.org/10.1097/SLA.0b013e31829385f7
  20. Jones CM, Athanasiou T. Diagnostic accuracy meta-analysis: review of an important tool in radiological research and decision making. Br J Radiol 2009;82:441-446 https://doi.org/10.1259/bjr/28171084
  21. Rutter CM, Gatsonis CA. Regression methods for metaanalysis of diagnostic test data. Acad Radiol 1995;2 Suppl 1:S48-S56; discussion S65-S67, S70-S71 pas
  22. Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics 2007;8:239-251 https://doi.org/10.1093/biostatistics/kxl004
  23. Walter SD. Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data. Stat Med 2002;21:1237-1256 https://doi.org/10.1002/sim.1099
  24. Harbord RM, Whiting P. Metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression. Stata J 2009;9:211-229
  25. Doebler P, Holling H. Meta-analysis of diagnostic accuracy (mada). Cran.r-project.org Web site. https://cran.r-project.org/web/packages/mada/vignettes/mada.pdf. Accessed October 5, 2015

Cited by

  1. Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part I. General Guidance and Tips vol.16, pp.6, 2015, https://doi.org/10.3348/kjr.2015.16.6.1175
  2. The detectability of brain metastases using contrast-enhanced spin-echo or gradient-echo images: a systematic review and meta-analysis vol.129, pp.2, 2015, https://doi.org/10.1007/s11060-016-2185-y
  3. The role of core-needle biopsy in the diagnosis of thyroid malignancy in 4580 patients with 4746 thyroid nodules: a systematic review and meta-analysis vol.54, pp.2, 2016, https://doi.org/10.1007/s12020-016-0991-9
  4. Efficacy and Safety of Radiofrequency and Ethanol Ablation for Treating Locally Recurrent Thyroid Cancer: A Systematic Review and Meta-Analysis vol.26, pp.3, 2015, https://doi.org/10.1089/thy.2015.0545
  5. Successful Publication of Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy vol.17, pp.1, 2015, https://doi.org/10.3348/kjr.2016.17.1.5
  6. Noninvasive fractional flow reserve derived from coronary computed tomography angiography for identification of ischemic lesions: a systematic review and meta-analysis vol.6, pp.None, 2015, https://doi.org/10.1038/srep29409
  7. Diagnostic Performance of DNA Hypermethylation Markers in Peripheral Blood for the Detection of Colorectal Cancer: A Meta-Analysis and Systematic Review vol.11, pp.5, 2015, https://doi.org/10.1371/journal.pone.0155095
  8. The Potential Use of Salivary miRNAs as Promising Biomarkers for Detection of Cancer: A Meta-Analysis vol.11, pp.11, 2015, https://doi.org/10.1371/journal.pone.0166303
  9. Diagnostic Performance of Sonographic Features in Patients With Biliary Atresia: A Systematic Review and Meta-analysis : Sonographic Features in Patients With Biliary Atresia vol.36, pp.10, 2015, https://doi.org/10.1002/jum.14234
  10. The diagnostic performance of shear wave elastography for malignant cervical lymph nodes: A systematic review and meta-analysis vol.27, pp.1, 2015, https://doi.org/10.1007/s00330-016-4378-3
  11. Diagnostic Accuracy of Memory Measures in Alzheimer’s Dementia and Mild Cognitive Impairment: a Systematic Review and Meta-Analysis vol.27, pp.4, 2017, https://doi.org/10.1007/s11065-017-9360-6
  12. Diagnostic Accuracy of Blood-Based Tests and Histopathology for Cytomegalovirus Reactivation in Inflammatory Bowel Disease : A Systematic Review and Meta-Analysis vol.23, pp.4, 2015, https://doi.org/10.1097/mib.0000000000001073
  13. Hypervascular Transformation of Hypovascular Hypointense Nodules in the Hepatobiliary Phase of Gadoxetic Acid–Enhanced MRI: A Systematic Review and Meta-Analysis vol.209, pp.4, 2015, https://doi.org/10.2214/ajr.16.17711
  14. Shear-Wave Elastography for Detection of Prostate Cancer: A Systematic Review and Diagnostic Meta-Analysis vol.209, pp.4, 2015, https://doi.org/10.2214/ajr.17.18056
  15. Diagnostic Performance of CT for Diagnosis of Fat-Poor Angiomyolipoma in Patients With Renal Masses: A Systematic Review and Meta-Analysis vol.209, pp.5, 2015, https://doi.org/10.2214/ajr.17.18184
  16. Diagnostic Performance of DWI for Differentiating High- From Low-Grade Clear Cell Renal Cell Carcinoma: A Systematic Review and Meta-Analysis vol.209, pp.6, 2017, https://doi.org/10.2214/ajr.17.18283
  17. Performance of CT in the Preoperative Diagnosis of Cervical Lymph Node Metastasis in Patients with Papillary Thyroid Cancer: A Systematic Review and Meta-Analysis vol.38, pp.1, 2017, https://doi.org/10.3174/ajnr.a4967
  18. The Role of Core Needle Biopsy for Thyroid Nodules with Initially Indeterminate Results on Previous Fine-Needle Aspiration: A Systematic Review and Meta-Analysis vol.38, pp.7, 2015, https://doi.org/10.3174/ajnr.a5182
  19. Optic nerve sheath diameter sonography for the diagnosis of increased intracranial pressure: a systematic review and meta-analysis protocol vol.7, pp.8, 2015, https://doi.org/10.1136/bmjopen-2017-016194
  20. LncRNA PVT1 as an effective biomarker for cancer diagnosis and detection based on transcriptome data and meta-analysis vol.8, pp.43, 2015, https://doi.org/10.18632/oncotarget.20634
  21. Preoperative sentinel lymph node identification, biopsy and localisation using contrast enhanced ultrasound (CEUS) in patients with breast cancer: a systematic review and meta-analysis vol.72, pp.11, 2017, https://doi.org/10.1016/j.crad.2017.06.121
  22. Pheochromocytoma as a frequent false-positive in adrenal washout CT: A systematic review and meta-analysis vol.28, pp.3, 2015, https://doi.org/10.1007/s00330-017-5076-5
  23. The diagnostic performance of shear-wave elastography for liver fibrosis in children and adolescents: A systematic review and diagnostic meta-analysis vol.28, pp.3, 2015, https://doi.org/10.1007/s00330-017-5078-3
  24. Comparison of gradient-recalled echo and spin-echo echo-planar imaging MR elastography in staging liver fibrosis: a meta-analysis vol.28, pp.4, 2015, https://doi.org/10.1007/s00330-017-5149-5
  25. The diagnostic performance of reduced-dose CT for suspected appendicitis in paediatric and adult patients: A systematic review and diagnostic meta-analysis vol.28, pp.6, 2015, https://doi.org/10.1007/s00330-017-5231-z
  26. Multiparametric MRI as a potential surrogate endpoint for decision-making in early treatment response following concurrent chemoradiotherapy in patients with newly diagnosed glioblastoma: a systematic vol.28, pp.6, 2018, https://doi.org/10.1007/s00330-017-5262-5
  27. ADC as a useful diagnostic tool for differentiating benign and malignant vertebral bone marrow lesions and compression fractures: a systematic review and meta-analysis vol.28, pp.7, 2015, https://doi.org/10.1007/s00330-018-5330-5
  28. Complications following ultrasound-guided core needle biopsy of thyroid nodules: a systematic review and meta-analysis vol.28, pp.9, 2018, https://doi.org/10.1007/s00330-018-5367-5
  29. Diagnostic performance of dual-energy CT for the detection of bone marrow oedema: a systematic review and meta-analysis vol.28, pp.10, 2018, https://doi.org/10.1007/s00330-018-5411-5
  30. The role of core needle biopsy in the diagnosis of initially detected thyroid nodules: a systematic review and meta-analysis vol.28, pp.11, 2018, https://doi.org/10.1007/s00330-018-5494-z
  31. Systematic Review and Meta-Analysis of CT Features for Differentiating Complicated and Uncomplicated Appendicitis vol.287, pp.1, 2015, https://doi.org/10.1148/radiol.2017171260
  32. Comment on “Systematic Review and Meta-Analysis of Diagnostic Accuracy of miRNAs in Patients with Pancreatic Cancer” vol.2018, pp.None, 2015, https://doi.org/10.1155/2018/6904569
  33. Shear Wave Elastography as a Quantitative Biomarker of Clinically Significant Portal Hypertension: A Systematic Review and Meta-Analysis vol.210, pp.5, 2015, https://doi.org/10.2214/ajr.17.18367
  34. The Diagnostic Performance of MRI for Detection of Lymph Node Metastasis in Bladder and Prostate Cancer: An Updated Systematic Review and Diagnostic Meta-Analysis vol.210, pp.3, 2018, https://doi.org/10.2214/ajr.17.18481
  35. Diagnostic Performance of In-Phase and Opposed-Phase Chemical-Shift Imaging for Differentiating Benign and Malignant Vertebral Marrow Lesions: A Meta-Analysis vol.211, pp.4, 2015, https://doi.org/10.2214/ajr.17.19306
  36. Diagnostic Performance of Transient Elastography for Liver Fibrosis in Children: A Systematic Review and Meta-Analysis vol.211, pp.5, 2015, https://doi.org/10.2214/ajr.18.19535
  37. Head-to-Head Comparison Between Biparametric and Multiparametric MRI for the Diagnosis of Prostate Cancer: A Systematic Review and Meta-Analysis vol.211, pp.5, 2018, https://doi.org/10.2214/ajr.18.19880
  38. Efficacy and Safety of Microwave Ablation for Malignant Renal Tumors: An Updated Systematic Review and Meta-Analysis of the Literature Since 2012 vol.19, pp.5, 2018, https://doi.org/10.3348/kjr.2018.19.5.938
  39. Commentary: Blood-Derived microRNAs for Pancreatic Cancer Diagnosis: A Narrative Review and Meta-Analysis vol.9, pp.None, 2015, https://doi.org/10.3389/fphys.2018.01896
  40. Blood Lactate or Lactate Clearance: Which Is Robust to Predict the Neurological Outcomes after Cardiac Arrest? A Systematic Review and Meta-Analysis vol.2018, pp.None, 2015, https://doi.org/10.1155/2018/8014213
  41. Performance of MRI for suspected appendicitis in pediatric patients and negative appendectomy rate: A systematic review and meta‐analysis vol.47, pp.3, 2015, https://doi.org/10.1002/jmri.25825
  42. How to Perform a Systematic Review and Meta-analysis of Diagnostic Imaging Studies vol.25, pp.5, 2018, https://doi.org/10.1016/j.acra.2017.12.007
  43. Diffusion-Weighted Imaging and Diffusion Tensor Imaging for Differentiating High-Grade Glioma from Solitary Brain Metastasis: A Systematic Review and Meta-Analysis vol.39, pp.7, 2018, https://doi.org/10.3174/ajnr.a5650
  44. MRI Findings in Tumefactive Demyelinating Lesions: A Systematic Review and Meta-Analysis vol.39, pp.9, 2015, https://doi.org/10.3174/ajnr.a5775
  45. Comparison between 3D isotropic and 2D conventional MR arthrography for diagnosing rotator cuff tear and labral lesions: A meta‐analysis vol.48, pp.4, 2015, https://doi.org/10.1002/jmri.26024
  46. The Diagnostic Value of Diffusion-Weighted Imaging in Differentiating Metastatic Lymph Nodes of Head and Neck Squamous Cell Carcinoma: A Systematic Review and Meta-Analysis vol.39, pp.10, 2015, https://doi.org/10.3174/ajnr.a5813
  47. Diagnostic performance of diffusion‐weighted imaging for differentiating benign and malignant gallbladder lesions: A systematic review and meta‐analysis vol.48, pp.5, 2015, https://doi.org/10.1002/jmri.26035
  48. 2-Hydroxyglutarate MR spectroscopy for prediction of isocitrate dehydrogenase mutant glioma: a systemic review and meta-analysis using individual patient data vol.20, pp.12, 2018, https://doi.org/10.1093/neuonc/noy113
  49. The clock drawing test: A systematic review and meta‐analysis of diagnostic accuracy vol.74, pp.12, 2015, https://doi.org/10.1111/jan.13810
  50. The diagnostic test accuracy of rectal examination for prostate cancer diagnosis in symptomatic patients: a systematic review vol.19, pp.None, 2015, https://doi.org/10.1186/s12875-018-0765-y
  51. Comparison of MRI and PET as Potential Surrogate Endpoints for Treatment Response After Stereotactic Radiosurgery in Patients With Brain Metastasis vol.211, pp.6, 2018, https://doi.org/10.2214/ajr.18.19674
  52. Comparison of 2-point and 3-point point-of-care ultrasound techniques for deep vein thrombosis at the emergency department : A meta-analysis vol.98, pp.22, 2015, https://doi.org/10.1097/md.0000000000015791
  53. Letter to the editor regarding the publication “Association between matrix-metalloproteinase polymorphisms and prostate cancer risk: a meta-analysis and systematic review” vol.11, pp.None, 2015, https://doi.org/10.2147/cmar.s195169
  54. Accuracy of Machine Learning Algorithms for the Diagnosis of Autism Spectrum Disorder: Systematic Review and Meta-Analysis of Brain Magnetic Resonance Imaging Studies vol.6, pp.12, 2019, https://doi.org/10.2196/14108
  55. A Glimpse on Trends and Characteristics of Recent Articles Published in the Korean Journal of Radiology vol.20, pp.12, 2019, https://doi.org/10.3348/kjr.2019.0928
  56. Diagnostic and prognostic value of microRNAs for cancers- strategies and approaches to improve the clinical utility vol.10, pp.5, 2019, https://doi.org/10.7150/jca.28581
  57. High performance of critical shoulder angle for diagnosing rotator cuff tears on radiographs vol.27, pp.1, 2019, https://doi.org/10.1007/s00167-018-5247-1
  58. Efficacy and safety of radiofrequency, microwave and laser ablation for treating papillary thyroid microcarcinoma: a systematic review and meta-analysis vol.36, pp.1, 2015, https://doi.org/10.1080/02656736.2019.1700559
  59. Systematic review and meta-analysis of magnetic resonance imaging features for diagnosis of adhesive capsulitis of the shoulder vol.29, pp.2, 2015, https://doi.org/10.1007/s00330-018-5604-y
  60. Imaging prediction of isocitrate dehydrogenase (IDH) mutation in patients with glioma: a systemic review and meta-analysis vol.29, pp.2, 2015, https://doi.org/10.1007/s00330-018-5608-7
  61. Postmortem computed tomography angiography (PMCTA) and traditional autopsy in cases of sudden cardiac death due to coronary artery disease: a systematic review and meta-analysis vol.124, pp.2, 2015, https://doi.org/10.1007/s11547-018-0943-y
  62. Meta-analysis for diagnostic tests vol.26, pp.1, 2015, https://doi.org/10.1007/s12350-018-01485-y
  63. Diagnostic Performance of Ultrasound Elastography for Evaluating Portal Hypertension in Children: A Systematic Review and Meta-analysis : Ultrasound Elastography for Portal Hypertension vol.38, pp.3, 2015, https://doi.org/10.1002/jum.14764
  64. Cold pulp testing is the simplest and most accurate of all dental pulp sensibility tests vol.20, pp.1, 2019, https://doi.org/10.1038/s41432-019-0004-y
  65. Diagnostic Outcome of Image-Guided Percutaneous Core Needle Biopsy of Sclerotic Bone Lesions: A Meta-Analysis vol.212, pp.3, 2019, https://doi.org/10.2214/ajr.18.20243
  66. Comparison of Radioembolization and Sorafenib for the Treatment of Hepatocellular Carcinoma with Portal Vein Tumor Thrombosis: A Systematic Review and Meta-Analysis of Safety and Efficacy vol.20, pp.3, 2015, https://doi.org/10.3348/kjr.2018.0496
  67. Fractional Exhaled Nitric Oxide for the Diagnosis of Childhood Asthma: a Systematic Review and Meta-analysis vol.56, pp.2, 2019, https://doi.org/10.1007/s12016-016-8573-4
  68. Amide proton transfer-weighted MRI in distinguishing high- and low-grade gliomas: a systematic review and meta-analysis vol.61, pp.5, 2015, https://doi.org/10.1007/s00234-018-02152-2
  69. Technical performance of shear wave elastography for measuring liver stiffness in pediatric and adolescent patients: a systematic review and meta-analysis vol.29, pp.5, 2015, https://doi.org/10.1007/s00330-018-5900-6
  70. Differentiating between hepatocellular carcinoma and intrahepatic cholangiocarcinoma using contrast-enhanced MRI features: a systematic review and meta-analysis vol.74, pp.5, 2015, https://doi.org/10.1016/j.crad.2018.12.016
  71. Technical Performance of Two-Dimensional Shear Wave Elastography for Measuring Liver Stiffness: A Systematic Review and Meta-Analysis vol.20, pp.6, 2015, https://doi.org/10.3348/kjr.2018.0812
  72. Diagnostic accuracy of saline contrast sonohysterography in detecting endometrial polyps in women with postmenopausal bleeding: systematic review and meta‐analysis vol.54, pp.1, 2015, https://doi.org/10.1002/uog.20229
  73. Sonographic lower uterine segment thickness after prior cesarean section to predict uterine rupture: A systematic review and meta‐analysis vol.98, pp.7, 2015, https://doi.org/10.1111/aogs.13585
  74. MRI as a diagnostic biomarker for differentiating primary central nervous system lymphoma from glioblastoma: A systematic review and meta‐analysis vol.50, pp.2, 2015, https://doi.org/10.1002/jmri.26602
  75. Perfusion CT for prediction of hemorrhagic transformation in acute ischemic stroke: a systematic review and meta-analysis vol.29, pp.8, 2015, https://doi.org/10.1007/s00330-018-5936-7
  76. Diagnostic performance of CT in detection of metastatic cervical lymph nodes in patients with thyroid cancer: a systematic review and meta-analysis vol.29, pp.9, 2015, https://doi.org/10.1007/s00330-019-06036-8
  77. Efficiency of knee ultrasound for diagnosing anterior cruciate ligament and posterior cruciate ligament injuries: a systematic review and meta-analysis vol.48, pp.10, 2015, https://doi.org/10.1007/s00256-019-03225-w
  78. Diagnostic performance of computed tomography for bowel endometriosis: A systematic review and meta-analysis vol.119, pp.None, 2015, https://doi.org/10.1016/j.ejrad.2019.08.007
  79. Assessment of Prognostic Value of Left Ventricular Global Longitudinal Strain for Early Prediction of Chemotherapy-Induced Cardiotoxicity : A Systematic Review and Meta-analysis vol.4, pp.10, 2015, https://doi.org/10.1001/jamacardio.2019.2952
  80. Active Surveillance for Small Papillary Thyroid Cancer: A Systematic Review and Meta-Analysis vol.29, pp.10, 2015, https://doi.org/10.1089/thy.2019.0159
  81. The “Central Vein Sign” on T2*-weighted Images as a Diagnostic Tool in Multiple Sclerosis: A Systematic Review and Meta-analysis using Individual Patient Data vol.9, pp.1, 2015, https://doi.org/10.1038/s41598-019-54583-3
  82. Accuracy of single molecular biomarkers in gingival crevicular fluid for the diagnosis of periodontitis: A systematic review and meta‐analysis vol.46, pp.12, 2015, https://doi.org/10.1111/jcpe.13188
  83. Imaging modality for measuring the presence and extent of the labral lesions of the shoulder: a systematic review and meta-analysis vol.20, pp.1, 2015, https://doi.org/10.1186/s12891-019-2876-6
  84. Accuracy of screening tests for gestational diabetes mellitus in Southeast Asia : A systematic review of diagnostic test accuracy studies vol.99, pp.46, 2020, https://doi.org/10.1097/md.0000000000023161
  85. Radiological Recurrence Patterns after Bevacizumab Treatment of Recurrent High-Grade Glioma: A Systematic Review and Meta-Analysis vol.21, pp.7, 2015, https://doi.org/10.3348/kjr.2019.0898
  86. MRI Assessment of Complete Response to Preoperative Chemoradiation Therapy for Rectal Cancer: 2020 Guide for Practice from the Korean Society of Abdominal Radiology vol.21, pp.7, 2015, https://doi.org/10.3348/kjr.2020.0483
  87. Accuracy of single molecular biomarkers in saliva for the diagnosis of periodontitis: A systematic review and meta‐analysis vol.47, pp.1, 2015, https://doi.org/10.1111/jcpe.13202
  88. A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection vol.34, pp.1, 2015, https://doi.org/10.1080/13854046.2019.1637027
  89. Safety of dry needling to the upper lumbar spine: a pilot cadaver study vol.28, pp.2, 2015, https://doi.org/10.1080/10669817.2019.1708593
  90. Usefulness of Nasal Endoscopy for Diagnosing Patients With Chronic Rhinosinusitis: A Meta-Analysis vol.34, pp.2, 2015, https://doi.org/10.1177/1945892419892157
  91. Accuracy and clinical utility of comprehensive dysphagia screening assessments in acute stroke: A systematic review and meta‐analysis vol.29, pp.9, 2015, https://doi.org/10.1111/jocn.15192
  92. Efficacy and Safety of Thermal Ablation Techniques for the Treatment of Primary Papillary Thyroid Microcarcinoma: A Systematic Review and Meta-Analysis vol.30, pp.5, 2015, https://doi.org/10.1089/thy.2019.0707
  93. Diagnostic performance of ankle ultrasound for diagnosing anterior talofibular and calcaneofibular ligament injuries: a meta-analysis vol.61, pp.5, 2020, https://doi.org/10.1177/0284185119873119
  94. Long-Term Results of Thermal Ablation of Benign Thyroid Nodules: A Systematic Review and Meta-Analysis vol.35, pp.2, 2015, https://doi.org/10.3803/enm.2020.35.2.339
  95. Comparison of diagnostic performance between CT and MRI for detection of cartilage invasion for primary tumor staging in patients with laryngo-hypopharyngeal cancer: a systematic review and meta-analy vol.30, pp.7, 2015, https://doi.org/10.1007/s00330-020-06718-8
  96. Diagnostic performance of MRI to detect metastatic cervical lymph nodes in patients with thyroid cancer: a systematic review and meta-analysis vol.75, pp.7, 2020, https://doi.org/10.1016/j.crad.2020.03.025
  97. Diagnostic Performance of Magnetic Resonance Imaging for Detecting Meniscal Ramp Lesions in Patients With Anterior Cruciate Ligament Tears: A Systematic Review and Meta-analysis vol.48, pp.8, 2015, https://doi.org/10.1177/0363546519880528
  98. MRI for prediction of hemorrhagic transformation in acute ischemic stroke: a systematic review and meta-analysis vol.61, pp.7, 2020, https://doi.org/10.1177/0284185119887593
  99. Liquid biopsy for cancer diagnosis using vibrational spectroscopy: systematic review vol.4, pp.4, 2015, https://doi.org/10.1002/bjs5.50289
  100. Diagnostic Performance of Four Ultrasound Risk Stratification Systems: A Systematic Review and Meta-Analysis vol.30, pp.8, 2015, https://doi.org/10.1089/thy.2019.0812
  101. A tutorial for meta-analysis of diagnostic tests for low-prevalence diseases: Bayesian models and software vol.16, pp.3, 2020, https://doi.org/10.5964/meth.4015
  102. Diagnostic test accuracy of the Nursing Delirium Screening Scale: A systematic review and meta‐analysis vol.76, pp.10, 2015, https://doi.org/10.1111/jan.14482
  103. DECAF score as a mortality predictor for acute exacerbation of chronic obstructive pulmonary disease: a systematic review and meta-analysis vol.10, pp.10, 2015, https://doi.org/10.1136/bmjopen-2020-037923
  104. Incidence of Pseudoprogression during Immune Checkpoint Inhibitor Therapy for Solid Tumors: A Systematic Review and Meta-Analysis vol.297, pp.1, 2015, https://doi.org/10.1148/radiol.2020200443
  105. Diagnostic Test Accuracy of the 4AT for Delirium Detection: A Systematic Review and Meta-Analysis vol.17, pp.20, 2015, https://doi.org/10.3390/ijerph17207515
  106. A Systematic Review and Meta-Analysis of the Utility of the Test of Memory Malingering in Pediatric Examinees vol.35, pp.8, 2015, https://doi.org/10.1093/arclin/acaa075
  107. Machine learning for the identification of clinically significant prostate cancer on MRI: a meta-analysis vol.30, pp.12, 2015, https://doi.org/10.1007/s00330-020-07027-w
  108. The 100 top-cited meta-analyses of diagnostic accuracy in radiology journals: a bibliometric analysis vol.11, pp.1, 2020, https://doi.org/10.1186/s13244-020-00936-w
  109. Prostate-specific membrane antigen positron emission tomography (PSMA-PET) for local staging of prostate cancer: a systematic review and meta-analysis vol.4, pp.1, 2015, https://doi.org/10.1186/s41824-020-00085-9
  110. Efficacy and safety of high-intensity focused ultrasound (HIFU) for treating benign thyroid nodules: a systematic review and meta-analysis vol.61, pp.12, 2015, https://doi.org/10.1177/0284185120909339
  111. Immune Checkpoint Inhibitors with or without Radiotherapy in Non-Small Cell Lung Cancer Patients with Brain Metastases: A Systematic Review and Meta-Analysis vol.10, pp.12, 2015, https://doi.org/10.3390/diagnostics10121098
  112. Threshold Analysis of the Cost-effectiveness of Endoscopic Ultrasound in Patients at High Risk for Pancreatic Ductal Adenocarcinoma vol.50, pp.6, 2015, https://doi.org/10.1097/mpa.0000000000001835
  113. Coronary Computed Tomography Angiography in Diagnosing Obstructive Coronary Artery Disease in Patients with Advanced Chronic Kidney Disease: A Systematic Review and Meta-Analysis vol.11, pp.1, 2015, https://doi.org/10.1159/000510402
  114. Radiomic and Genomic Machine Learning Method Performance for Prostate Cancer Diagnosis: Systematic Literature Review vol.23, pp.4, 2015, https://doi.org/10.2196/22394
  115. Immune Checkpoint Inhibitor with or without Radiotherapy in Melanoma Patients with Brain Metastases: A Systematic Review and Meta-Analysis vol.22, pp.4, 2021, https://doi.org/10.3348/kjr.2020.0728
  116. Neuroimaging Findings in Patients with COVID-19: A Systematic Review and Meta-Analysis vol.22, pp.None, 2015, https://doi.org/10.3348/kjr.2021.0127
  117. Efficacy of toluidine blue in the diagnosis and screening of oral cancer and pre‐cancer: A systematic review and meta‐analysis vol.46, pp.1, 2021, https://doi.org/10.1111/coa.13613
  118. The Effect of Using Rome IV Criteria on the Prevalence of Functional Abdominal Pain Disorders and Functional Constipation among Children of the Western Region of Saudi Arabia vol.8, pp.None, 2015, https://doi.org/10.1177/2333794x211022265
  119. Systematic review of diagnostic methods for acute respiratory distress syndrome vol.7, pp.1, 2021, https://doi.org/10.1183/23120541.00504-2020
  120. Classification of true progression after radiotherapy of brain metastasis on MRI using artificial intelligence: a systematic review and meta-analysis vol.3, pp.1, 2015, https://doi.org/10.1093/noajnl/vdab080
  121. Diagnostic Accuracy of PET for Differentiating True Glioma Progression From Post Treatment-Related Changes: A Systematic Review and Meta-Analysis vol.12, pp.None, 2021, https://doi.org/10.3389/fneur.2021.671867
  122. Diagnostic Value of Sonographic Features in Distinguishing Malignant Partially Cystic Thyroid Nodules: A Systematic Review and Meta-Analysis vol.12, pp.None, 2021, https://doi.org/10.3389/fendo.2021.624409
  123. Diagnostic performance of neuromelanin-sensitive magnetic resonance imaging for patients with Parkinson’s disease and factor analysis for its heterogeneity: a systematic review and meta-analysis vol.31, pp.3, 2015, https://doi.org/10.1007/s00330-020-07240-7
  124. Cardiac natriuretic peptides for diagnosis of covert atrial fibrillation after acute ischaemic stroke: a meta-analysis of diagnostic accuracy studies vol.6, pp.1, 2015, https://doi.org/10.1136/svn-2020-000440
  125. Definition, Incidence, and Challenges for Assessment of Hyperprogressive Disease During Cancer Treatment With Immune Checkpoint Inhibitors : A Systematic Review and Meta-analysis vol.4, pp.3, 2015, https://doi.org/10.1001/jamanetworkopen.2021.1136
  126. Diagnostic roles of HOX transcript antisense intergenic RNA in cancer vol.17, pp.2, 2015, https://doi.org/10.1111/ajco.13300
  127. The ‘swirl sign’ as a marker for haematoma expansion and outcome in intra-cranial haemorrhage: A meta-analysis vol.87, pp.None, 2021, https://doi.org/10.1016/j.jocn.2021.02.028
  128. Comparison of clinical usefulness of serum Ca125 and CA19-9 in pancreatic adenocarcinoma diagnosis: meta-analysis and systematic review of literature vol.26, pp.4, 2015, https://doi.org/10.1080/1354750x.2021.1876770
  129. Reply to Comment on “Supplemental breast cancer-screening ultrasonography in women with dense breasts: a systematic review and meta-analysis” vol.124, pp.11, 2021, https://doi.org/10.1038/s41416-021-01349-2
  130. Incidence of Immune-Mediated Pseudoprogression of Lymphoma Treated with Immune Checkpoint Inhibitors: Systematic Review and Meta-Analysis vol.10, pp.11, 2015, https://doi.org/10.3390/jcm10112257
  131. Hierarchical Modeling for Diagnostic Test Accuracy Using Multivariate Probability Distribution Functions vol.9, pp.11, 2021, https://doi.org/10.3390/math9111310
  132. Project management offices in the construction industry: a literature review and qualitative synthesis of success variables vol.39, pp.6, 2015, https://doi.org/10.1080/01446193.2021.1916052
  133. The T2-FLAIR mismatch sign as a predictor of IDH-mutant, 1p/19q-noncodeleted lower-grade gliomas: a systematic review and diagnostic meta-analysis vol.31, pp.7, 2015, https://doi.org/10.1007/s00330-020-07467-4
  134. Diagnostic performance and interobserver agreement of the callosal angle and Evans’ index in idiopathic normal pressure hydrocephalus: a systematic review and meta-analysis vol.31, pp.7, 2015, https://doi.org/10.1007/s00330-020-07555-5
  135. Comparison of diffusion-weighted imaging and MR elastography in staging liver fibrosis: a meta-analysis vol.46, pp.8, 2021, https://doi.org/10.1007/s00261-021-03055-2
  136. Dual-energy CT performance in acute pulmonary embolism: a meta-analysis vol.31, pp.8, 2015, https://doi.org/10.1007/s00330-020-07633-8
  137. Predictive Value of Delphian Lymph Node Metastasis in the Thyroid Cancer vol.131, pp.9, 2015, https://doi.org/10.1002/lary.29426
  138. A meta-analysis evaluating contrast-enhanced intraoperative ultrasound (CE-IOUS) in the context of surgery for colorectal liver metastases vol.46, pp.9, 2021, https://doi.org/10.1007/s00261-021-03096-7
  139. Diagnostic and prognostic accuracy of Protein C in adult patients with sepsis: protocol for a systematic review and meta-analysis vol.11, pp.9, 2015, https://doi.org/10.1136/bmjopen-2021-050754
  140. Predictive value of ipsilateral central lymph node metastasis for contralateral central lymph node metastasis in patients with thyroid cancer: Systematic review and meta‐analysis vol.43, pp.10, 2021, https://doi.org/10.1002/hed.26787
  141. Diagnostic Accuracy of Cardiovascular Magnetic Resonance for Cardiac Transplant Rejection vol.14, pp.12, 2015, https://doi.org/10.1016/j.jcmg.2021.05.008
  142. Conducting proportional meta-analysis in different types of systematic reviews: a guide for synthesisers of evidence vol.21, pp.1, 2015, https://doi.org/10.1186/s12874-021-01381-z
  143. Ultrasonography and Fine‐Needle Aspiration in Indeterminate Thyroid Nodules: A Systematic Review of Diagnostic Test Accuracy vol.132, pp.1, 2015, https://doi.org/10.1002/lary.29778
  144. Accuracy of the ultrasound attenuation coefficient for the evaluation of hepatic steatosis: a systematic review and meta-analysis of prospective studies vol.41, pp.1, 2015, https://doi.org/10.14366/usg.21076
  145. Diagnostic Performance of the Magnetic Resonance Parkinsonism Index in Differentiating Progressive Supranuclear Palsy from Parkinson’s Disease: An Updated Systematic Review and Meta-Analysis vol.12, pp.1, 2022, https://doi.org/10.3390/diagnostics12010012
  146. Diagnostic Accuracy of Imaging Findings in Pleural Empyema: Systematic Review and Meta-Analysis vol.8, pp.1, 2015, https://doi.org/10.3390/jimaging8010003