DOI QR코드

DOI QR Code

Bayesian methods in clinical trials with applications to medical devices

  • Received : 2017.11.01
  • Accepted : 2017.11.16
  • Published : 2017.11.30

Abstract

Bayesian statistics can play a key role in the design and analysis of clinical trials and this has been demonstrated for medical device trials. By 1995 Bayesian statistics had been well developed and the revolution in computing powers and Markov chain Monte Carlo development made calculation of posterior distributions within computational reach. The Food and Drug Administration (FDA) initiative of Bayesian statistics in medical device clinical trials, which began almost 20 years ago, is reviewed in detail along with some of the key decisions that were made along the way. Both Bayesian hierarchical modeling using data from previous studies and Bayesian adaptive designs, usually with a non-informative prior, are discussed. The leveraging of prior study data has been accomplished through Bayesian hierarchical modeling. An enormous advantage of Bayesian adaptive designs is achieved when it is accompanied by modeling of the primary endpoint to produce the predictive posterior distribution. Simulations are crucial to providing the operating characteristics of the Bayesian design, especially for a complex adaptive design. The 2010 FDA Bayesian guidance for medical device trials addressed both approaches as well as exchangeability, Type I error, and sample size. Treatment response adaptive randomization using the famous extracorporeal membrane oxygenation example is discussed. An interesting real example of a Bayesian analysis using a failed trial with an interesting subgroup as prior information is presented. The implications of the likelihood principle are considered. A recent exciting area using Bayesian hierarchical modeling has been the pediatric extrapolation using adult data in clinical trials. Historical control information from previous trials is an underused area that lends itself easily to Bayesian methods. The future including recent trends, decision theoretic trials, Bayesian benefit-risk, virtual patients, and the appalling lack of penetration of Bayesian clinical trials in the medical literature are discussed.

Keywords

References

  1. Alderson NE (2005). Editorial, Clinical Trials, 2, 271-272. https://doi.org/10.1191/1740774505cn108ed
  2. Ashby D (2006). Bayesian statistics in medicine: a 25 year review, Statistics in Medicine, 25, 3589-3631. https://doi.org/10.1002/sim.2672
  3. Ashby D and Machin D (1993). Stopping rules, interim analyses and data monitoring committees, British Journal of Cancer, 68, 1047-1050. https://doi.org/10.1038/bjc.1993.481
  4. Bae RN, Kang YH, Hong MH, and Kim SW (2008). Multiple comparison for the one-way ANOVA with the power prior, Communications for Statistical Applications and Methods, 15, 13-26. https://doi.org/10.5351/CKSS.2008.15.1.013
  5. Bayes T (1763). An essay towards solving a problem in the doctrine of chances, Philosophical Transactions of the Royal Society of London, 53, 370-418. https://doi.org/10.1098/rstl.1763.0053
  6. Berger JO and Berry DA (1988). Statistical analysis and the illusion of objectivity, American Scientist, 76, 159-165.
  7. Berger JO and Wolpert RL (1988). The Likelihood Principle (2nd ed), Institute of Mathematical Statistics, Hayward.
  8. Berry DA (1987). Interim analysis in clinical trials: the role of the likelihood principle, The American Statistician, 41, 117-122.
  9. Berry DA (1993). A case for Bayesianism in clinical trials, Statistics in Medicine, 12, 1377-1393. https://doi.org/10.1002/sim.4780121504
  10. Berry DA (1997). Using a Bayesian approach in medical device development, Technical Paper, Retrieved October, 2017, from: http://ftp.isds.duke.edu/WorkingPapers/97-21.ps
  11. Berry DA (2004). Bayesian statistics and the efficiency and ethics of clinical trials, Statistical Science, 19, 175-187. https://doi.org/10.1214/088342304000000044
  12. Berry DA (2005). Introduction Bayesian methods III: uses and interpretation of Bayesian tools in design and analysis, Clinical Trials, 2, 295-300. https://doi.org/10.1191/1740774505cn100oa
  13. Berry SM, Carlin BP, Lee JJ, and Muller P (2011). Bayesian Adaptive Methods for Clinical Trials, CRC Press, Boca Raton.
  14. Bonangelino P, Irony T, Liang S, et al. (2011). Bayesian approaches in medical device clinical trials: a discussion with examples in the regulatory setting, Journal of Biopharmaceutical Statistics, 21, 938-953. https://doi.org/10.1080/10543406.2011.589650
  15. Box GEP and Tiao GC (1973). Bayesian Inference in Statistical Analysis, Addison-Wesley, Reading.
  16. Campbell G (1982). The maximum of a sequence with prior information, Communications in Statistics. Part C: Sequential Analysis, 1, 177-191. https://doi.org/10.1080/07474948208836012
  17. Campbell G (2005). The experience in the FDA's Center for Devices and Radiological Health with Bayesian strategies, Clinical Trials, 2, 359-363. https://doi.org/10.1191/1740774505cn093oa
  18. Campbell G (2011). Bayesian statistics in medical devices: innovation sparked by the FDA, Journal of Biopharmaceutical Statistics, 21, 871-887. https://doi.org/10.1080/10543406.2011.589638
  19. Campbell G (2013). Similarities and differences of Bayesian designs and adaptive designs for medical devices: a regulatory view, Statistics in Biopharmaceutical Research, 5, 356-368. https://doi.org/10.1080/19466315.2013.846873
  20. Campbell G (2017). Regulatory acceptance of Bayesian statistics. In E Lesaffre, G Baio, and B Boulanger (Eds), Bayesian Statistics Applied to Pharmaceutical Research, CRC Press, Boca Raton.
  21. Campbell G and Hollander M (1978). Rank order estimation with the Dirichlet prior, Annals of Statistics, 6, 142-153. https://doi.org/10.1214/aos/1176344073
  22. Campbell G and Hollander M (1982). Prediction intervals with a Dirichlet-process prior distribution, The Canadian Journal of Statistics, 10, 103-111. https://doi.org/10.2307/3314902
  23. Campbell G and Yue LQ (2016). Statistical innovations in the medical device world sparked by the FDA, Journal of Biopharmaceutical Statistics, 26, 3-16. https://doi.org/10.1080/10543406.2015.1092037
  24. Carlin BP and Louis TA (2009). Bayesian Methods for Data Analysis (3rd ed), Chapman and Hall/CRC, Boca Raton.
  25. Carlin BP and Sargent DJ (1996). Robust Bayesian approaches for clinical trial monitoring, Statistics in Medicine, 15, 1093-1106. https://doi.org/10.1002/(SICI)1097-0258(19960615)15:11<1093::AID-SIM231>3.0.CO;2-0
  26. Chaloner K, Church T, Louis TA, and Matts JP (1993). Graphical elicitation of a prior distribution for a clinical trial, The Statistician, 42, 341-353. https://doi.org/10.2307/2348469
  27. Chen MH, Ibrahim JG, Lam P, Yu A, and Zhang Y (2011). Bayesian design of noninferiority trials for medical devices using historical data, Biometrics, 67, 1163-1170. https://doi.org/10.1111/j.1541-0420.2011.01561.x
  28. Cheng Y, Su F, and Berry DA (2003). Choosing sample size for a clinical trial using decision analysis, Biometrika, 90, 923-936. https://doi.org/10.1093/biomet/90.4.923
  29. Chevret S (2012). Bayesian adaptive clinical trials: a dream for statisticians only?, Statistics in Medicine, 31, 1002-1013. https://doi.org/10.1002/sim.4363
  30. Dixon DO and Simon R (1992). Bayesian subset analysis in a colorectal cancer clinical trial, Statistics in Medicine, 11, 13-22. https://doi.org/10.1002/sim.4780110104
  31. Dmitrienko A and Wang MD (2006). Bayesian predictive approach to interim monitoring in clinical trials, Statistics in Medicine, 25, 2178-2195. https://doi.org/10.1002/sim.2204
  32. Fayers PM, Ashby D, and Parmar MK (1997). Tutorial in biostatistics Bayesian data monitoring in clinical trials, Statistics in Medicine, 16, 1413-1430. https://doi.org/10.1002/(SICI)1097-0258(19970630)16:12<1413::AID-SIM578>3.0.CO;2-U
  33. Ferguson TS (1973). Bayesian analysis of some nonparametric problems, The Annals of Statistics, 1, 209-230. https://doi.org/10.1214/aos/1176342360
  34. Food and Drug Administration (1998). Guidance for industry: E9 statistical principles for clinical trials, Retrieved October, 2017, from: https://www.fda.gov/downloads/drugs/guidancecomplianceregulatoryinformation/guidances/ucm073137.pdf
  35. Food and Drug Administration (2009). FDA panel presentation for Therox P080005, Retrieved October, 2017, from: https://www.fda.gov/ohrms/dockets/ac/09/slides/2009-4419s1-01.pdf
  36. Food and Drug Administration (2010). The use of Bayesian statistics in medical device clinical trials: guidance for industry and Food and Drug Administration staff, Retrieved October, 2017, from: http://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/
  37. Food and Drug Administration (2016a). Adaptive designs for medical device clinical studies: guidance for Industry and Food and Drug Administration staff, Retrieved October, 2017, from: https://www.fda.gov/downloads/medicaldevices/
  38. Food and Drug Administration (2016b). Leveraging existing clinical data for extrapolation to pediatric uses of medical devices: guidance for Industry and Food and Drug Administration staff, Retrieved October, 2017, from: http://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM444591
  39. Food and Drug Administration (2017). FDA CRADAs, Retrieved October, 2017, from: https://www.fda.gov/scienceresearch/collaborativeopportunities/
  40. Freedman LS and Spiegelhalter DJ (1992). Application of Bayesian statistics to decision making during a clinical trial, Statistics in Medicine, 11, 23-35. https://doi.org/10.1002/sim.4780110105
  41. Freedman LS, Spiegelhalter DJ, and Parmar MK (1994). The what, why and how of Bayesian clinical trials monitoring monitoring, Statistics in Medicine, 13, 1371-1383. https://doi.org/10.1002/sim.4780131312
  42. Gamalo MA, Tiwari RC, and LaVange LM (2014). Bayesian approach to the design and analysis of non-inferiority trials for anti-infective products, Pharmaceutical Statistics, 13, 25-40. https://doi.org/10.1002/pst.1588
  43. Gamalo-Siebers M, Savic J, Basu C, et al. (2017). Statistical modeling for Bayesian extrapolation of adult clinical trial information in pediatric drug evaluation, Pharmaceutical Statistics, 16, 232-249. https://doi.org/10.1002/pst.1807
  44. Geman S and Geman D (1984). Stochastic relaxation, Gibbs distribution and Bayesian restoration of images, IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
  45. Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, and Rubin DB (2013). Bayesian Data Analysis (3rd ed), Chapman & Hall/CRC, Boca Raton.
  46. Gonen M (2009). Bayesian clinical trials: no more excuses, Clinical Trials, 6, 203-204. https://doi.org/10.1177/1740774509105374
  47. Goodman SN (1999a). Toward evidence-based medical statistics, I: the P value fallacy, Annals of Internal Medicine, 130, 995-1004. https://doi.org/10.7326/0003-4819-130-12-199906150-00008
  48. Goodman SN (1999b). Toward evidence-based medical statistics, II: the Bayes factor, Annals of Internal Medicine, 130, 1005-1013. https://doi.org/10.7326/0003-4819-130-12-199906150-00019
  49. Goodman SN (2005). Introduction Bayesian methods I: measuring the strength of evidence, Clinical Trials, 2, 282-290. https://doi.org/10.1191/1740774505cn098oa
  50. Greenhouse JB and Wasserman L (1995). Robust Bayesian methods for monitoring clinical trials, Statistics in Medicine, 14, 1379-1391. https://doi.org/10.1002/sim.4780141210
  51. Grieve AP, Choi SC, and Pepple PA (1991). Predictive probability in clinical trials, Biometrics, 47, 323-330. https://doi.org/10.2307/2532518
  52. Grieve AP (2007). 25 years of Bayesian methods in the pharmaceutical industry: a personal, statistical bummel, Pharmaceutical Statistics, 6, 261-281. https://doi.org/10.1002/pst.315
  53. Haddad T, Himes A, Thompson L, Irony T, Nair R, and MDIC Computer Modeling and Simulation Working Group Participants (2017). Incorporation of stochastic engineering models as prior information in Bayesian medical device trials, Journal of Biopharmaceutical Statistics, 10, 1-15.
  54. Hobbs BP, Carlin BP, Mandrekar SJ, and Sargent DJ (2011). Hierarchical commensurate and power prior models for adaptive incorporation of historical information in clinical trials, Biometrics, 67, 1047-1056. https://doi.org/10.1111/j.1541-0420.2011.01564.x
  55. Hobbs BP, Carlin BP, and Sargent DJ (2013). Adaptive adjustment of the randomization ratio using historical control data, Clinical Trials, 10, 430-440. https://doi.org/10.1177/1740774513483934
  56. Hobbs BP, Sargent DJ, and Carlin BP (2012). Commensurate priors for incorporating historical information in clinical trials using general and generalized linear models, Bayesian Analysis, 7, 639-674. https://doi.org/10.1214/12-BA722
  57. Hu F and Rosenberger W (2006). The Theory of Response-Adaptive Randomization in Clinical Trials, Wiley, Hoboken.
  58. Hughes MD (1993). Reporting Bayesian analyses of clinical trials, Statistics in Medicine, 12, 1651-1663. https://doi.org/10.1002/sim.4780121802
  59. Ibrahim JG and Chen MH (2000). Power prior distributions for regression models, Statistical Science, 15, 46-60. https://doi.org/10.1214/ss/1009212673
  60. Inoue LYT, Thall PF, and Berry DA (2002). Seamlessly expanding a randomized phase II trial to phase III, Biometrics, 58, 823-831. https://doi.org/10.1111/j.0006-341X.2002.00823.x
  61. Irony T and Simon R (2006). Application of Bayesian methods to medical device trials, in Clinical Evaluation of Medical Devices, Principles and Case Studies (2nd ed), Humana Press, New York, 99-116.
  62. Kadane JB (1995). Prime time for Bayes, Controlled Clinical Trials, 16, 313-318. https://doi.org/10.1016/0197-2456(95)00072-0
  63. Kadane JB (1996). Bayesian Methods and Ethics in a Clinical Trial Design, Wiley, New York.
  64. Lewis RJ and Berry DA (1994). Group sequential clinical trials: a classical evaluation of Bayesian decision-theoretic designs, Journal of the American Statistical Association, 89, 1528-1534. https://doi.org/10.1080/01621459.1994.10476893
  65. Lipscomb B, Ma G, and Berry DA (2005). Bayesian predictions of final outcomes: Regulatory approval of a spinal implant, Clinical Trials, 2, 325-333. https://doi.org/10.1191/1740774505cn104oa
  66. Louis TA (2005). Introduction Bayesian methods II: fundamental concepts, Clinical Trials, 2, 291-294. https://doi.org/10.1191/1740774505cn099oa
  67. MacEachern SN (2016). Nonparametric Bayesian methods: a gentle introduction and overview, Communications for Statistical Applications and Methods, 23, 445-466. https://doi.org/10.5351/CSAM.2016.23.6.445
  68. Malec D (2001). A closer look at combining data among a small number of binomial experiments, Statistics in Medicine, 20, 1811-1824. https://doi.org/10.1002/sim.782
  69. Meurer WJ, Lewis RJ, Tagle D, et al. (2012). An overview of the adaptive designs accelerating promising trials into treatments (ADAPT-IT) project, Annals of Emergency Medicine, 60, 451-457. https://doi.org/10.1016/j.annemergmed.2012.01.020
  70. Meurer WJ, Legocki L, Mawocha S, et al. (2016). Attitudes and opinions regarding confirmatory adaptive clinical trials: a mixed methods analysis from the Adaptive Designs Accelerating Promising Trials into Treatments (ADAPT-IT) project, Trials, 17, 373. https://doi.org/10.1186/s13063-016-1493-z
  71. Muller P, Xu Y, and Thall P (2017). Clinical trial design as a decision problem, Applied Stochastic Models in Business and Industry, 33, 296-301. https://doi.org/10.1002/asmb.2222
  72. Murray TA, Hobbs BP, Lystig TC, and Carlin BP (2014). Semiparametric Bayesian commensurate survival model for post-market medical device surveillance with non-exchangeable historical data, Biometrics, 70, 185-191. https://doi.org/10.1111/biom.12115
  73. Parmar MKB, Spiegelhalter DJ, and Freedman LS (1994). The CHART trials: Bayesian design and monitoring in practice, Statistics in Medicine, 13, 1297-1312. https://doi.org/10.1002/sim.4780131304
  74. Parmar MKB, Ungerleider RS, and Simon R (1996). Assessing whether to perform a confirmatory randomized clinical trial, Journal of the National Cancer Institute, 88, 1645-1651. https://doi.org/10.1093/jnci/88.22.1645
  75. Pedroza C, Tyson JE, Das A, Laptook A, Bell EF, and Shankaran S (2016). Advantages of Bayesian monitoring methods in deciding whether and when to stop a clinical trial: an example of a neonatal cooling trial, Trials, 17, 335. https://doi.org/10.1186/s13063-016-1480-4
  76. Pennello G and Thompson L (2007). Experience with reviewing Bayesian medical device trials, Journal of Biopharmaceutical Statistics, 18, 81-115. https://doi.org/10.1080/10543400701668274
  77. Pibouleau L and Chevret S (2011). Bayesian statistical method was underused despite its advantages in the assessment of implantable medical devices, Journal of Clinical Epidemiology, 64, 270-279. https://doi.org/10.1016/j.jclinepi.2010.03.018
  78. Royall RM (1991). Ethics and statistics in randomized clinical trials (with discussion), Statistical Science, 6, 52-88. https://doi.org/10.1214/ss/1177011934
  79. Saville BR, Connor JT, Ayers GD, and Alvarez J (2014). The utility of Bayesian predictive probabilities for interim monitoring of clinical trials, Clinical Trials, 11, 485-493. https://doi.org/10.1177/1740774514531352
  80. Simon R (1991). A decade of progress in statistical methodology for clinical trials, Statistics in Medicine, 10, 1789-1817. https://doi.org/10.1002/sim.4780101203
  81. Simon R (2002). Bayesian subset analysis: application to studying treatment-by-gender interactions, Statistics in Medicine, 21, 2909-2916. https://doi.org/10.1002/sim.1295
  82. Spiegelhalter DJ, Abrams KR, and Myles JP (2004). Bayesian Approaches to Clinical Trials and Health-Care Evaluation, Wiley, Chichester.
  83. Spiegelhalter DJ, Freedman LS, and Parmar MKB (1994). Bayesian approaches to randomised trials, Journal of the Royal Statistical Society Series A (Statistics in Society), 157, 357-416. https://doi.org/10.2307/2983527
  84. Spiegelhalter D, Thomas A, Best N, and Lunn D (2003). WinBUGS version 1.4.1 user manual, Retrieved October, 2017, from: http://www.mrc-bsu.cam.ac.uk/wpcontent/uploads/manual14.pdf
  85. Stokes M, Chen F, and Gunes F (2015). An introduction to Bayesian analysis with SAS/STAT software: paper SAS1775-2015, Retrieved October, 2017, from: http://support.sas.com/resources/papers/proceedings15/SAS1775-2015.pdf
  86. Stone GW, Martin JL, de Boer MJ, et al. (2009). Effect of supersaturated oxygen delivery on infarct size after percutaneous coronary intervention in acute myocardial infarction, Circulation: Cardiovascular Interventions, 2, 366-375.
  87. Sung L, Hayden J, Greenberg ML, Koren G, Feldman BM, and Tomlinson GA (2005). Seven items were identified for inclusion when reporting a Bayesian analysis of a clinical study, Journal of Clinical Epidemiology, 58, 261-268. https://doi.org/10.1016/j.jclinepi.2004.08.010
  88. Temple R (2005). How FDA currently makes decisions on clinical studies, Clinical Trials, 2, 276-281. https://doi.org/10.1191/1740774505cn097oa
  89. Viele K, Berry S, Neuenschwander B, et al. (2014). Use of historical control data for assessing treatment effects in clinical trials, Pharmaceutical Statistics, 13, 41-54. https://doi.org/10.1002/pst.1589
  90. Waddingham E, Mt-Isa S, Nixon R, and Ashby D (2015). A Bayesian approach to probabilistic sensitivity analysis in structured benefit-risk assessment, Biometrical Journal, 58, 28-42.
  91. Ware JH (1989). Investigating therapies of potentially great benefit: ECMO (with discussion), Statistical Science, 4, 298-340. https://doi.org/10.1214/ss/1177012384
  92. Wasserman RL and Lazar NA (2016). The ASA's statement on p-values: context, process and purpose, The American Statistician, 70, 129-133. https://doi.org/10.1080/00031305.2016.1154108
  93. Wei LJ and Durham S (1978). The randomized play-the-winner rule in medical trials, Journal of the American Statistical Association, 73, 830-843.
  94. Woodcock J (2005). FDA introductory comments: clinical study design and evaluation issues, Clinical Trials, 2, 273-275. https://doi.org/10.1191/1740774505cn096oa
  95. Yang X, Thompson L, Chu J, et al. (2016). Adaptive design practice at the Center for Devices and Radiological Health (CDRH), January 2007 to May 2013. Therapeutic Innovation and Regulatory Science, 50, 710-717. https://doi.org/10.1177/2168479016656027