International Journal of Fluid Machinery and Systems

Korean Society for Fluid machinery (한국유체기계학회)
권호 표지
DOI QR코드

DOI QR Code

Effects of Latin hypercube sampling on surrogate modeling and optimization

  • Afzal, Arshad (Department of Mechanical Engineering, Indian Institute of Technology Kanpur) ;
  • Kim, Kwang-Yong (Department of Mechanical Engineering, Inha University) ;
  • Seo, Jae-won (Department of Mechanical Engineering, Inha University)
  • Received : 2016.08.30
  • Accepted : 2017.02.23
  • Published : 2017.06.30
⟨ Previous Next ⟩

Abstract

Latin hypercube sampling is widely used design-of-experiment technique to select design points for simulation which are then used to construct a surrogate model. The exploration/exploitation properties of surrogate models depend on the size and distribution of design points in the chosen design space. The present study aimed at evaluating the performance characteristics of various surrogate models depending on the Latin hypercube sampling (LHS) procedure (sample size and spatial distribution) for a diverse set of optimization problems. The analysis was carried out for two types of problems: (1) thermal-fluid design problems (optimizations of convergent-divergent micromixer coupled with pulsatile flow and boot-shaped ribs), and (2) analytical test functions (six-hump camel back, Branin-Hoo, Hartman 3, and Hartman 6 functions). The three surrogate models, namely, response surface approximation, Kriging, and radial basis neural networks were tested. The important findings are illustrated using Box-plots. The surrogate models were analyzed in terms of global exploration (accuracy over the domain space) and local exploitation (ease of finding the global optimum point). Radial basis neural networks showed the best overall performance in global exploration characteristics as well as tendency to find the approximate optimal solution for the majority of tested problems. To build a surrogate model, it is recommended to use an initial sample size equal to 15 times the number of design variables. The study will provide useful guidelines on the effect of initial sample size and distribution on surrogate construction and subsequent optimization using LHS sampling plan.

Keywords

References

  1. Kim, H.M. and Kim, K. Y., 2006, "Shape optimization of three-dimensional channel roughened by angled ribs with RANS analysis of turbulent heat transfer," International Journal of Heat and Mass Transfer, Vol. 49, pp. 4013-4022. https://doi.org/10.1016/j.ijheatmasstransfer.2006.03.039
  2. Knill D.L., Giunta A.A., Baker C.A., Grossman B., Mason W.H., Haftka R.T., Watson L.T., 1999, "Response surface models combining linear and euler aerodynamics for supersonic transport design," Journal of Aircraft, Vol. 36 No. 1, pp. 75-86. https://doi.org/10.2514/2.2415
  3. Lee, S.Y. and Kim, K. Y., 2000, "Design optimization of axial flow compressor blades with three-dimensional Navier-Stokes solver," KSME International Journal, Vol. 14 No. 9, 1005-1012. https://doi.org/10.1007/BF03185803
  4. Bahrami, S., Tribes, C., Fellenberg, S.V., Vu, T.C., Guibault F., 2015, "Physics-based Surrogate Optimization of Francis Turbine Runner Blades, Using Mesh Adaptive Direct Search and Evolutionary Algorithms," International Journal of Fluid Machinery and Systems, Vol. 8 No. 3, 209-219. https://doi.org/10.5293/IJFMS.2015.8.3.209
  5. Samad, A., Kim, K. Y., Goel, T., Haftka, R.T. and Shyy, W., 2008, "Multiple surrogate modeling for axial compressor blade shape optimization," Journal of Propulsion and power, 24, 302-310.
  6. Samad, A., and Kim, K. Y., 2009, "Surrogate Based Optimization Techniques for Aerodynamic Design of Turbomachinery," International Journal of Fluid Machinery and Systems, Vol. 2 No. 2, pp. 179-188. https://doi.org/10.5293/IJFMS.2009.2.2.179
  7. Benini, E., 2004, "Three-Dimensional Multi-Objective Design Optimization of a Transonic Compressor Rotor," Journal of Propulsion and power, Vol. 20 No. 3, pp. 559-565. https://doi.org/10.2514/1.2703
  8. Madsen, J.I., Shyy, W. and Haftka, R.T, 2000, "Response surface techniques for diffuser shape optimization," AIAA J, Vol. 38, pp. 1512-1518. https://doi.org/10.2514/2.1160
  9. Queipo, N.V., Haftka, R.T., Shyy, W., Goel, T., Vaidyanathan, R. and Tucker, P.K., 2005, "Surrogate-based analysis and optimization," Progress in Aerospace sciences, Vol. 41, pp. 1-28. https://doi.org/10.1016/j.paerosci.2005.02.001
  10. Forrester, A.I.J. and Keane, A.J., 2009, "Recent advances in surrogate-based optimization," Progress in Aerospace sciences, Vol. 45, pp. 50-79. https://doi.org/10.1016/j.paerosci.2008.11.001
  11. Barthelemy, J.-FM. and Haftka, R.T, 1993, "Approximation concepts for optimum structural design-a review," Structural Optimization, Vol. 5, pp. 129-144. https://doi.org/10.1007/BF01743349
  12. Afzal, A. and Kim, K.-Y., 2015, "Multi-objective Optimization of a Passive Micromixer based on periodic variation of Velocity profile," Chemical Engineering Communications, Vol. 202, pp. 322-333. https://doi.org/10.1080/00986445.2013.841150
  13. Afzal, A. and Kim, K.-Y., 2015, "Multi-objective Optimization of a Micromixer with Convergent-divergent sinusoidal walls," Chemical Engineering Communications, Vol. 202, pp. 1324-1334. https://doi.org/10.1080/00986445.2014.935352
  14. Afzal. A. and Kim, K.-Y., 2015, "Optimization of pulsatile flow and geometry for a Convergent-divergent micromixer," Chemical Engineering Technology., Vol. 281, pp. 134-143. https://doi.org/10.1016/j.cej.2015.06.046
  15. Afzal, A. and Kim, K. Y., 2015, "Convergent-divergent micromixer coupled with Pulsatile flow," Sens Actuators B: Chemical, 211, 198-205. https://doi.org/10.1016/j.snb.2015.01.062
  16. Jin, R., Chen, W. and Simpson, T.W., 2001, "Comparative studies of metamodeling techniques under multiple modeling criteria," Structural and Multidisciplinary Optimization, Vol. 23 No. 1, pp. 1-13. https://doi.org/10.1007/s00158-001-0160-4
  17. Simpson, T.W., Peplinski, J.D., Koch, P.N. and Allen, J.K., 2001, "Meta-models for computer based engineering design: survey and recommendations," Engineering Computations, Vol. 17, pp. 129-150. https://doi.org/10.1007/PL00007198
  18. Regis, R.G., 2016, "Trust regions in Kriging-based optimization with expected improvement," Engineering optimization, Vol. 48 No. 6, pp. 1037-1059. https://doi.org/10.1080/0305215X.2015.1082350
  19. Wang, H., Ye, F., Li, E. and Li, G., 2016, "A comparative study of expected improvement-assisted global optimization with different surrogates," Engineering optimization, Vol. 48 No. 8, pp. 1432-1458. https://doi.org/10.1080/0305215X.2015.1115645
  20. Jones, D.R., Schonlau, M. and Welch, W.J., 1998, "Efficient global optimization of expensive black-box functions," J. Global Optimization, Vol. 13, pp. 455-492. https://doi.org/10.1023/A:1008306431147
  21. Yang, X., Liu, Y., Gao, Y., Zhang, Y., and Gao, Z., 2015, "An active learning kriging model for hybrid reliability analysis with both random and interval variables," Structural and Multidisciplinary Optimization, Vol. 51, pp. 1003-1016. https://doi.org/10.1007/s00158-014-1189-5
  22. Razavi, S., Tolson, B.A. and Burn, D.H., 2012, "Review of surrogate modeling in water resources," Water Resources Research, Vol. 48 No. 7, pp. 1-32. https://doi.org/10.1016/j.advwatres.2012.07.002
  23. Mehmani, A., Zhang, J., Chowdhury, S. and Messac, A., 2012, "Surrogate-based Design Optimization with Adaptive sequential sampling," 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, Honolulu, Hawaii.
  24. McKay, M., Conover, W. and Beckman, R., 1979, "A comparison of three methods for selecting values of input variables in the analysis of output from a computer code," Technometrics, Vol. 21, pp. 239-45.
  25. Stein, M., 1987, "Large sample properties of simulations using Latin hypercube sampling," Technometrics, 29, 143-51. https://doi.org/10.1080/00401706.1987.10488205
  26. Myers, R.H. and Montgomery, D.C., 1995, Response Surface Methodology: Process and Product Optimization Using Designed Experiments. New York, Wiley
  27. Martin, J.D. and Simpson, T.W., 2005, "Use of Kriging models to approximate deterministic computer models," AIAA J., Vol. 43 No. 4, 853-863. https://doi.org/10.2514/1.8650
  28. Chen, C., Cowan, C. F. N. and Grant, P. M., 1991, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE transaction of neural networks, Vol. 2, pp. 302-309. https://doi.org/10.1109/72.80341
  29. MATLAB version 8.4.0, 2014, The Language of Technical Computing, Massachusetts: The MathWorks, Inc.
  30. Kennedy, J. and Eberhart, R.C., 1995, "Particle Swarm Optimization," Proceedings of the IEEE International Conference on Neural Networks, 27 November-1 December, Perth, Australia, 1942-1948.
  31. Seo, J.W., Afzal, A. and Kim, K. Y., 2015, "Optimization of a boot-shaped rib in a cooling channel," The 13th Asian International Conference on Fluid Machinery, Tokyo, Japan, September 7-10.
  32. Dittus, F.W. and Boelter, L.M., 1930, "Heat Transfer in Automobile Radiators of the Turbulator Type," University of California, Berkeley Publication, Vol. 2, pp. 443-461.
  33. Petukhov, B.S., 1970. Advances in Heat Transfer. New York: Academic Press.
  34. Dixon, L.C.W. and Szego, G.P., 1978, "Towards global optimization 2," Amsterdam, The Netherlands: North Holland.

Cited by

  1. Design Optimization of the Centrifugal Pumps via Low Fidelity Models vol.2018, pp.1563-5147, 2018, https://doi.org/10.1155/2018/3987594