Industrial Engineering and Management Systems

Korean Institute of Industrial Engineers (대한산업공학회)
권호 표지
DOI QR코드

DOI QR Code

Comparison of Three Evolutionary Algorithms: GA, PSO, and DE

  • Received : 2012.06.29
  • Accepted : 2012.08.18
  • Published : 2012.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper focuses on three very similar evolutionary algorithms: genetic algorithm (GA), particle swarm optimization (PSO), and differential evolution (DE). While GA is more suitable for discrete optimization, PSO and DE are more natural for continuous optimization. The paper first gives a brief introduction to the three EA techniques to highlight the common computational procedures. The general observations on the similarities and differences among the three algorithms based on computational steps are discussed, contrasting the basic performances of algorithms. Summary of relevant literatures is given on job shop, flexible job shop, vehicle routing, location-allocation, and multimode resource constrained project scheduling problems.

Keywords

References

  1. Ai, T. J. and Kachitvichyanukul, V. (2009a), A particle swarm optimization for the heterogeneous fleet vehicle routing problem, International Journal of Logistics and SCM Systems, 3(1), 32-39.
  2. Ai, T. J. and Kachitvichyanukul, V. (2009b), A particle swarm optimization for vehicle routing problem with time windows, International Journal of Operational Research, 6(4), 519-537. https://doi.org/10.1504/IJOR.2009.027156
  3. Ai, T. J. and Kachitvichyanukul, V. (2009c), A particle swarm optimization for the vehicle routing problem with simultaneous pickup and delivery, Computers and Operations Research, 36(5), 1693-1702. https://doi.org/10.1016/j.cor.2008.04.003
  4. Ai, T. J. and Kachitvichyanukul, V. (2009d), Particle swarm optimization and two solution representations for solving the capacitated vehicle routing problem, Computers and Industrial Engineering, 56(1), 380- 387. https://doi.org/10.1016/j.cie.2008.06.012
  5. Amiri, A. (2006), Designing a distribution network in a supply chain system: formulation and efficient solution procedure, European Journal of Operational Research, 171(2), 567-576. https://doi.org/10.1016/j.ejor.2004.09.018
  6. Baker, B. M. and Ayechew, M. A. (2003), A genetic algorithm for the vehicle routing problem, Computers and Operations Research, 30(5), 787-800. https://doi.org/10.1016/S0305-0548(02)00051-5
  7. Canel, C., Khumawala, B. M., Law, J., and Loh, A. (2001), An algorithm for the capacitated, multicommodity multi-period facility location problem, Computers and Operations Research, 28(5), 411- 427. https://doi.org/10.1016/S0305-0548(99)00126-4
  8. Ge, H.-W., Sun, L., Liang, Y.-C., and Qian, F. (2008), An effective PSO and AIS-based hybrid intelligent algorithm for job-shop scheduling, IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 38(2), 358-368. https://doi.org/10.1109/TSMCA.2007.914753
  9. Gen, M. and Cheng, R. (1997), Genetic Algorithms and Engineering Design, Wiley, New York, NY.
  10. Gen, M., Cheng, R., and Lin, L. (2008), Network Models and Optimization: Multiobjective Genetic Algorithm Approach, Springer, London, UK.
  11. Godfrey, O. and Donald, D. (2006), Scheduling flow shops using differential evolution algorithm, European Journal of Operational Research, 171(2), 674-692. https://doi.org/10.1016/j.ejor.2004.08.043
  12. Goldberg, D. E. (1989), Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley Pub., Reading, MA.
  13. Hassan, R., Cohanim, B., de Weck, O., and Venter, G. (2005), A comparison of particle swarm optimization and the genetic algorithm, Proceedings of the 1st AIAA Multidisciplinary Design Optimization Specialist Conference, Austin, TX.
  14. Holland, J. H. (1975), Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence, University of Michigan Press, Ann Arbor, MI.
  15. Hwang, H.-S. (2002), An improved model for vehicle routing problem with time constraint based on genetic algorithm, Computers and Industrial Engineering, 42(2-4), 361-369. https://doi.org/10.1016/S0360-8352(02)00033-5
  16. Jaramillo, J. H., Bhadury, J., and Batta, R. (2002), On the use of genetic algorithms to solve location problems, Computers and Operations Research, 29(6), 761-779. https://doi.org/10.1016/S0305-0548(01)00021-1
  17. Jarboui, B., Damak, N., Sirry, P., and Rebai, A. (2008), A combinatorial particle swarm optimization for solving multi-mode resource-constrained project scheduling problems, Applied Mathematics and Computation, 195(1), 299-308. https://doi.org/10.1016/j.amc.2007.04.096
  18. Kacem, I., Hammadi, S., and Borne, P. (2002), Approach by localization and multiobjective evolutionary optimization for flexible job-shop scheduling problems, IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, 32(1), 1-13 https://doi.org/10.1109/TSMCC.2002.1009117
  19. Kachitvichyanukul, V., Vinaipanit, M., and Kungwalsong, K. (2010), A genetic algorithm for multicommodity distribution network design of supply chain, International Journal of Logistics and Transport, 4(2), 167-181.
  20. Kachitvichyanukul, V. and Sitthitham, S. (2011), A twostage genetic algorithm for multi-objective job shop scheduling problems, Journal of Intelligent Manufacturing, 22(3), 355-365. https://doi.org/10.1007/s10845-009-0294-6
  21. Kasemset, C. and Kachitvichyanukul, V. (2010), Bi-level multi-objective mathematical model for job-shop scheduling: the application of theory of constraints, International Journal of Production Research, 48 (20), 6137-6154. https://doi.org/10.1080/00207540903176705
  22. Kasemset, C. and Kachitvichyanukul, V. (2012), A PSObased procedure for a bi-level multi-objective TOCbased job-shop scheduling problem, International Journal of Operational Research, 14(1), 50-69. https://doi.org/10.1504/IJOR.2012.046343
  23. Kennedy, J. and Eberhart, R. (1995), Particle swarm optimization, Proceedings of IEEE International Conference on Neural Networks, Perth, WA, 1942-1948.
  24. Liu, B., Wang, L., and Jin, Y.-H. (2007a), An effective hybrid particle swarm optimization for no-wait flow shop scheduling, The International Journal of Advanced Manufacturing Technology, 31(9/10), 1001- 1011. https://doi.org/10.1007/s00170-005-0277-5
  25. Liu, B., Wang, L., and Jin, Y.-H. (2007b), An effective PSO-based memetic algorithm for flow shop scheduling, IEEE Transactions on Systems, Man, and Cybernetics Part B, 37(1), 18-27. https://doi.org/10.1109/TSMCB.2006.883272
  26. Lova, A., Tormos, P., Cervantes, M., and Barber, F. (2009), An efficient hybrid genetic algorithm for scheduling projects with resource constraints and multiple execution modes, International Journal of Production Economics, 117(2), 302-316. https://doi.org/10.1016/j.ijpe.2008.11.002
  27. Marinakis, Y. and Marinaki, M. (2010), A hybrid genetic- particle swarm optimization algorithm for the vehicle routing problem, Expert Systems with Applications, 37(2), 1446-1455. https://doi.org/10.1016/j.eswa.2009.06.085
  28. Melo, M. T., Nickel, S., and Saldanha de Gama, F. (2006), Dynamic multi-commodity capacitated facility location: a mathematical modeling framework for strategic supply chain planning, Computers and Operations Research, 33(1), 181-208. https://doi.org/10.1016/j.cor.2004.07.005
  29. Nguyen, S., Ai, T. J., and Kachitvichyanukul, V. (2010), Object Library for Evolutionary Techniques (ETLib): User's Manual, Asian Institute of Technology, Tailand.
  30. Nguyen, S. and Kachitvichyanukul, V. (2010), Movement strategies for multi-objective particle swarm optimization, International Journal of Applied Metaheuristic Computing, 1(3), 59-79. https://doi.org/10.4018/jamc.2010070105
  31. Nguyen, S. and Kachitvichyanukul, V. (2012), An efficient differential evolution algorithm for multimode resource constrained project scheduling problems, International Journal of Operational Research (Accepted March 2012).
  32. Pan, Q.-K., Tasgetiren, M. F., and Liang, Y.-C. (2008), A discrete differential evolution algorithm for the permutation flowshop scheduling problem, Computers and Industrial Engineering, 55(4), 795-816. https://doi.org/10.1016/j.cie.2008.03.003
  33. Van Peteghem, V. and Vanhoucke, M. (2010), A genetic algorithm for the preemptive and non-preemptive multi-mode resource-constrained project scheduling problem, European Journal of Operational Research, 201(2), 409-418. https://doi.org/10.1016/j.ejor.2009.03.034
  34. Pezzella, F., Morganti, G., and Ciaschetti, G. (2008), A genetic algorithm for the flexible job-shop scheduling problem, Computers and Operations Research, 35(10), 3202-3212. https://doi.org/10.1016/j.cor.2007.02.014
  35. Pongchairerks, P. and Kachitvichyanukul, V. (2005), A non-homogenous particle swarm optimization with multiple social structures, Proceedings of the International Conference on Simulation and Modeling, Bangkok, Thailand.
  36. Pongchairerks, P. and Kachitvichyanukul, V. (2009), A two-level particle swarm optimisation algorithm on job-shop scheduling problems, International Journal of Operational Research, 4(4), 390-411. https://doi.org/10.1504/IJOR.2009.023535
  37. Pratchayaborirak, T. and Kachitvichyanukul, V. (2011), A two-stage PSO algorithm for job shop scheduling problem, International Journal of Management Science and Engineering Management, 6(2), 84-93
  38. Price, K. V., Storn, R. M., and Lampinen, J. A. (2005), Differential Evolution: A Practical Approach to Global Optimization, Springer, Berlin, Germany.
  39. Prins, C. (2004) A simple and effective evolutionary algorithm for the vehicle routing problem, Computers and Operations Research, 31(12), 1985-2002. https://doi.org/10.1016/S0305-0548(03)00158-8
  40. Qian, B., Wang, L., Huang, D.-X., and Wang, W. (2008), Scheduling multi-objective job shops using a memetic algorithm based on differential evolution, The International Journal of Advanced Manufacturing Technology, 35(9-10), 1014-1027. https://doi.org/10.1007/s00170-006-0787-9
  41. Sombuntham, P. and Kachitvichyanukul, V. (2010), Multi- depot vehicle routing problem with pickup and delivery requests, Proceedings of the International MultiConference of Engineers and Computer Scientists, Hong Kong, 71-85.
  42. Sooksaksun, N., Kachitvichyanukul, V., and Gong, D.-C. (2012), A class-based storage warehouse design using a particle swarm optimisation algorithm, International Journal of Operational Research, 13(2), 219-237. https://doi.org/10.1504/IJOR.2012.045188
  43. Storn, R. and Price, K. (1995), Differential evolution-a simple and efficient adaptive scheme for global optimization over continuous spaces, Technical Report TR-95-012, International Computer Science Institute, Berkeley, CA.
  44. Syarif, A., Yun, Y., and Gen, M. (2002), Study on multistage logistic chain network: a spanning tree-based genetic algorithm approach, Computers and Industrial Engineering, 43(1/2), 299-314. https://doi.org/10.1016/S0360-8352(02)00076-1
  45. Wall, M. (1996), GAlib: A C++ library of genetic algorithm components, http://lancet.mit.edu/ga/.
  46. Wisittipanich, W. and Kachitvichyanukul, V. (2011), Differential evolution algorithm for job shop scheduling problem, Industrial Engineering and Management Systems, 10(3), 203-208. https://doi.org/10.7232/iems.2011.10.3.203
  47. Wisittipanich, W. and Kachitvichyanukul, V. (2012), Two enhanced differential evolution algorithms for job shop scheduling problems, International Journal of Production Research, 50(10), 2757-2773. https://doi.org/10.1080/00207543.2011.588972
  48. Xia, W. and Wu, Z. (2005), An effective hybrid optimization approach for multi-objective flexible jobshop scheduling problems, Computers and Industrial Engineering, 48(2), 409-425. https://doi.org/10.1016/j.cie.2005.01.018
  49. Xia, W. and Wu, Z. (2006), A hybrid particle swarm optimization approach for the job-shop scheduling problem, The International Journal of Advanced Manufacturing Technology, 29(3/4), 360-366. https://doi.org/10.1007/s00170-005-2513-4
  50. Yu, X. and Gen, M. (2010), Introduction to Evolutionary Algorithms, Springer, London, UK.
  51. Zhang, H. and Gen, M. (2005), Multistage-based genetic algorithm for flexible job-shop scheduling problem, Journal of Complexity International, 11, 223-232.

Cited by

  1. Application of Adaptive Particle Swarm Optimization to Bi-level Job-Shop Scheduling Problem vol.13, pp.1, 2014, https://doi.org/10.7232/iems.2014.13.1.043
  2. An Orthogonal Learning Differential Evolution Algorithm for Remote Sensing Image Registration vol.2014, pp.1563-5147, 2014, https://doi.org/10.1155/2014/305980
  3. An Improved Polynomial Neural Network Classifier Using Real-Coded Genetic Algorithm vol.45, pp.11, 2015, https://doi.org/10.1109/TSMC.2015.2406855
  4. Transport Aircraft Conceptual Design Optimization Using Real Coded Genetic Algorithm vol.2016, pp.1687-5974, 2016, https://doi.org/10.1155/2016/2813541
  5. Optimizing Greenhouse Lighting for Advanced Agriculture Based on Real Time Electricity Market Price vol.2017, pp.1563-5147, 2017, https://doi.org/10.1155/2017/6862038
  6. An Improved Multi-Objective Particle Swarm Optimization Algorithm Based on Adaptive Local Search vol.8, pp.2, 2017, https://doi.org/10.4018/IJAEC.2017040101
  7. A multi-release software reliability modeling for open source software incorporating dependent fault detection process pp.1572-9338, 2017, https://doi.org/10.1007/s10479-017-2556-6
  8. Intrusion detection of distributed denial of service attack in cloud pp.1573-7543, 2017, https://doi.org/10.1007/s10586-017-1149-0
  9. Distributed Query Plan Generation using Particle Swarm Optimization vol.4, pp.3, 2013, https://doi.org/10.4018/ijsir.2013070104
  10. Comparative Study of DE, PSO and GA for Position Domain PID Controller Tuning vol.8, pp.3, 2015, https://doi.org/10.3390/a8030697
  11. The Multi-Objective Optimization Algorithm Based on Sperm Fertilization Procedure (MOSFP) Method for Solving Wireless Sensor Networks Optimization Problems in Smart Grid Applications vol.11, pp.1, 2018, https://doi.org/10.3390/en11010097
  12. Nonlinear Modeling and Inferential Multi-Model Predictive Control of a Pulverizing System in a Coal-Fired Power Plant Based on Moving Horizon Estimation vol.11, pp.3, 2018, https://doi.org/10.3390/en11030589
  13. Prediction of river flow using hybrid neuro-fuzzy models vol.11, pp.22, 2018, https://doi.org/10.1007/s12517-018-4079-0
  14. ratio for elastic wavefield inversion vol.34, pp.11, 2018, https://doi.org/10.1088/1361-6420/aade1f
  15. A Multi-Criteria Decision Maker for Grid-Connected Hybrid Renewable Energy Systems Selection Using Multi-Objective Particle Swarm Optimization vol.11, pp.4, 2019, https://doi.org/10.3390/su11041188
  16. Behavioral study and availability optimization of a multi-state repairable system with hot redundancy pp.0265-671X, 2019, https://doi.org/10.1108/IJQRM-12-2017-0274
  17. Hybrid genetic algorithm for test bed scheduling problems vol.52, pp.4, 2012, https://doi.org/10.1080/00207543.2013.838327
  18. Evolutionary Algorithm-based Space Diversity for Imperfect Channel Estimation vol.8, pp.5, 2012, https://doi.org/10.3837/tiis.2014.05.005
  19. A combination of genetic algorithm and particle swarm optimization method for solving traveling salesman problem vol.2, pp.1, 2012, https://doi.org/10.1080/23311835.2015.1048581
  20. Weighted Fuzzy Interpolative Reasoning Based on the Slopes of Fuzzy Sets and Particle Swarm Optimization Techniques vol.45, pp.7, 2015, https://doi.org/10.1109/tcyb.2014.2347956
  21. Assessment of evolutionary algorithms in predicting non-deposition sediment transport vol.13, pp.5, 2012, https://doi.org/10.1080/1573062x.2014.994003
  22. A particle swarm optimization approach in printed circuit board thermal design vol.24, pp.2, 2012, https://doi.org/10.3233/ica-160536
  23. Scope of Support Vector Machine in Steganography vol.225, pp.None, 2012, https://doi.org/10.1088/1757-899x/225/1/012077
  24. PSO Method for Fitting Analytic Potential Energy Functions. Application to I-(H2O) vol.14, pp.3, 2012, https://doi.org/10.1021/acs.jctc.7b01122
  25. An improved fuzzy time series forecasting model using the differential evolution algorithm vol.36, pp.2, 2012, https://doi.org/10.3233/jifs-18636
  26. A Study of Sensor Placement Optimization Problem for Guided Wave-Based Damage Detection vol.19, pp.8, 2012, https://doi.org/10.3390/s19081856
  27. Numerical Modeling and Hydraulic Optimization of a Surge Tank Using Particle Swarm Optimization vol.11, pp.4, 2012, https://doi.org/10.3390/w11040715
  28. Performance modeling and optimization for complex repairable system of paint manufacturing unit using a hybrid BFO-PSO algorithm vol.36, pp.7, 2012, https://doi.org/10.1108/ijqrm-02-2018-0041
  29. Dynamic transportation planning for prefabricated component supply chain vol.27, pp.9, 2012, https://doi.org/10.1108/ecam-12-2019-0674
  30. Novel approaches for air temperature prediction: A comparison of four hybrid evolutionary fuzzy models vol.27, pp.1, 2020, https://doi.org/10.1002/met.1817
  31. Design and Optimization of Three-Phase Dual-Active-Bridge Converters for Electric Vehicle Charging Stations vol.13, pp.1, 2012, https://doi.org/10.3390/en13010150
  32. Sparse Principal Component Analysis Using Particle Swarm Optimization vol.53, pp.7, 2020, https://doi.org/10.1252/jcej.20we006
  33. Hybrid differential evolution algorithm and genetic operator for multi-trip vehicle routing problem with backhauls and heterogeneous fleet in the beverage logistics industry vol.146, pp.None, 2012, https://doi.org/10.1016/j.cie.2020.106571
  34. Big Data-Based Optimization of a Pressure Swing Adsorption Unit for Syngas Purification: On Mapping Uncertainties from a Metaheuristic Technique vol.59, pp.31, 2020, https://doi.org/10.1021/acs.iecr.0c01155
  35. An Overview of Mutation Strategies in Particle Swarm Optimization : vol.11, pp.4, 2012, https://doi.org/10.4018/ijamc.2020100102
  36. Performance Comparison between Particle Swarm Optimization and Differential Evolution Algorithms for Postman Delivery Routing Problem vol.11, pp.6, 2012, https://doi.org/10.3390/app11062703
  37. Swarm Intelligence-Based Methodology for Scanning Electron Microscope Image Segmentation of Solid Oxide Fuel Cell Anode vol.14, pp.11, 2012, https://doi.org/10.3390/en14113055
  38. Comprehensive Model for Real Battery Simulation Responsive to Variable Load vol.14, pp.11, 2012, https://doi.org/10.3390/en14113209
  39. Multi-Objective Optimization of a Mine Water Reuse System Based on Improved Particle Swarm Optimization vol.21, pp.12, 2012, https://doi.org/10.3390/s21124114
  40. Integration of DE Algorithm with PDC-APF for Enhancement of Contour Path Planning of a Universal Robot vol.11, pp.14, 2012, https://doi.org/10.3390/app11146532
  41. From an Optimal Point to an Optimal Region: A Novel Methodology for Optimization of Multimodal Constrained Problems and a Novel Constrained Sliding Particle Swarm Optimization Strategy vol.9, pp.15, 2012, https://doi.org/10.3390/math9151808
  42. Using an Improved Differential Evolution for Scheduling Optimization of Dual-Gantry Multi-Head Surface-Mount Placement Machine vol.9, pp.16, 2021, https://doi.org/10.3390/math9162016
  43. Optimization of Sizing and Operation Strategy of Distributed Generation System Based on a Gas Turbine and Renewable Energy vol.14, pp.24, 2012, https://doi.org/10.3390/en14248448
  44. From a Pareto Front to Pareto Regions: A Novel Standpoint for Multiobjective Optimization vol.9, pp.24, 2012, https://doi.org/10.3390/math9243152
  45. Practical health indicator construction methodology for bearing ensemble remaining useful life prediction with ISOMAP-DE and ELM-WPHM vol.33, pp.2, 2012, https://doi.org/10.1088/1361-6501/ac3855