Artificial Intelligence (Invited Review Article)No Access

Harmony Search Algorithm and its Variants

School of Computing and Intelligent Systems, Ulster University, Northland Road, Londonderry, BT48 7JL, United Kingdom

E-mail Address: nh.siddique@ulster.ac.uk

Corresponding author.

and

Departments of Biomedical Engineering, Biomedical Informatics, Civil, Environmental, and Geodetic Engineering, Electrical and Computer Engineering, Neuroscience and Neurology, The Ohio State University, 470 Hitchcock Hall, 2070 Neil Avenue, Columbus, Ohio 43210, USA

E-mail Address: Adeli.1@osu.edu

Search for more papers by this author

https://doi.org/10.1142/S0218001415390012Cited by:83 (Source: Crossref)

Abstract

In the past three decades nature-inspired and meta-heuristic algorithms have dominated the literature in the broad areas of search and optimization. Harmony search algorithm (HSA) is a music-inspired population-based meta-heuristic search and optimization algorithm. The concept behind the algorithm is to find a perfect state of harmony determined by aesthetic estimation. This paper starts with an overview of the harmonic phenomenon in music and music improvisation used by musicians and how it is applied to the optimization problem. The concept of harmony memory and its mathematical implementation are introduced. A review of HSA and its variants is presented. Guidelines from the literature on the choice of parameters used in HSA for effective solution of optimization problems are summarized.

Keywords:

References

1. H. Adeli, Advances in Design Optimization (Chapman and Hall, London, 1994). Crossref, Google Scholar
2. H. Adeli and S. L. Hung, Machine Learning- Neural Networks, Genetic Algorithms, and Fuzzy Sets (John Wiley and Sons, New York, 1995). Google Scholar
3. H. Adeli and A. Karim, Scheduling/cost optimization and neural dynamics model for construction, J. Construct. Manag. Eng. 123 (4) (1997) 450–458. Crossref, Web of Science, Google Scholar
4. H. Adeli and H. Kim, Cost optimization of composite floors using the neural dynamics model, Commun. Numer. Methods Eng. 17 (2001) 771–787. Crossref, Web of Science, Google Scholar
5. H. Adeli and S. Kumar, Distributed Computer-Aided Engineering for Analysis, Design, and Visualization (CRC Press, Boca Raton, Florida, 1999). Google Scholar
6. H. Adeli and H. S. Park, A neural dynamics model for structural optimization — theory, Comput. Struct. 57 (3) (1995) 383–390. Crossref, Web of Science, Google Scholar
7. H. Adeli and H. S. Park, Optimization of space structures by neural dynamics, Neural Net. 8 (5) (1995) 769–781. Crossref, Web of Science, Google Scholar
8. H. Adeli and H. S. Park, Neurocomputing for Design Automation (CRC Press, Boca Raton, Florida, 1998). Crossref, Google Scholar
9. H. Adeli and K. Sarma, Cost Optimization of Structures – Fuzzy Logic, Genetic Algorithms, and Parallel Computing (John Wiley and Sons, West Sussex, United Kingdom, 2006). Crossref, Google Scholar
10. M. A. Al-Betar, A. T. Khader and J. J. Thomas, A combination of metaheuristic components based on harmony search for the uncapacitated examination timetabling, Belfast, Northern Ireland Proc. 8th Int. Conf. Practice Theory Automat. Timetabling 08 (2010) 57–80. Google Scholar
11. A. Alexandridis, Evolving RBF neural networks for adaptive soft-sensor design, Int. J. Neural Syst. 23 (6) (2013) 1350029. Link, Web of Science, Google Scholar
12. F. Amini, N. Khanmohamadi Hazaveh and A. Abdolahi Rad, Wavelet PSO-based LQR algorithm for optimal structural control using active tuned mass dampers, Comput.-Aided Civ. Infrastruct. Eng. 28 (7) (2013) 542–557. Crossref, Web of Science, Google Scholar
13. C. Arango, P. Cortés, L. Onieva and A. Escudero, Simulation-optimisation models for the dynamic berth allocation problem, Comput.-Aided Civ. Infrastruct. Eng. 28 (10) (2013) 769–779. Crossref, Web of Science, Google Scholar
14. M. T. Ayvaz, Identification of groundwater parameter structure using harmony search algorithm, Music Inspired Harmony Search Algorithm: Theory and Applications, eds. Z. W. Geem (Springer-Verlag, Berlin Heidelberg, 2009), pp. 129–140. Crossref, Google Scholar
15. P. Ball, A sound theory?, Nature, doi: 10.1038/news.2008.883. Google Scholar
16. B. Borrell, Mosquitoes mate in perfect harmony, Nature (2009), doi: 10.1038/news.2009.1167. Crossref, Google Scholar
17. B. R. Campomanes-Álvareza, O. Cordón and S. Damasa, Evolutionary multi-objective optimization for mesh simplification of 3d open models, Integ. Comput.-Aided Eng. 20 (4) (2013) 375–390. Crossref, Web of Science, Google Scholar
18. J. Chen and T. Wu, A computational intelligence optimization algorithm: Cloud drops algorithm, Integr. Comput.-Aided Eng. 21 (2) (2014) 177–188. Crossref, Web of Science, Google Scholar
19. X. Chen, L. Zhang, X. He, C. Xiong and Z. Li, Surrogate-based optimization of expensive-to-evaluate objective for optimal highway toll charging in a large-scale transportation network, Comput.-Aided Civ. Infrastruct. Eng. 29 (5) (2014) 359–381. Crossref, Web of Science, Google Scholar
20. J. Y. J. Chow, Activity-based travel scenario analysis with routing problem reoptimization, Comput.-Aided Civ. Infrastruct. Eng. 29 (2) (2014) 91–106. Crossref, Web of Science, Google Scholar
21. L. S. Coelho and D. L. A. Bernert, An improved harmony search algorithm for synchronization of discrete-time chaotic systems, Chaos, Solitons Fractals 41 (2009) 2526–2532. Crossref, Web of Science, Google Scholar
22. S. Das, A. Mukhopadhyay, A. Roy, A. Abraham and B. K. Panigrahi, Exploratory power of the harmony search algorithm: Analysis and improvements for global numerical optimization, IEEE Trans. Syst., Man, Cybern. Cybern. 41 (1) (2011) 89–106. Crossref, Web of Science, Google Scholar
23. S. O. Degertekin, Improved harmony search algorithms for sizing optimisation of truss structures, Comput. Struct. 92–93 (2012) 229–241. Crossref, Web of Science, Google Scholar
24. H. Duan and J. Li, Gaussian harmony search: A novel method for loney’s solenoid problem, IEEE Trans. Magn. 50 (3) (2014) 7026405. Crossref, Web of Science, Google Scholar
25. R. Faturechi and E. Miller-Hooks, A mathematical framework for quantifying and optimizing protective actions for civil infrastructure systems, Comput.-Aided Civ. Infrastruct. Eng. 29 (8) (2014) 572–589. Crossref, Web of Science, Google Scholar
26. M. Fesanghary, M. Mahdavi, M. Minary-Jolandan and Y. Alizadeh, Hybridizing harmony search algorithm with sequential quadratic programming for engineering optimization problems, Comput. Methods Appli. Mech. Eng. 197 (40) (2008) 3080–3091 33. Crossref, Web of Science, Google Scholar
27. E. Forcael, V. González, F. Orozco, S. Vargas, P. Moscoso and A. Pantoja, Ant colony optimization model for tsunamis evacuation routes, Comput.-Aided Civ. Infrastruct. Eng. 29 (10) (2014) 723–737. Crossref, Web of Science, Google Scholar
28. H. Gao and X. Zhang, A Markov-based road maintenance optimization model considering user costs, Comput.-Aided Civ. Infrastruct. Eng. 28 (6) (2013) 451–464. Crossref, Web of Science, Google Scholar
29. Z. W. Geem, J. H. Kim and G. V. Loganathan, A new heuristic optimization algorithm: Harmony search, Simulation 76 (2) (2001) 60–68. Crossref, Google Scholar
30. Z. W. Geem, J. H. Kim and G. V. Loganathan, Harmony search optimisation: Application to pipe network design, Int. J. Model. Simulat. 22 (2) (2002) 125–133. Crossref, Google Scholar
31. Z. W. Geem, C. L. Tseng and Y. Park, Harmony search for generalized orienteering problem: Best touring in China, Advances in Natural Computation, eds. L. Wang, K. Chen and Y. Ong (Springer, Berlin, 2005), pp. 741–750. Crossref, Google Scholar
32. Z. W. Geem, K. S. Lee and Y. Park, Application of harmony search to vehicle routing, Am. J. Appl. Sci. 2 (12) (2005) 1552–1557. Crossref, Google Scholar
33. Z. W. Geem, Harmony search in water pump switching problem, Advances in Natural Computation, ICNC 2005 (2005) 751– 760. Google Scholar
34. Z. W. Geem, Optimal cost design of water distribution networks using harmony search, Eng. Optim. 38 (3) (2006) 259–280. Crossref, Web of Science, Google Scholar
35. Z. Geem, Improved harmony search from ensemble of music players, Knowledge-based Intelligent Information and Engineering Systems Lecture Notes on Artificial Intelligence, eds. B. Gabrys, R. J. Howlett and L. Jain (Springer, Heidelberg, 2006), pp. 86–93. Crossref, Google Scholar
36. Z. W. Geem and J. Choi, Music composition using harmony search algorithm, Evo Workshops 2007 (2007) 593–600. Google Scholar
37. Z. W. Geem, Novel derivative of harmony search algorithm for discrete design variables, Appl. Math. Comput. 199 (1) (2008) 223–230. Crossref, Web of Science, Google Scholar
38. Z. W. Geem, Effects of initial memory and identical harmony in global optimization using harmony search algorithm, Appl. Math. Comput. 218 (2012) 11337–11343. Crossref, Web of Science, Google Scholar
39. F. Hejazi, I. Toloue, J. Noorzaei and M. S. Jaafar, Optimization of earthquake energy dissipation system by genetic algorithm, Comput.-Aided Civ. Infrastruct. Eng. 28 (10) (2013) 796–810. Crossref, Web of Science, Google Scholar
40. J. H. Holland, Adaptation in natural and artificial systems (University Michigan Press, Ann Arbour, 1975). Google Scholar
41. W. Y. Hsu, Application of quantum-behaved particle swarm optimization to motor imagery eeg classification, Int. J. Neural Syst. 23 (6) (2013) 1350026. Link, Web of Science, Google Scholar
42. G. Iacca, F. Caraffini and F. Neri, Multi-strategy coevolving aging particle optimization, Int. J. Neural Syst. 24 (1) (2014) 1450008. Link, Web of Science, Google Scholar
43. L. Jia, Y. Wang and L. Fan, Multiobjective bilevel optimization for production-distribution planning problems using hybrid genetic algorithm, Integr. Comput.-Aided Eng. 21 (1) (2014) 77–90. Crossref, Web of Science, Google Scholar
44. M. M. Joly, T. Verstraete and G. Paniagua, Integrated multifidelity, multidisciplinary evolutionary design optimization of counter rotating compressors, Integr. Comput.-Aided Eng. 21 (3) (2014) 249–261. Crossref, Web of Science, Google Scholar
45. J. H. Kim, Z. W. Geem and E. S. Kim, Parameter estimation of the nonlinear Muskingum model using harmony search, J. Am. Water Resourc. Assoc. 37 (5) (2001) 1131–1138. Crossref, Web of Science, Google Scholar
46. M. Kociecki and H. Adeli, Two-phase genetic algorithm for size optimization of free-form steel space-frame roof structures, J. Construct. Steel Res. 90 (2013) 283–296. Crossref, Web of Science, Google Scholar
47. M. Kociecki and H. Adeli, Two-phase genetic algorithm for topology optimization of free-form steel space-frame roof structures with complex curvatures, Eng. Appl. Artif. Intell. 32 (2014) 218–227. Crossref, Web of Science, Google Scholar
48. M. Kociecki and H. Adeli, Shape optimization of free-form steel space-frame roof structures with complex geometries using evolutionary computing, Eng. Appl. Artificial Intell. 38 (2015) 168–182. Crossref, Web of Science, Google Scholar
49. C. L. Krumhansl, Cognitive Foundations of Musical Pitch (Oxford University Press, 1990). Google Scholar
50. K. S. Lee and Z. W. Geem, A new structural optimization method based on the harmony search algorithm, Comput. Struct. 82 (9–10) (2004) 781–798. Crossref, Web of Science, Google Scholar
51. K. S. Lee and Z. W. Geem, A new meta-heuristic algorithm for continuous engineering optimization: Harmony search theory and practice, Comput. Methods Appl. Mech. Eng. 194 (38) (2005) 3902–3933 36. Crossref, Web of Science, Google Scholar
52. J. Li and H. Duan, Novel biological visual attention mechanism via gaussian harmony search, Optik 125 (2014) 2313–2319. Crossref, Web of Science, Google Scholar
53. H. Li, W. Yi and X. Yuan, Fuzzy-valued intensity measures for near-fault ground motions, Comput.-Aided Civ. Infrastruct. Eng. 28 (10) (2013) 780–795. Crossref, Web of Science, Google Scholar
54. D. Y. Lin and Y. H. Ku, Using genetic algorithms to optimize stopping patterns for passenger rail transportation, Comput.-Aided Civ. Infrastruct. Eng. 29 (4) (2014) 264–278. Crossref, Web of Science, Google Scholar
55. J. M. Luna, J. R. Romero, C. Romero and S. Ventura, Reducing gaps in quantitative association rules: A genetic programming free-parameter algorithm, Integr. Comput.-Aided Eng. 21 (4) (2014) 321–337. Crossref, Web of Science, Google Scholar
56. D. Luo, Z. Ibrahim, B. Xu and Z. Ismail, Optimization the geometries of biconical tapered fiber sensors for monitoring the early-age curing temperatures of concrete specimens, Comput.-Aided Civ. Infrastruct. Eng. 28 (7) (2013) 531–541. Crossref, Web of Science, Google Scholar
57. M. Mahdavi, M. Fesanghary and E. Damangir, An improved harmony search algorithm for solving optimization problems, Appl. Math. Comput. 188 (2) (2007) 1567–1579. Crossref, Web of Science, Google Scholar
58. H. Menendez, D. F. Barrero and D. Camacho, A genetic graph-based approach to the partitional clustering, Int. J. Neural Syst. 24 (3) (2014) 1430008. Link, Web of Science, Google Scholar
59. M. Molina-García, J. Calle-Sánchez, C. González-Merino, A. Fernández-Durán and J. I. Alonso, Design of in-building wireless networks deployments using evolutionary algorithms, Integr. Comput.-Aided Eng. 21 (4) (2014) 367–385. Crossref, Web of Science, Google Scholar
60. I. Montalvo, J. Izquierdo, M. Herrera and R. Pérez-García, Water distribution system computer-aided design by agent swarm optimization, Comput.-Aided Civ. Infrastruct. Eng. 29 (6) (2014) 433–448. Crossref, Web of Science, Google Scholar
61. B. Nettl, Thoughts on improvisation: A comparative approach, Musical Q. 60 (1) (1974) 1–19. Crossref, Google Scholar
62. M. Omran and M. Mahdavi, Global-best harmony search, Appl. Math. Comput. 198 (2008) 643–656. Crossref, Web of Science, Google Scholar
63. A. Panchal, Harmony search in therapeutic medical physics, Music Inspired Harmony Search Algorithm: Theory and Applications, eds. Z. W. Geem (Springer-Verlag, Berlin Heidelberg, 2009), pp. 189–204. Crossref, Google Scholar
64. R. Parncutt, Harmony: A Psycho-acoustical Approach (Springer-Verlag, New York, 1989). Crossref, Google Scholar
65. F. Peng and Y. Ouyang, Optimal clustering of railroad track maintenance jobs, Comput.-Aided Civ. Infrastruct. Eng. 29 (4) (2014) 235–247. Crossref, Web of Science, Google Scholar
66. O. Reyes, C. Morell and S. Ventura, Evolutionary feature weighting to improve the performance of multi-label lazy algorithms, Integr. Comput.-Aided Eng. 21 (4) (2014) 339–354. Crossref, Web of Science, Google Scholar
67. J. Ricart, G. Huttemann, J. Lima and B. Baran, Multiobjective harmony search algorithm proposals, Electron. Notes Theor. Comput. Sci. 281 (2011) 51–67. Crossref, Google Scholar
68. M. P. Saka, Optimum design of steel sway frames to BS5950 using harmony search algorithm, J. Construct. Steel Res. 65 (1) (2009) 36–43. Crossref, Web of Science, Google Scholar
69. Y. Shafahi and M. Bagherian, A customized particle swarm method to solve highway alignment optimization problem, Comput.-Aided Civ. Infrastruct. Eng. 28 (1) (2013) 52–67. Crossref, Web of Science, Google Scholar
70. R. Smith, E. Ferrebee, Y. Ouyang and J. Roesler, Optimal staging area locations and material recycling strategies for sustainable highway reconstruction, Comput.-Aided Civ. Infrastruct. Eng. 29 (8) (2014) 559–571. Crossref, Web of Science, Google Scholar
71. W. Y. Szeto, Y. Wang and S. C. Wong, The chemical reaction optimization approach to solving the environmentally sustainable network design problem, Comput.-Aided Civ. Infrastruct. Eng. 29 (2) (2014) 140–158. Crossref, Web of Science, Google Scholar
72. N. Siddique and H. Adeli, Computational Intelligence - Synergies of Fuzzy Logic, Neural Networks and Evolutionary Computing (Wiley, West Sussex, United Kingdom, 2013). Crossref, Google Scholar
73. N. Siddique and H. Adeli, Hybrid harmony search algorithm, Int. J. Artif. Intell. Tools 24(6) (2015), in process. Google Scholar
74. C. M. Wang and Y. F. Huang, Self-adaptive harmony search algorithm for optimization, Expert Syst. Appl. 37 (4) (2010) 2826–2837. Crossref, Web of Science, Google Scholar
75. J. W. Wu, J. C. R. Tseng and W. N. Tsai, A hybrid linear text segmentation algorithm using hierarchical agglomerative clustering and discrete particle swarm optimization, Integr. Comput.-Aided Eng. 21 (1) (2014) 35–46. Crossref, Web of Science, Google Scholar
76. W.-L. Xiang, M.-Q. An, Y.-Z. Li, R.-C. He and J.-F. Zhang, An improved global-best harmony search algorithm for faster optimization, Expert Syst. Appl. 41 (2014) 5788–5803. Crossref, Web of Science, Google Scholar
77. X. S. Yang, Harmony search as a metaheuristic algorithm, in Music Inspired Harmony Search Algorithm: Theory and Applications, ed. Z. W. Geem (Springer-Verlag, Berlin Heidelberg, 2009), pp. 1–14. Google Scholar
78. H. Xu, X. Z. Gao, T. Wang and K. Xue, Harmony search optimization algorithm: application to a reconfigurable mobile robot prototype, Recent Advances in Harmony Search Algorithm Studies in Computational Intelligence, pp. 11–22. Google Scholar
79. Z. Zeng, J. Xu, S. Wu and M. Shen, Antithetic method-based particle swarm optimization for a queuing network problem with fuzzy data in concrete transportation systems, Comput.-Aided Civ. Infrastruct. Eng. 29 (10) (2014) 771–800. Crossref, Web of Science, Google Scholar
80. G. Zhang and Y. Wang, Optimizing coordinated ramp metering – A preemptive hierarchical control approach, Comput.-Aided Civ. Infrastruct. Eng. 28 (1) (2013) 22–37. Crossref, Web of Science, Google Scholar
81. G. Zhang, H. Rong, F. Neri and M. J. Perez-Jimenez, An optimization spiking neural P system for approximately solving combinatorial optimization problems, Int. J. Neural Syst. 24 (5) (2014) 1440006. Link, Web of Science, Google Scholar