Design of Hybrid Differential Evolution and Group Method of Data Handling for Inductive Modeling, Godfrey C. Onwubolu, IWIM, Prague, 2007.

 Article (in pdf)

Abstract. The Group method of data handling (GMDH) and differential evolution (DE) population-based lgorithm are two well-known nonlinear methods of mathematical modeling. In this paper, both methods are explained and a new design methodology which is a hybrid of GMDH and DE is proposed. The proposed method constructs a GMDH network model of a population of promising DE solutions. The new hybrid implementation is then applied to modeling and prediction of practical datasets and its results are compared with the results obtained by GMDH-related algorithms. Results presented show that the proposed algorithm appears to perform reasonably well and hence can be applied to real-life prediction and modeling problems.

Keywords. Inductive modeling, GMDH, DE, complex systems

References.

1. Ivakhnenko A. G., 1968. The Group Method of Data Handling - A rival of the Method of Stochastic Approximation. Soviet Automatic Control, vol 13 c/c of avtomatika, 1, 3, 43-55.
2. Ivakhnenko, A. G., 1971. Polynomial theory of complex systems, IEEE Trans. on Systems, Man and Cybernetics, vol. SMC-1, pp. 364-378.
3. Ivakhnenko, A. G., Ivakhnenko, G. A. and Muller, J.A. 1994. Self-organization of neural networks with active neurons, Pattern Recognition and Image Analysis, vol. 4, no. 2, pp. 185-196.
4. Ivakhnenko, A. G. and Ivakhnenko, G. A. 1995. The review of problems solvable by algorithms of the group method of data handling (GMDH), Pattern Recognition and Image Analysis, vol. 5, no. 4, pp. 527-535.
5. Farlow, S. J. (ed.) 1984: Self-organizing Methods in Modeling. GMDH Type Algorithms. Marcel Dekker. New York, Basel
6. Madala, H.R.; Ivakhnenko, A.G. 1994: Inductive Learning Algorithms for Complex Systems Modeling. CRC Press Inc., Boca Raton, Ann Arbor, London, Tokyo
7. Mueller, J-A., and Lemke, F.: Self-Organizing Data Mining: An Intelligent Approach to Extract Knowledge From Data, Dresden, Berlin, 1999.
8. Robinson, C. 1998. Multi-objective optimization of polynomial models for time series prediction using genetic algorithms and neural networks, PhD Thesis in the Department of Automatic Control & Systems Engineering, University of Sheffield, UK.
9. Hiassat M., Abbod M., and Mort N. 2003. Using Genetic Programming to Improve the GMDH in Time Series Prediction, Statistical Data Mining and Knowledge Discovery, edited by Hamparsum Bozdogan. Chapman & Hall CRC, pp257-268.
10. Iba, H., de Garis, H., Sato, T., Genetic programming using a minimum description length principle, In Advances in Genetic Programming, Kinnear, K. E. Jr (ed), Cambridge: MIT, 1994, pp 265-284.
11. Park, H.-S., Park, B.-J., Kim, H, -K., and Oh, S.-K. 2004. Self-organizing polynomial neural networks based on genetically optimized multi-layer perceptron architecture, International Journal of Control, Automation, and Systems, 2(4), pp. 423-434.
12. Oh, S.-K., Park, B.-J., and Kim, H.-K, Genetically optimized hybrid fuzzy neural networks based on linear fuzzy inference rules, International Journal of Control, Automation, and Systems, 3(2), pp. 183-194, 2005.
13. Press, W. H., Teukolsky, S A, Vetterling, W. T. and Flannery, B. P. 1992. “Numerical recipes in C: The art of scientific computing”. Cambridge University Press.
14. Nariman-Zadeh, N., Darvizeh, A., and Ahmad-Zadeh, G. R., Hybrid genetic design of GMDH-type neural networks using singular value decomposition for modeling and predicting of the explosive cutting process, Nariman-Zadeh, Proc. Instn Mech. Engrs Vol 217 Part B: Nariman-Zadeh, 779-790.
15. Storn, R. and Price, K., 1995, Differential evolution - a simple and efficient adaptive scheme for global optimization over continuous spaces, Technical Report TR-95-012, ICSI, March 1999 (Available via ftp from ftp.icsi.berkeley.edu/pub/techreports/1995/tr-95-012.ps.Z).
16. Storn, R. M. and Price, K. V., 1997, Differential evolution – a simple evolution strategy for fast optimization. Dr. Dobb's Journal, April 1997, 18–24 and 78.
17. Price, K. V, 1999, An introduction to differential evolution. New Ideas in Optimization, (Eds.) Corne, D., Dorigo, M., and Glover, McGraw? Hill, International (UK), 79-108.
18. Storn, R. M., 1999, Designing digital filters with differential evolution, New Ideas in Optimization, (Eds.) Corne, D., Dorigo, M., and Glover, McGraw? Hill, International (UK), 109-125.
19. Price, K. V., and Storn, R. M., 2001, Differential evolution homepage (Web site of Price and Storm) as at 2001.  http://www.ICSI.Berkeley.edu/~storn/code.html
20. Price, K. V., Storn, R. M, 2006, and Lampinene, J. A., Differential Evolution: A Practical Approach to Global Optimization, Springer-Verlag, Berlin 2005.
21. Onwubolu, G. C., 2001, Optimization using differential evolution, Institute of Applied Science Technical Report, TR-2001/05.
22. Davendra, D., Hybrid Differential Evolution and Scatter Search, MSc Thesis, The University of the South Pacific, 2003.
23. Onwubolu, G. C., and Davendra, D., Scheduling flow shops using differential evolution algorithm, European Journal of Operational Research, 171, 674-692, 2006.
24. Davendra, D., and Onwubolu, G. C., Scheduling flow shops using enhanced differential evolution algorithm, European Conference on Modeling and Simulation (ECMS), Prague, Czech, 2007.
25. Kim, D., and Park, G.-T, GMDH-type neural network modeling in evolutionary optimization, Lecture Notes in Computer Science, Springer, Berlin, 3533, pp. 563-570, 2005.
26. Oh, S.-K and Pedrycz, W., Identification of fuzzy systems by means of an auto-tuning algorithm and its application to nonlinear systems, Fuzzy Sets and Systems, 115(2), pp. 205-230, 2000.
27. Park, H.-S., Park, B.-J., Kim, H, -K., and Oh, S.-K. 2004. Self-organizing polynomial neural networks based on genetically optimized multi-layer perceptron architecture, International Journal of Control, Automation, and Systems, 2(4), pp. 423-434.
28. Buryan, P., and Onwubolu, G. C., 2007, Design of Enhanced MIA-GMDH Learning Networks, (submitted)