Implementation of Evolution Strategies for Classifier Model Optimization

Mahmud Dwi Sulistiyo, Rita Rismala

Abstract


Classification becomes one of the classic problems that are often encountered in the field of artificial intelligence and data mining. The problem in classification is how to build a classifier model through training or learning process. Process in building the classifier model can be seen as an optimization problem. Therefore, optimization algorithms can be used as an alternative way to generate the classifier models. In this study, the process of learning is done by utilizing one of Evolutionary Algorithms (EAs), namely Evolution Strategies (ES). Observation and analysis conducted on several parameters that influence the ES, as well as how far the general classifier model used in this study solve the problem. The experiments and analyze results show that ES is pretty good in optimizing the linear classification model used. For Fisher’s Iris dataset, as the easiest to be classified, the test accuracy is best achieved by 94.4%; KK Selection dataset is 84%; and for SMK Major Election datasets which is the hardest to be classified reach only 49.2%.

Full Text:

PDF

References


Bäck, T., & Schwefel, H. P. (1993). An Overview of Evolutionary Algorithms for Parameter Optimization. Evolutionary Computation, 1(1), 1-23. Crossref

Dianati, M., Song, I., & Treiber, M. (2002). An Introduction to Genetic Algorithms and Evolution Strategies. Technical report, University of Waterloo, Ontario, N2L 3G1, Canada.

Eiben, A. E., & Smith, J. E. (2003). Introduction to Evolutionary Computing. Springer Science & Business Media. Crossref

Go, A., Bhayani, R., & Huang, L. (2009). Twitter Sentiment Classification Using Distant Supervision. CS224N Project Report, Stanford, 1, 12.

Gottlieb, J., Marchiori, E., & Rossi, C. (2002). Evolutionary Algorithms for the Satisfiability Problem. Evolutionary Computation, 10(1), 35-50. Crossref

Greenwood, G. W., Gupta, A. K., & McSweeney, K. (1994, June). Scheduling Tasks in Multiprocessor Systems Using Evolutionary Strategies. In International Conference on Evolutionary Computation (pp. 345-349). Crossref

Hermawati, Fajar Astuti. (2013). Data Mining. Penerbit Andi.

Jones, G. (1998). Genetic and Evolutionary Algorithms. Encyclopedia of Computational Chemistry.

Louchet, J. (2000). Stereo Analysis Using Individual Evolution Strategy. In Pattern Recognition, 2000. Proceedings. 15th International Conference on (Vol. 1, pp. 908-911). IEEE. Crossref

Muhammad, L., Dayawati, R. N., & Rismala, R. (2014). Brain Tumor Detection and Classification In Magnetic Resonance Imaging (MRI) using Region Growing, Fuzzy Symmetric Measure, and Artificial Neural Network and Connected Component Labeling. International Journal on Information and Communication Technology| IJoICT, 1(1).

Nguyen, Danh V., and David M. Rocke. "Tumor classification by partial least squares using microarray gene expression data." Bioinformatics 18.1 (2002): 39-50. Crossref

Oliveto, P. S., He, J., & Yao, X. (2007, September). Evolutionary Algorithms and the Vertex Cover Problem. In Evolutionary Computation, 2007. CEC 2007. IEEE Congress on (pp. 1870-1877). IEEE. Crossref

Ostertag, M., & Kiencke, U. (1995, September). Optimization of Airbag Release Algorithms Using Evolutionary Strategies. In Control Applications, 1995., Proceedings of the 4th IEEE Conference on (pp. 275-280). IEEE. Crossref

Pennacchiotti, M., & Popescu, A. M. (2011). A Machine Learning Approach to Twitter User Classification. ICWSM, 11, 281-288.

Ragab, A. H. M., Noaman, A. Y., Al-Ghamdi, A. S., & Madbouly, A. I. (2014, June). A Comparative Analysis of Classification Algorithms for Students College Enrollment Approval Using Data Mining. In Proceedings of the 2014 Workshop on Interaction Design in Educational Environments (p. 106). ACM. Crossref

Rismala, R. (2015). Prediksi Time Series Tingkat Inflasi Indonesia Menggunakan Evolution Strategies. Jurnal Ilmiah Teknologi Informasi Terapan, 1(2).

Sulistiyo, Mahmud Dwi, Dayawati, R. N., Nurlasmaya. (2013, November). Evolution Strategies for Weight Optimization of Artificial Neural Network in Time Series Prediction. In Robotics, Biomimetics, and Intelligent Computational Systems (ROBIONETICS), 2013 IEEE International Conference on (pp. 143-147). IEEE.

Suyanto, ST., MSc. (2008). Evolutionary Computation: Komputasi Berbasis “Evolusi” dan “Genetika”. Informatika.

Tsai, H. K., Yang, J. M., Tsai, Y. F., & Kao, C. Y. (2004). An Evolutionary Algorithm for Large Traveling Salesman Problems. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 34(4), 1718-1729. Crossref




DOI: http://dx.doi.org/10.21108/INDOJC.2016.1.2.43

Refbacks

  • There are currently no refbacks.


Copyright (c) 2016 Indonesia Journal on Computing (Indo-JC)

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.