The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Binary Border Collie Optimization Algorithm for Feature Selection

Salah Mortada,

Effective performance enhancement and feature reduction can be achieved by feature selection, which is the procedure of evaluating and choosing the most informative features. Consequently, this paper proposes a Binary Border Collie Optimization (BBCO) to address the feature selection problem in classification tasks. The sigmoidal function is used in the proposed algorithm to compress the continually updated position in order to achieve BBCO. Therefore, the proposed algorithm is utilized to determine the ideal feature subset from the initial feature set. To assess the performance of the proposed algorithm, BBCO is compared with Binary Firefly Algorithm (BFA), Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Binary Gray Wolf Optimization (BGWO). The experiments on eighteen datasets collected from University of California Irvine (UCI) machine learning data repository results show the superiority of BBCO in 15 datasets, which means 83.3% in terms of classification accuracy with a reduced features number being chosen. Furthermore, BBCO has a very low average selected feature ratio, it is more beneficial for applications in the actual world.

 

[1] Al-Behadili H., “Improved Firefly Algorithm with Variable Neighborhood Search for Data Clustering,” Baghdad Science Journal, vol. 19, no. 2, pp. 409-421, 2022. DOI: 10.21123/BSJ.2022.19.2.0409

[2] Al-Behadili H., “Stochastic Local Search Algorithms for Feature Selection: A Review,” Iraqi Journal for Electrical and Electronic Engineering, vol. 17, no. 1, pp. 1-10, 2021. DOI: 10.37917/ijeee.17.1.1

[3] AL-Behadili H., Mahamud K., and Sagban R., “Hybrid Ant Colony Optimization and Genetic Algorithm for Rule Induction,” Journal of Computer Science, vol. 16, no. 7, pp. 1019-1028, 2020. DOI: 10.3844/JCSSP.2020.1019.1028

[4] Almazini H. and Mahamud K., “Adaptive Technique for Feature Selection in Modified Graph Clustering-Based Ant Colony Optimization,” International Journal of Intelligent Engineering and System, vol. 14, no. 3, pp. 332-345, 2021. DOI: 10.22266/ijies2021.0630.28

[5] Almazini H. and Mahamud K., “Grey Wolf Optimization Parameter Control for Feature Selection in Anomaly Detection,” International Journal of Intelligent Engineering and Systems, vol. 14, no. 2, pp. 474-483, 2021. DOI: 10.22266/ijies2021.0430.43

[6] Al-shalabi L., “Feature Selection Method Based on Consecutive Forward Selection and Backward Elimination Concepts Using a Weighted Vector,” The International Arab Journal of Information Technology, vol. 22, no. 4, pp. 801-813, 2025. DOI: 10.34028/iajit/22/4/13

[7] Babatunde O., Armstrong L., Leng J., and Diepeveen D., “A Genetic Algorithm-Based Feature Selection,” International Journal of Electronics Communication and Computer Engineering, vol. 5, no. 4, pp. 899-905, 2014. file:///C:/Users/acit2k/Downloads/Publication2.p df

[8] Bache M. and Lichman K., UCI Machine Learning Repository, https://archive.ics.uci.edu/ml/index.php, Last Visited, 2025.

[9] Banati H. and Bajaj M., “Fire Fly Based Feature Selection Approach,” International Journal of Computer Science Issues, vol. 8, no. 4, pp. 473- 479, 2011. https://www.researchgate.net/publication/235323 871_Fire_Fly_Based_Feature_Selection_Approa ch

[10] Dutta T., Bhattacharyya S., Dey S., and Platos J., “Border Collie Optimization,” IEEE Access, vol. 8, pp. 109177-109197, 2020. DOI: 10.1109/ACCESS.2020.2999540

[11] Emary E., Zawbaa H., and Hassanien A., “Binary Grey Wolf Optimization Approaches for Feature Selection,” Neurocomputing, vol. 172, pp. 371- 381, 2016. DOI: 10.1016/j.neucom.2015.06.083

[12] Emary E., Zawbaa H., Grosan C., and Hassenian A., Afro-European Conference for Industrial Advancement, Advances in Intelligent Systems and Computing, Springer, 2015. DOI: 10.1007/978-3- 319-13572-4_1

[13] Firpi H. and Goodman E., “Swarmed Feature Selection,” in Proceedings of the 33rd Applied Imagery Pattern Recognition Workshop, Washington (DC), pp. 112-118, 2004. DOI: 10.1109/AIPR.2004.41

[14] Huang J., Cai Y., and Xu X., “A Hybrid Genetic Algorithm for Feature Selection Wrapper Based on Mutual Information,” Pattern Recognition Letters, vol. 28, no. 13, pp. 1825-1844, 2007. DOI: 10.1016/j.patrec.2007.05.011

[15] Kennedy J. and Eberhart R., “Discrete Binary Version of the Particle Swarm Algorithm,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Orlando, pp. 4104-4108, 1997. DOI: 10.1109/icsmc.1997.637339

[16] Mahamud K. and Almazini H., “Heuristic Initialization Using Grey Wolf Optimizer Algorithm for Feature Selection in Intrusion Detection,” International Journal of Intelligent Engineering and System, vol. 16, no. 1, pp. 410- 418, 2023. DOI: 10.22266/ijies2023.0228.36

[17] Mortada S. and Yusof Y., “An Improved Artificial Bee Colony with Perturbation Operators in Scout Bees’ Phase for Solving Vehicle Routing Problem with Time Windows,” IAES International Journal of Artificial Intelligence, vol. 12, no. 2, pp. 656- 666, 2023. DOI: 10.11591/ijai.v12.i2.pp656-666

[18] Nakamura R., Pereira L., Costa K., Rodrigues D., and et al., “BBA: A Binary Bat Algorithm for Feature Selection,” in Proceedings of the 25th SIBGRAPI Conference on Graphics, Patterns and Images, Ouro Preto, pp. 291-297, 2012. DOI: 10.1109/SIBGRAPI.2012.47

[19] Ramos C., Souza A., Chiachia G., Falcao A., and Papa J., “A Novel Algorithm for Feature Selection Using Harmony Search and its Application for Non-Technical Losses Detection,” Computers Electrecal Engineering, vol. 37, no. 6, pp. 886- 894, 2011. DOI: 10.1016/j.compeleceng.2011.09.013

[20] Rashedi E., Nezamabadi-Pour H., and Saryazdi S., “BGSA: Binary Gravitational Search Algorithm,” Natural Computing, vol. 9, no. 3, pp. 727-745, 2010. DOI: 10.1007/s11047-009-9175-3

[21] Shunmugapriya P. and Kanmani S., “A Hybrid Algorithm Using Ant and Bee Colony Optimization for Feature Selection and Classification (AC-ABC Hybrid),” Swarm and Binary Border Collie Optimization Algorithm for Feature Selection 57 Evolutionary Computation, vol. 36, pp. 27-36, 2017. DOI: 10.1016/j.swevo.2017.04.002

[22] Too J., Abdullah A., and Saad N., “A New Quadratic Binary Harris Hawk Optimization for Feature Selection,” Electron, vol. 8, no. 10, pp. 1- 27, 2019. DOI: 10.3390/electronics8101130

[23] Yang L., Li K., Zhang W., Wang Y., and Ke Z., “Application of a New mAnt-MinerPR Algorithm in Classification Rule Mining,” Journal of Digital Information Management, vol. 13, no. 5, pp. 311- 320, 2015. https://dline.info/fpaper/jdim/v13i5/v13i5_1.pdf

[24] ZorarpacI E. and Ozel S., “A Hybrid Approach of Differential Evolution and Artificial Bee Colony for Feature Selection,” Expert Systems with Applications, vol. 62, no. C, pp. 91-103, 2016. DOI: 10.1016/j.eswa.2016.06.004