The International Arab Journal of Information Technology (IAJIT)

..............................
..............................
..............................


Automated Excavator Activity Diagnosis Via a Topology and Statistical Information Based Classifier

For automated diagnosis of excavator activities, a Topology and Statistical Information based Classifier (TSIC) is put forward, and it employs topology and statistical information of excavator activity samples. Specifically, a small sensor network is built on the excavator for its activity data acquisition. Distance metric learning is improved to explore sample features, making the same-class samples closer and different-class ones further. An improved mountain function is employed to construct covers for topology feature extraction, and then a weighted linear classifier is designed to diagnose (or classify) excavator activities. Generalization performance of TSIC is discussed. Experiments on excavator construction datasets and public datasets demonstrate competitive performance of TSIC.

[1] Akhavian R. and Behzadan A., “An Integrated Data Collection and Analysis Framework for Remote Monitoring and Planning of Construction Operations,” Advanced Engineering Informatics, vol. 26, no. 4, pp. 749-761, 2012. https://doi.org/10.1016/j.aei.2012.04.004

[2] Akhavian R. and Behzadan A., “Construction Equipment Activity Recognition for Simulation Input Modeling Using Mobile Sensors and Machine Learning Classifiers,” Advanced Engineering Informatics, vol. 29, pp. 867-877, 2015. https://doi.org/10.1016/j.aei.2015.03.001

[3] Alawneh H. and Hasasneh A., “Survival Prediction of Children After Bone Marrow Transplant Using Machine Learning Algorithms,” The International Arab Journal of Information Technology, vol. 21, no. 3, pp. 394-407, 2024.

[4] Bae J., Kim K., and Hong D., “Automatic Identification of Excavator Activities Using Joystick Signals,” International Journal of Precision Engineering and Manufacturing, vol. 20, no. 3, pp. 2101-2107, 2019. https://doi.org/10.1007/s12541-019-00219-5

[5] Chen C., Zhu Z., and Hammad A., “Automated Excavators Activity Recognition and Productivity Analysis from Construction Site Surveillance Video,” Automation in Construction, vol. 110, pp. 103045, 2020. https://doi.org/10.1016/j.autcon.2019.103045

[6] Cheng C., Rashidi A., Davenport M., and Anderson D., “Activity Analysis of Construction Equipment Using Audio Signals and Support Vector Machines,” Automation in Construction, vol. 81, pp. 240-253, 2017. https://doi.org/10.1016/j.autcon.2017.06.005

[7] Dua D. and Graff C., UCI Machine Learning Repository, CA: University of California, School of Information and Computer Science, 2019. C 740 The International Arab Journal of Information Technology, Vol. 22, No. 4, July 2025 http://archive.ics.uci.edu/ml

[8] Gaikwad S., Gawali W., and Yannawar P., “A Review on Speech Recognition Technique,” International Journal of Computer Applications, vol. 10, no. 3, pp. 16-24, 2010. DOI:10.5120/1462-1976

[9] Ganaie M., Tanveer M., and Lin C., “Large-Scale Fuzzy Least Squares Twin SVMs for Class Imbalance Learning,” IEEE Transactions on Fuzzy Systems, vol. 30, no. 11, pp. 4815-4827, 2022. DOI:10.1109/TFUZZ.2022.3161729

[10] Ghelmani A. and Hammad A., “Improving Single- Stage Activity Recognition of Excavators Using Knowledge Distillation of Temporal Gradient Data,” Computer-Aided Civil and Infrastructure Engineering, vol. 39, no. 13, pp. 2028-2053, 2024. DOI: 10.1111/mice.13157

[11] Ghelmani A., Torabi G., Hammad A., and Chen C., “Single-Stage Spatiotemporal Activity Recognition of Excavators: A Case Study,” in Proceedings of the 41st International Symposium on Automation and Robotics in Construction, Lille, pp. 800-807, 2024. https://www.iaarc.org/publications/fulltext/103_I SARC_2024_Paper_181.pdf

[12] Golparvar-Fard M., Heydarian A., and Niebles J., “Vision-Based Action Recognition of Earthmoving Equipment Using Spatio-Temporal Features and Support Vector Machine Classifiers,” Advanced Engineering Informatics, vol. 27, no. 4, pp. 652-663, 2013. https://doi.org/10.1016/j.aei.2013.09.001

[13] Gong J., Caldas C., and Gordon C., “Learning and Classifying Actions of Construction Workers and Equipment Using Bag-of-Video-Feature-Words and Bayesian Network Models,” Advanced Engineering Informatics, vol. 25, no. 4, pp. 771- 782, 2011. https://doi.org/10.1016/j.aei.2011.06.002

[14] Harichandran A., Raphael B., and Mukherjee A., “Equipment Activity Recognition and Early Fault Detection in Automated Construction through a Hybrid Machine Learning Framework,” Computer-Aided Civil and Infrastructure Engineering, vol. 38, pp. 253-268, 2023. https://doi.org/10.1111/mice.12848

[15] Huang C., Zhou J., Chen J., Yang J., Clawson K., and Peng Y., “A Feature Weighted Support Vector Machine and Artificial Neural Network Algorithm for Academic Course Performance Prediction,” Neural Computing and Applications, vol. 35, pp. 11517-11529, 2023. https://doi.org/10.1007/ s00521-021-05962-3

[16] Huang G., Zhou H., Ding X., and Zhang R., “Extreme Learning Machine for Regression and Multiclass Classification,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 42, no. 2, pp. 513-529, 2012. DOI:10.1109/TSMCB.2011.2168604

[17] Jain M., Kaur G., and Saxena V., “A K-Means Clustering and SVM based Hybrid Concept Drift Detection Technique for Network Anomaly Detection,” Expert Systems with Applications, vol. 193, pp. 116510, 2022. https://doi.org/10.1016/j.eswa.2022.116510

[18] Kim D., Lee K., Lee D., and Lee K., “A Kernel- Based Subtractive Clustering Method,” Pattern Recognition Letters, vol. 26, no. 7, pp. 879-891, 2005. https://doi.org/10.1016/j.patrec.2004.10.001

[19] Kim I., Latif K., Kim J., Sharafat A., and Lee D., “Vision-Based Activity Classification of Excavators by Bidirectional LSTM,” Applied Science, vol. 13, no. 1, pp. 1-19, 2023. https://doi.org/10.3390/app13010272

[20] Kim J., Kim D., Shah J., and Lee S., “Synthetic Training Image Dataset for Vision-Based 3D Pose Estimation of Construction Workers,” in Proceedings of the Construction Research Congress, Arlington, pp. 254-262, 2022. https://ascelibrary.org/doi/full/10.1061/97807844 83961.027

[21] Kingma D. and Ba J., “Adam: A Method for Stochastic Optimization,” in Proceedings of the International Conference on Learning Representations, Banff, pp. 1-1, 2014. https://api.semanticscholar.org/CorpusID:662810 6

[22] Langroodi A., Vahdatikhaki F., and Doree A., “Activity Recognition of Construction Equipment Using Fractional Random Forest,” Automation in Construction, vol. 122, pp. 103465, 2021. https://doi.org/10.1016/j.autcon.2020.103465

[23] Lee J., Kim B., Sun D., Han C., and Ahn Y., “Development of Unmanned Excavator Vehicle System for Performing Dangerous Construction Work,” Sensors, vol. 19, no. 22, pp. 1-17, 2019. https://doi.org/10.3390/s19224853

[24] Li X., Zhang Y., Yu Y., Wang W., and Zhao Z., “Filtering and Denoising of Rock Blasting Vibration Signal with EMD,” Journal of Central South University, vol. 37, no. 1, pp. 150-154, 2006. https://doi.org/10.1038/s41598-023-47755- 9

[25] Liang N., Huang G., Saratchandran P., and Sundararajan N., “A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks,” IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411-1423, 2006. DOI:10.1109/TNN.2006.880583

[26] Man Z., Lee K., Wang D., Cao Z., and Khoo S., “Robust Single-Hidden Layer Feedforward Network-Based Pattern Classifier,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 12, pp. 1974-1986, 2012. DOI:10.1109/TNNLS.2012.2218616 Automated Excavator Activity Diagnosis Via a Topology and Statistical Information ... 741

[27] Man Z., Lee K., Wang D., Cao Z., and Miao., “A New Robust Training Algorithm for a Class of Single Hidden Layer Neural Networks,” Neurocomputing, vol. 74, no. 16, pp. 2491-2501, 2011. https://doi.org/10.1016/j.neucom.2010.11.033

[28] Mathur M., Aria S., Adams T., and Ahn C., “Automated Cycle Time Measurement and Analysis of Excavator’s Loading/Operation Using Smart Phone-Embedded IMU Sensors,” in Proceedings of the ASCE International Conference on Computing in Civil Engineering, Corvallis, pp. 215-222, 2015. DOI:10.1061/9780784479247.027

[29] Molaei A., Kolu A., Lahtinen K., and Geimer M., “Automatic Recognition of Excavator Working Cycles Using Supervised Learning and Motion Data Obtained from Inertial Measurement Units (IMUs),” Construction Robotics, vol. 8, no. 2, pp. 1-20, 2024. https://doi.org/10.1007/s41693-024- 00130-0

[30] Pradhananga N. and Teizer J., “Automatic Spatio- Temporal Analysis of Construction Site Equipment Operations Using GPS Data,” Automation in Construction, vol. 29, pp. 107-122, 2013. https://doi.org/10.1016/j.autcon.2012.09.004

[31] Rashid K. and Louis J., “Construction Equipment Activity Recognition from IMUs Mounted on Articulated Implements and Supervised Classification,” in Proceedings of the ASCE International Conference on Computing in Civil Engineering, Atlanta, pp. 130-138, 2019. DOI:10.1061/9780784482445.017

[32] Seo J. and Kim S., “The Study on Measures for Reducing Safety Accidents of Excavator,” Journal of the Korea Institute of Building Construction, vol. 8, no. 3, pp. 127-133, 2008. https://doi.org/10.5345/JKIC.2008.8.3.127

[33] Shao Y., Lv X., Huang L., and Bai L., “Twin SVM for Conditional Probability Estimation in Binary and Multiclass Classification,” Pattern Recognition, vol. 136, pp. 109253, 2023. https://doi.org/10.1016/j.patcog.2022.109253

[34] Shen Y., Wang J., Feng C., and Wang Q., “Dual Attention-Based Deep Learning for Construction Equipment Activity Recognition Considering Transition Activities and Imbalanced Dataset,” Automation in Construction, vol. 160, pp. 105300, 2024. https://doi.org/10.1016/j.autcon.2024.105300

[35] Suykens J., Brabanter J., Lukas L., and Vandewalle J., “Weighted Least Squares Support Vector Machines: Robustness and Sparse Approximation,” Neurocomputing, vol. 48, pp. 85-105, 2002. https://doi.org/10.1016/S0925- 2312(01)00644-0

[36] Vahdatikhaki F. and Hammad A., “Framework for Near Real-Time Simulation of Earthmoving Projects Using Location Tracking Technologies,” Automation in Construction, vol. 42, pp. 50-67, 2014. https://doi.org/10.1016/j.autcon.2014.02.018

[37] Vapnik V., The Nature of Statistics Learning Theory, Springer, 1995. https://doi.org/10.1007/978-1-4757-2440-0

[38] Wang C., Penga G., and De Baets B., “Embedding Metric Learning into an Extreme Learning Machine for Scene Recognition,” Expert Systems with Applications, vol. 203, pp. 117505, 2022. https://doi.org/10.1016/j.eswa.2022.117505

[39] Wang H. and Shao Y., “Fast Truncated Huber Loss SVM for Large Scale Classification,” Knowledge- Based System, vol. 260, pp. 110074, 2023. https://doi.org/10.1016/j.knosys.2022.110074

[40] Wang H., Hu L., and Zhang Y., “SVM Based Imbalanced Correction Method for Power Systems Transient Stability Evaluation,” ISA Transactions, vol. 136, pp. 245-253, 2023. https://doi.org/10.1016/j.isatra.2022.10.039

[41] Wang M., Lu Y., and Pan W., “An Improved Pattern-Based Prediction Model for a Class of Industrial Processes,” Transactions of the Institute of Measurement and Control, vol. 44, no. 7, pp. 1410-1423, 2022. https://doi.org/10.1177/01423312211055569

[42] Wang S., Qu Y., Li W., and Qin H., “Face Recognition: Biomimetic Pattern Recognition vs. Traditional Pattern Recognition,” Acta Electronica Sinica, vol. 32, no. 7, pp. 1057-1061, 2004.

[43] Weinberger K. and Saul K., “Distance Metric Learning for Large Margin Nearest Neighbor Classification,” Journal of Machine Learning Research, vol. 10, pp. 207-244, 2009. https://jmlr.csail.mit.edu/papers/volume10/weinb erger09a/weinberger09a.pdf

[44] Zhou Z. and Feng J., “Deep Forest,” National Science Review, vol. 6, no. 1, pp. 74-86, 2019. DOI:10.1093/nsr/nwy108 742