
KG4RSV: Towards Knowledge Graph -driven Specification and Validation of ML Dataset Quality Requirements: Case Study on e -ICU dataset
Artificial Intelligence (AI) and Machine Learning (ML) are increasingly embedded in critical domains, raising the challenges for ensuring the quality and reliability of AI/ML solutions. While traditional Requirements Engineering (RE) plays a cent ral role in eliciting and specifying the stockholders ’ expectations, current practices often lack the systematic specification and verification of dataset requirements, even though poor data quality issues remain a primary cause of ML project failures. Thi s paper introduces a Knowledge Graph -enabled framework for ML Dataset Requirements Specification ( KG4RSV ) and Validation. KG4RSV addresses three critical challenges in dataset engineering: managing data heterogeneity, ensuring data quality, and supporting systematic specification and validation of dataset requirements. Leveraging the semantic capabilities of Knowledge Graphs (KGs), the proposed method enables a structured representation of both data requirements and datasets using Resource Description Frame work (RDF ) and SHACL standards. We evaluate KG4RSV on a real -world clinical dataset electronic Intensive Care Unit (eICU) for binary classification of cardiovascular events. Results demonstrate that the framework effectively detects and handles quality issues related to completeness, consistency, and semantic correctness. The validation process led to notable improvements in ML performance -up to a 7% increase in recall for an Artificial Neural Network (ANN) model and an average 5% improvement across mult iple ML models, such as Random Forest (RL) and Logistic Regression (LR) . By bringing dataset validation into the requirements process, KG4RSV improves data quality and ensures better alignment between data and system goals from the early phases .
[1] Abdelmageed N., “Towards Transforming Tabular Datasets into Knowledge Graphs, ” in Proceedings of the Semantic Web: ESWC 2020 Satellite Events , Crete, pp 217 -228, 2020. https://doi.org/10.1007/978 -3-030 -62327 -2_37
[2] Abdelmageed N. and König -Ries B., “Meta2KG: An Embeddings -based Approach for Transforming Metadata to Knowledge Graphs, ” in Proceedings of the 4th International Workshop on Knowledge Graph Construction@ESWC , Cre te, pp. 1 -15, 2023. https://openreview.net/pdf?id=sF2ZN7M6iT
[3] Abduljabbar R., Dia H., Liyanage S., and Bagloee S., “Applications of Artificial Intelligence in Transport: An Overview, ” Sustainability , vol. 11, no. 1, pp. 1 -24, 2019. https://doi.org/10.3390/su11010189
[4] Ahmad K., Abdelrazek M., Arora C., Bano M., and Grundy J., “Requirements Engineering for Artificial Intelligence Systems: A Systematic Mapping Study, ” Information and Software Technology , vol. 158, pp. 107176, 2023. https://doi.org/10.1016/j.infsof.2023.107176
[5] Ahangaran M., Zhu H., Li R., Yin L., and et al., “DREAMER: A Computational Framework to Ev aluate Readiness of Datasets for Machine Learning, ” BMC Medical Informatics and Decision Making, vol. 24, pp. 1 -14, 2024. Doi:10.1186/s12911 -024 -02544 -w
[6] Alaketu M., Oguntimilehin A., Olatunji K., Abiola O., and et al., “Comparative Analysis of Intrusion De tection Models Using Big Data Analytics and Machine Learning Techniques, ” The International Arab Journal of Information Technology , vol. 21, no. 2, pp. 326 -337, 2024. https://doi.org/10.34028/iajit/21/2/14
[7] Agarwal R., Fernandez D., Elsaleh T., Gyrard A., and et al., “Unified IoT Ontology to Enable Interoperability and Federation of Testbeds, ” in Proceedings of the IEEE 3 rd World Forum on Internet of Things , Reston, pp. 70 -75, 2016. DOI:10.1109/WF -IoT.2016.7845470
[8] Arpteg A., Brinne B., Crnkovic -Friis L., and Bosch J., “Software Engineering Challenges of Deep Learning, ” in Proceedings of the 44 th Euromicro Conference on Software Engineering and Advanced Applications , Prague, pp. 50 -59, 2018. DOI:10.1109/SEAA.2018.00018
[9] Bader S., Grangel -Gonzalez I., Nanjappa P ., Vidal M., and Maleshkova M., “A Knowledge Graph for Industry 4.0,” in Proceedings of the European Semantic Web Conference , Crete, pp. 465 -480, 2020. https://doi.org/10.1007/978 -3-030 -49461 - 2_27
[10] Barrera J., Reina -Reina A., Lavalle A., Maté A., and Trujil lo J., “An Extension of Istar for Machine Learning Requirements by Following the PRISE Methodology, ” Computer Standards and Interfaces , vol. 88, pp. 1 -15, 2024. doi:10.1016/j.csi.2023.103806
[11] Beckett D. and McBride B., “RDF/XML syntax specification (revised ),” W3C recommendation , vol. 10, no. 2.3, pp. 1 -56, 2004.
[12] Berners -Lee T., Hendler J., and Lassila O., Linking the world ’s information: essays on Tim Berners - Lee ’s invention of the World Wide Web , ACM Books, 2023. https://doi.org/10.1145/3591366
[13] Challa H., Niu N., and Johnson R., “Faulty Requirements Made Valuable: On the Role of Data Quality in Deep Learning, ” in Proceedings of the IEEE 7 th International Workshop on Art ificial Intelligence for Requirements Engineering , Zurich, pp. 61 -69, 2020. DOI:10.1109/AIRE51212.2020.00016
[14] Cui H., Lu J., Wang S., Xu R., and et al, “A Survey On Knowledge Graphs for Healthcare: Resources, Application Progress, And Promise, ” in Proceedin gs of the ICML 3 rd Workshop on Interpretable Machine Learning in Healthcare , Hawaii, pp. 1 -19, 2023. https://openreview.net/pdf?id=CZCktJoBRh
[15] Du R., Tsougenis E., Ho J., Chan J., and et al, “Machine Learning Application for The Prediction of SARS -Cov -2 Inf ection Using Blood Tests and Chest Radiograph, ” Scientific Reports , vol. 11, no. 1, pp. 1 -13, 2021. DOI:10.1038/s41598 -021 -93719 -2
[16] DuCharme B., Learning SPARQL , O ’Reilly Media , Inc., 2013. https://www.oreilly.com/library/view/learning - sparql -2nd/9781449371 449/
[17] Djeddi C., Zarour N., and Charrel P., “A Requirement Elicitation Method for Big Data Projects, ” in Proceedings of the International Conference on Managing Business Through Web Analytics , Khemis Miliana, pp. 231 -242, 2022. https://doi.org/10.1007/978 -3-031 -06971 -0_17
[18] Emmert -Streib F. and Dehmer M., “Understanding Statistical Hypothesis Testing: The Logic of Statistical Inference, ” Machine and Knowledge Extraction , vol. 1, no. 3, pp. 945 -961, 2019, DOI:10.3390/make1030054
[19] Färber M. and Lamprecht D., “The Data Set Knowledge Graph: Creating A Linked Open Data Source for Data Sets, ” Quantitative Science Studies , vol. 2, no. 4, pp. 1324 -1355, 2021. https://doi.org/10.1162/qss_a_00161
[20] Fernandez -Llorca D. and Gómez E., “Trustworthy Artificial Intelligence Requirements in the Autonomous Driving Domain, ” Computer , vol. 56, no. 2, pp. 29 -39, 2023. DOI:10.1109/MC.2022.3212091
[21] Ferranti N., Polleres A., de Souza J., and Ahmetaj S., “Formalizin g Property Constraints in Wikidata, ” Wikidata@ ISWC , vol. 3262, pp. 1 -13, 2022. https://ceur -ws.org/Vol -3262/paper1.pdf
[22] Foidl H., Golendukhina V., Ramler R., and Felderer M., “Data Pipeline Quality: Influencing Factors, Root Causes of Data -related Issues, and Processing Problem Areas for Developers, ” arXiv Preprint , vol. arXiv:2309.07067, pp. 1 -34, 2023. https://doi.org/10.48550/arXiv.2309.07067
[23] Goel P., Wasson V., Singh I., Kaur A., and et al, “Machine Learning Based Water Requirement Prediction for Agricu lture Before a Rainfall, ” in Proceedings of the International Conference on Emerging Smart Computing and Informatics , Pune, pp. 1 -7, 2024. DOI:10.1109/ESCI59607.2024.10497332
[24] Gudigar A., Kadri N., Raghavendra U., Samanth J., and et al., “Automatic Identifi cation of Hypertension and Assessment of Its Secondary Effects Using Artificial Intelligence: A Systematic Review (2013 -2023),” Computers in Biology and Medicine , vol. 172, pp. 1 -26, 2024. DOI:10.1016/j.compbiomed.2024.108207
[25] Habibullah K., Gay G., and Hor koff J., “Non - Functional Requirements for Machine Learning: Understanding Current Use and Challenges Among Practitioners, ” Requirements Engineering , vol. 28, no. 2, pp. 283 -316, 2023. DOI:10.1007/s00766 -022 -00395 -3
[26] Horkoff J., Aydemir F., Cardoso E., Li T. , and et al, “Goal -Oriented Requirements Engineering: An Extended Systematic Mapping Study, ” Requirements Engineering , vol. 24, no. 2, pp. 133 - 160, 2019. doi:10.1007/s00766 -017 -0280 -z
[27] Huang H., Niazmand E., and Vidal M., “Hybrid AI Approach for Counterfact ual Prediction over Knowledge Graphs for Personal Healthcare, ” in Proceedings of the Artificial Intelligence and Data Science for Healthcare: Bridging Data -Centric AI and People -Centric Healthcare , Barcelona, pp.1 - 6, 2024. DOI: 10.13140/RG.2.2.15682.18889
[28] Jahić B., Guelfi N., and Ries B., “SEMKIS -DSL: A Domain -Specific Language to Support Requirements Engineering of Datasets and Neural Network Recognition, ” Information , vol. 14, no. 4, pp. 1 -25, 2023. DOI:10.3390/info14040213
[29] Jiang L. and Wang X., “Dataset Constrution through Ontology -Based Data Requirements Analysis, ” Applied Sciences , vol. 14, no. 6, pp. 1 - 22, 2024. https://doi.org/10.3390/app14062237
[30] Kamm S., Veekati S., Mueller T., J azdi N., and Weyrich M., “A Survey On Machine Learning Based Analysis of Heterogeneous Data in Industrial Automation, ” Computers in Industry , vol. 149, pp. 1 -14, 2023. https://doi.org/10.1016/j.compind.2023.103930
[31] Knublauch H. and Kontokostas D., “Shapes Constraint Language (SHACL), ” W3C Candidate Recommendation , vol. 11, no. 8, p p. 1, 2017.
[32] Massey P., Montgomery C., and Zhang A., “Comparison of ChatGPT -3.5, ChatGPT -4, and Orthopaedic Resident Performance on Orthopaedic Assessment Examinations, ” Journal of the American Academy of Orthopaedic Surgeons , vol. 31, no. 23, pp. 1173 -1179, 2023. DOI: 10.5435/JAAOS -D-23 -00396
[33] Mehrabian A., Gerasimov I., Khayat M., Pagán B., and et al, “Unveiling Knowledge: Enhancing Data Discovery Through Integrative Knowledge Graphs at NASA ’s GES -DISC, ” in Proceedings of the 23 rd Meeting of the American Geophysical Union , California, pp. 1 -28, 2023. https://ntrs.nasa.gov/api/citations/20230017499/d ownloads/AGU23 -GESDISC -Graph -removed - graphics.pdf
[34] Mohamed A. and Jebapillai C., “A Machine Learning Attempt for Anatomizing Software Ri sks in Small and Medium Agile Enterprises, ” The International Arab Journal of Information Technology , vol. 22, no. 3, pp. 547 -559, 2025. https://doi.org/10.34028/iajit/22/3/10
[35] Mohamed A., Abuoda G., Ghanem A., Kaoudi Z., and Aboulnaga A., “RDFFrames: Knowl edge Graph Access for Machine Learning Tools, ” The VLDB Journal , vol. 31, no. 2, pp. 321 -346, 2022. https://doi.org/10.1007/s00778 -021 -00690 -5
[36] Montoya -Murillo D., Mora M., Galvan -Cruz S., Munoz -Zavala A., and Alvarez -Rodriguez F., “A Review of SDLCs for Bi g Data Analytics Systems in the Context of Very Small Entities Using the ISO/IEC 29110 Standard -Basic Profile, ” The International Arab Journal of Information Technology , vol. 22, no. 1, pp. 194 -215, 2025. https://doi.org/10.34028/iajit/22/1/15
[37] Narayanan P. , Data Engineering for Machine Learning Pipelines: From Python Libraries to ML Pipelines and Cloud Platforms , Springer, 2024. https://doi.org/10.1007/979 -8-8688 -0602 -5_6
[38] Pandey D., Niwaria K., and Chourasia B., “Machine Learning Algorithms: A Review, ” Inte rnational Research Journal of Engineering and Technology , vol. 6, no. 2, pp. 916 -922, 2019.
[39] Priestley M., O ’donnell F., and Simperl E., “A Survey of Data Quality Requirements That Matter in ML Development Pipelines, ” ACM Journal of Data and Information Qua lity , vol. 15, no. 2, pp. 1-39, 2023. https://doi.org/10.1145/3592616
[40] Pollard T., Johnson A., Raffa J., and Celi L., “The eICU Collaborative Research Database, A Freely Available Multi -Center Database for Cri tical Care Research, ” Scientific data , vol. 5, no. 1, pp. 1 -13, 2018. https://doi.org/10.1038/sdata.2018.178
[41] Rajabi E. and Kafaie S., “Knowledge Graphs and Explainable AI in Healthcare, ” Information , vol. 13, no. 10, pp. 1 -10, 2022. https://doi.org/10.3390 /info13100459
[42] Ries B., Guelfi N., and Jahić B., “An MDE Method for Improving Deep Learning Dataset Requirements Engineering using Alloy and UML, ” in Proceedings of the 9 th International Conference on Model -Driven Engineering and Software Development, Scien ce and Technology Publications , virtual, pp. 41 -52, 2021. DOI:10.5220/0010216600410052
[43] Rouse M., SNOMED CT (Systematized Nomenclature of Medicine -Clinical Terms), SearchHealthIT, 2010. Last Visited, 2025. https://www.snomed.org/
[44] Salazar -Salazar G., Mora M. , Duran -Limon H., Alvarez -Rodriguez F., and Munoz -Zavala A., “Review of Agile SDLC for Big Data Analytics Systems in the Context of Small Organizations Using Scrum -XP, ” The International Arab Journal of Information Technology , vol. 21, no. 6, pp. 1089 -1110 , 2024. https://doi.org/10.34028/iajit/21/6/12
[45] Schaffenrath R., Proksch D., Kopp M., Albasini I., and et al, “Benchmark for Performance Evaluation of SHACL Implementations in Graph Databases, ” in Proceedings of the International Joint Conference on Rules a nd Reasoning , Oslo, pp. 82 - 96, 2020. https://doi.org/10.1007/978 -3-030 - 57977 -7_6
[46] Semmak F., Gnaho C., Brunet J., and Laleau R., “How to Adapt the KAOS Method to the Requirements Engineering of Cycab Vehicle., ” in Proceedings of the 4 th International Conference on Evaluation of Novel Approaches to Software Engineering , Milan, pp. 87 -94, 2009.
[47] Semler S., “LOINC: Origin, Development of and Perspectives for Medical Research and Biobanking -20 Years on the Way to Implementation in Germany, ” Journal of Laboratory Medicine , vol. 43, no. 6, pp. 359 -382, 2019. https://doi.org/10.1515/labmed -2019 -0193
[48] Sendak M., Sirdeshmukh G., Ochoa T., Premo H., and et al, “Development and Validation of ML - DQA -a Machine Learning Data Quality Assurance Framework for Healthcare, ” in Proceedings of the 7 th Machine Learning for Healthcare Conference, North Carolina, pp. 741 - 759, 2022. DOI: 10.48550/arXiv.2208.02670
[49] Sheh R., “Explainable Artificial I ntelligence Requirements for Safe, Intelligent Robots, ” in Proceedings of the IEEE International Conference on Intelligence and Safety for Robotics , Tokoname, pp. 382 -387. 2021. DOI:10.1109/ISR50024.2021.9419498
[50] Sellami S. and Zarour N., “Keyword -Based Fac eted Search Interface for Knowledge Graph Construction and Exploration, ” International Journal of Web Information Systems , vol. 18, no. 56, pp. 453 -486, 2022. https://doi.org/10.1108/IJWIS -02 -2022 -0037
[51] Sellami S., Dkaki T., Zarour N., and Charrel P., “KGMap: Leveraging Enterprise Knowledge Graphs by Bridging Between Relational, Social and Linked Web Data, ” in Proceedings of the 3 rd Int ernational Conference on Advances in Artificial Intelligence , Istanbul, pp. 90 -96, 2019. https://doi.org/10.1145/3369114.3369146
[52] Soukour S., Aboucaya W., and Georgantas N., “Leveraging Knowledge Graph s for Goal Model Generation, ” in Proceedings of the 7th Workshop on Natural Language Processing for Requirements Engineering in conjuction with the 30 th International Woking Conference on Requirements Engineering: Foundation for Software Quality , Winterthu r, pp. 1 -12, 2024. https://inria.hal.science/hal -04486653
[53] Soureya Y., Amougou N., Ngossaha J., Tsakou S., and M. Ndjodo, “Adaptive Software Development: A Comprehensive Framework Integrating Artificial Intelligence for Sustainable Evolution, ” The Internati onal Arab Journal of Information Technology , vol. 22, no. 2, pp. 248 - 262, 2025. https://doi.org/10.34028/iajit/22/2/4
[54] Vandenbussche P., Atemezing G., Poveda -Villalón M., and Vatant B., “Linked Open Vocabularies (LOV): A Gateway to Reusable Semantic Vocabularies on the Web, ” Semantic Web , vol. 8, no. 3, pp. 437 -452, 2016. DOI: 10.3233/SW - 160213
[55] Vonder Haar L., Reynolds S., Procko T., and Ochoa O., “Validating Security Requirement Specifications through the use of a Knowledge Graph, ” in Proceedings of the IEEE 17 th International Conference on Semantic Computing , Laguna Hills, pp. 244 -251, 2023. DOI:10.1109/ICSC56153.2023.00048
[56] Vogelsang A. and Borg M., “Requirements Engineering for Machine Learning: Perspectives from Data Scientists, ” in Proceedings of the IEEE 27 th International Requirements Engineering Conferenc e Workshops , Jeju, pp. 245 -251. 2019. DOI:10.1109/REW.2019.00050
[57] Weihrauch D., Schindler P., and Sihn W., “A Conceptual Model for Developing a Smart Process Control System, ” Procedia CIRP , vol. 67, pp. 386 -391, 2018. DOI:10.1016/j.procir.2017.12.230
[58] White J., Hays S., Fu Q., Spencer -Smith J., and Schmidt D., Generative AI for Effective Software Development , Springer, 2024. https://doi.org/10.1007/978 -3-031 -55642 -5_4
[59] Yahya M., Ali A., Mehmood Q., Yang L., and et al, “A Benchmark Dataset with Knowledge Graph Generation for Industry 4.0 Production Lines, ” Semantic Web , vol. 15, no. 2, pp. 461 -479, 2024. https://doi.org/10.3233/SW -233431
[60] Yogi K., Gowda D., Mouna K., Sujithra L., and et al, “Scalability and Perfor mance Evaluation of Machine Learning Techniques in High -Volume Social Media Data Analysis, ” in Proceedings of the 11 th International Conference on Reliability, Infocom Technologies and Optimization , Noida, pp. 1 -6, 2024. DOI :10.1109/ICRITO61523.2024.105223 61
[61] Zhao Z., Liu W., French T., and Stewart M., “Rel2Graph: Automated Mapping from Relational Databases to a Unified Property Knowledge Graph, ” arXiv Preprint , vol. arXiv:2310.01080, pp. 1 -18, 2023. doi:10.48550/arXiv.2310.01080
[62] Zhou S., Greenspan H., Davatzikos C., Duncan J., and et al., “A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies with Progress Highlights, And Future Promises, ” IEEE , vol. 109, no. 5, pp. 820 - 838, 2021, Doi:10.110 9/JPROC.2021.3054390