Intelligent Software Fault Prediction Using Machine Learning and Neural Network Techniques

Pooja Singh; Saoud Sarwar; Kaveri Umesh Kadam

doi:10.65890/race.v2i2.173

Authors

Pooja Singh Research Scholar, Department of Computer Science, Al-Falah University, Faridabad, Haryana
Saoud Sarwar Department of Computer Science, Al-Falah University, Faridabad, Haryana
Kaveri Umesh Kadam Department of Computer Science, Jamia Hamdard University, New Delhi

DOI:

https://doi.org/10.65890/race.v2i2.173

Keywords:

Software Fault Prediction, Machine Language, Neural Network, Software Metrics, Software Quality

Abstract

The investigative methodology includes a careful process that begins with data cleaning and feature selection. Uses 10-fold cross-validation, which means it basically takes 10ths of the data and tests it to see if it's consistent. A number of machine learning algorithms are evaluated, including Decision Tree, Naive Bayes, Support Vector Machine, Random Forest, and Multi-Layer Perceptron. The classic criteria accuracy, precision, recall and F1 score are used to evaluate all. When the models were completed, the results showed that models that use several techniques (e.g., Random Forest) and/or neural networks (e.g., Multi-Layer Perceptron) generally outperform simpler models. Among them, the Multi-Layer Perceptron is best suited for predictions, and the Random Forest is strong across all types of datasets. These discoveries indicate that machine learning can be used to estimate software failure time. Based on the research involved and the results it yielded, it is suggested that further investigation be undertaken into the possibility of combining the methods and emphasizing learning-based approaches. In this work, a methodology utilising data preprocessing, followed by feature selection and ten-fold cross-validation, is used to obtain a fair assessment. The performance of various classifiers, including Decision Tree, Naïve Bayes, Support Vector Machine (SVM), Random Forest, and Multi-Layer Perceptron (MLP), is assessed using four popular metrics: accuracy, precision, recall, and F1-score. The findings show that the ensemble and neural network outperform traditional classifiers for some data sets. The Multi-Layer Perceptron achieves the best predictive accuracy, while the Random Forest shows consistent and reliable performance. This suggests that machine learning has potential applications that go beyond simply predicting software failure in an early and efficient manner and explores further in the realm of hybrid and learning-focused approaches.

References

[1] Shelke, C., Mandale, A., Anjimoon, S., Asha, V., Nijhawan, G., & Dhanraj, J. A. (2025). Optimized Machine Learning Techniques for Software Fault Prediction. Natural Language Processing for Software Engineering, 207-219. DOI: https://doi.org/10.1002/9781394272464.ch14

[2] Alsangari, B., & Bircik, G. (2023, June). Performance Evaluation of various ML techniques for Software Fault Prediction using NASA dataset. In 2023 5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) (pp. 1-7). IEEE. DOI: https://doi.org/10.1109/HORA58378.2023.10156708

[3] Pavana, M. S., Pushpalatha, M. N., & Parkavi, A. (2021, October). Software fault prediction using machine learning algorithms. In International Conference on Advances in Electrical and Computer Technologies (pp. 185-197). Singapore: Springer Nature Singapore. DOI: https://doi.org/10.1007/978-981-19-1111-8_16

[4] Liu, J., Pan, C., Lei, F., Hu, D., & Zuo, H. (2021). Fault prediction of bearings based on LSTM and statistical process analysis. Reliability Engineering & System Safety, 214, 107646. DOI: https://doi.org/10.1016/j.ress.2021.107646

[5] Siddiqui, T., & Mustaqeem, M. (2023). Performance evaluation of software defect prediction with NASA dataset using machine learning techniques. International Journal of Information Technology, 15(8), 4131-4139. DOI: https://doi.org/10.1007/s41870-023-01528-9

[6] Jakhar, A. K., & Rajnish, K. (2018). Software Fault Prediction with Data Mining Techniques by Using Feature Selection Based Models. International Journal on Electrical Engineering & Informatics, 10(3). DOI: https://doi.org/10.15676/ijeei.2018.10.3.3

[7] P. Tyagi, A. K. Bindal and D. Srivastava, "A Fusion-Driven Deep Learning Framework for Robust and Scalable Face Recognition in Biometric Systems," 2025 International Conference on Data, Energy and Communication Networks (DECoN), Bhopal, India, 2025, pp. 1-6, doi: 10.1109/DECoN67170.2025.11447814. DOI: https://doi.org/10.1109/DECoN67170.2025.11447814

[8] Basha, N., Nounou, M., & Nounou, H. (2018). Multivariate fault detection and classification using interval principal component analysis. Journal of computational science, 27, 1-9. DOI: https://doi.org/10.1016/j.jocs.2018.04.017

[9] Rathore, S. S., & Kumar, S. (2019). A study on software fault prediction techniques. Artificial Intelligence Review, 51, 255-327. DOI: https://doi.org/10.1007/s10462-017-9563-5

[10] Hammouri, A., Hammad, M., Alnabhan, M., & Alsarayrah, F. (2018). Software bug prediction using machine learning approach. International journal of advanced computer science and applications, 9(2). DOI: https://doi.org/10.14569/IJACSA.2018.090212

[11] Tantithamthavorn, C., Hassan, A. E., & Matsumoto, K. (2018). The impact of class rebalancing techniques on the performance and interpretation of defect prediction models. IEEE Transactions on Software Engineering, 46(11), 1200-1219. DOI: https://doi.org/10.1109/TSE.2018.2876537

[12] Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., ... & Zimmermann, T. (2019, May). Software engineering for machine learning: A case study. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) (pp. 291-300). IEEE. DOI: https://doi.org/10.1109/ICSE-SEIP.2019.00042

[13] Batool, I., & Khan, T. A. (2023). Software fault prediction using deep learning techniques. Software Quality Journal, 31(4), 1241-1280. DOI: https://doi.org/10.1007/s11219-023-09642-4

[14] Matloob, F., Ghazal, T. M., Taleb, N., Aftab, S., Ahmad, M., Khan, M. A., ... & Soomro, T. R. (2021). Software defect prediction using ensemble learning: A systematic literature review. IEEe Access, 9, 98754-98771. DOI: https://doi.org/10.1109/ACCESS.2021.3095559

[15] Arasteh, B., & Branch, T. (2018). Software fault-prediction using combination of neural network and Naive Bayes algorithm. J. Netw. Technol, 9(3), 95. DOI: https://doi.org/10.6025/jnt/2018/9/3/94-101

[16] Albreiki, B., Zaki, N., & Alashwal, H. (2021). A systematic literature review of student’performance prediction using machine learning techniques. Education Sciences, 11(9), 552. DOI: https://doi.org/10.3390/educsci11090552

[17] Tyagi, P., Bindal, D.A., & Srivastava, D. (2025). An Optimized Feature-Level Fusion Framework for Multimodal Biometric Authentication Using ML Classifiers. International Journal of Environmental Sciences. DOI: https://doi.org/10.64252/jmz3x190

[18] Tasneem, N., Zulzalil, H. B., & Hassan, S. A. (2025). Enhancing Agile Software Development: A Systematic Literature Review of Requirement Prioritization and Reprioritization Techniques. IEEE Access. DOI: https://doi.org/10.1109/ACCESS.2025.3539357

[19] Charan, S., Sinha, S., Sujan, S. M., & Nayak, U. A. (2024, May). Accuracy Prediction of Ensemble Deep Learning Model through Software Defect Prediction. In 2024 Second International Conference on Data Science and Information System (ICDSIS) (pp. 1-8). IEEE. DOI: https://doi.org/10.1109/ICDSIS61070.2024.10594340

[20] Zhou, X., Yuan, W., Gao, Q., & Yang, C. (2024). An efficient ensemble learning method based on multi-objective feature selection. Information Sciences, 679, 121084. DOI: https://doi.org/10.1016/j.ins.2024.121084

[21] Karim, S., Warnars, H. L. H. S., Gaol, F. L., Abdurachman, E., & Soewito, B. (2017, November). Software metrics for fault prediction using machine learning approaches: A literature review with PROMISE repository dataset. In 2017 IEEE international conference on cybernetics and computational intelligence (CyberneticsCom) (pp. 19-23). IEEE. DOI: https://doi.org/10.1109/CYBERNETICSCOM.2017.8311708

[22] Zhang, B., Li, Y., & Chai, Z. (2022). A novel random multi-subspace based ReliefF for feature selection. Knowledge-Based Systems, 252, 109400. DOI: https://doi.org/10.1016/j.knosys.2022.109400

[23] Ayon, S. I. (2019, May). Neural network-based software defect prediction using genetic algorithm and particle swarm optimization. In 2019 1st International conference on advances in science, engineering and robotics technology (ICASERT) (pp. 1-4). IEEE DOI: https://doi.org/10.1109/ICASERT.2019.8934642

[24] Srivastava, D., Mall, S., Singh, S. P., Bhatt, A., Kumar, S., & Soni, D. (2024). Deep ensemble model for sequence-based prediction of PPI: Self improved optimization assisted intelligent model. Multimedia Tools and Applications, 83(26), 68135-68154. DOI: https://doi.org/10.1007/s11042-024-18738-3

[25] Sharma, V., Kumar, L., & Srivastava, D. (2023). Machine Learning-Based Prediction of Users' Involvement on Social Media. In Advanced Applications of NLP and Deep Learning in Social Media Data (pp. 151-170). IGI Global Scientific Publishing. DOI: https://doi.org/10.4018/978-1-6684-6909-5.ch008

[26] Goyal, D., Choudhary, A., Pabla, B. S., & Dhami, S. S. (2020). Support vector machines based non-contact fault diagnosis system for bearings. Journal of Intelligent Manufacturing, 31(5), 1275-1289. DOI: https://doi.org/10.1007/s10845-019-01511-x

[27] Iqbal, A., Aftab, S., Ali, U., Nawaz, Z., Sana, L., Ahmad, M., & Husen, A. (2019). Performance analysis of machine learning techniques on software defect prediction using NASA datasets. International Journal of Advanced Computer Science and Applications, 10(5). DOI: https://doi.org/10.14569/IJACSA.2019.0100538

[28] Kaur, G., Pruthi, J., & Gandhi, P. (2023). Decision tree regression analysis of proposed metric suite for software fault prediction. SN Computer Science, 5(1), 69. DOI: https://doi.org/10.1007/s42979-023-02386-9

[29] Mustaqeem, M., Mustajab, S., & Alam, M. (2024). A hybrid approach for optimizing software defect prediction using a grey wolf optimization and multilayer perceptron. International Journal of Intelligent Computing and Cybernetics, 17(2), 436-464. DOI: https://doi.org/10.1108/IJICC-11-2023-0385

[30] Juneja, S., Nauman, A., Uppal, M., Gupta, D., Alroobaea, R., Muminov, B., & Tao, Y. (2024). Machine learning-based defect prediction model using multilayer perceptron algorithm for escalating the reliability of the software. The Journal of Supercomputing, 80(7), 10122-10147. DOI: https://doi.org/10.1007/s11227-023-05836-6