An Integrating Machine Learning Algorithm and Simulation Method for Improving Software Project Management: A Case Study

Document Type : Research Paper

Authors

1 School of Industrial and Systems Engineering, College of Engineering, University of Tehran, Tehran, Iran

2 School of Industrial Engineering, K. N. Toosi University of Technology (KNTU), Tehran, Iran

10.22070/jqepo.2022.15346.1214

Abstract

Project managers analyze the factors that affected projects' success, signifying performing a project within the scopes (Time, Quality, and cost) defined in the initial step. The implication of each factor on project success is essential since several of them have been specified in this area. Employing all of them is not feasible, and it may impose outrageous expenses on the organizations. Therefore, this article aims to identify the factors that impact project accomplishment and pinpoint the most contributing factors to facilitate the project's implementation. The main contribution of this paper is representing a framework by combining Machine Learning algorithms and simulation models to detect the effectiveness of leading organizational factors on project accomplishment, beneficially leading to extracting the accurate analysis.   A logistic regression algorithm was employed to build a predictive model. The predictive model was created based on independent variables to predict whether the software project would be successful or fail. Also, Gamification was determined as the most influential factor on the objective by the Logistic regression feature importance method. Then, Gamified and non-Gamified models were compared by the Simulation method and showed Gamification made a 36.26% improvement in the rojects cycle time and a 15% enhancement in the quality of employers' performance by decreasing the projects' bugs. For validating the simulation results, some projects were implemented in the real case study, and the model results clarified the Gamification potential in improving employee engagement leading to better work progress tracking and higher performance quality.

Keywords


Akgün, A.E. (2020) Team wisdom in software development projects and its impact on project performance. International Journal of Information Management 50: 228-243.
Amani, M.A., Ebrahimi, F., Dabbagh, A. et al. (2021) A machine learning-based model for the estimation of the temperature-dependent moduli of graphene oxide reinforced nanocomposites and its application in a thermally affected buckling analysis. Engineering with Computers 37(3): 2245-2255.
Amid, A., Biancolin, D., Gonzalez, A. et al. (2020) Chipyard: Integrated Design, Simulation, and Implementation Framework for Custom SoCs. IEEE Micro 40(4): 10-21.
Amirkhalili,Y.S., Aghsami, A., Jolai, F. (2020). "Comparison of Time Series ARIMA Model and Support Vector Regression". International Journal of Hybrid Information Technology, 13(1), pp.7-18. doi:10.21742/IJHIT.2020.13.1.02
Bassil, Y. (2012) A simulation model for the waterfall software development life cycle. arXiv preprint arXiv:1205.6904.
Bibi, S. and Stamelos, I. (2006) Selecting the appropriate machine learning techniques for the prediction of software development costs. IFIP International Conference on Artificial Intelligence Applications and Innovations. Springer, 533-540.
Cerdeiral, C.T. and Santos, G. (2019) Software project management in high maturity: A systematic literature mapping. Journal of Systems and Software 148: 56-87.
Dashti, M.S., RezaZadeh, M., Khanzadi, M. et al. (2021) Integrated BIM-based simulation for automated time-space conflict management in construction projects. Automation in Construction 132: 103957.
Davoudabadi, R., Mousavi, S.M., Šaparauskas, J. et al. (2019) Solving construction project selection problem by a new uncertain weighting and ranking based on compromise solution with linear assignment approach. Journal of Civil Engineering and Management 25(3): 241-251.
Deterding, S., Dixon, D., Khaled, R. et al. (2011) From game design elements to gamefulness: defining" gamification". Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments. 9-15.
Dugarte-Peña, G.L., Sánchez-Segura, M.I., Medina-Domínguez, F. et al. (2020) Simulation of the software development process: an approximation using System Dynamics and the Larman Method.
Efe, P. and Demirors, O. (2019) A change management model and its application in software development projects. Computer Standards & Interfaces 66: 103353.
Featherstone, M. and Habgood, J. (2019) UniCraft: Exploring the impact of asynchronous multiplayer game elements in Gamification. International Journal of Human-Computer Studies 127: 150-168.
Fisher, J., Koning, D. and Ludwigsen, A. (2013) Utilizing Atlassian JIRA for large-scale software development management. Reportno. Report Number|, Date. Place Published|: Institution|.
França, B.B.N. and Travassos, G.H. (2013) Are we prepared for simulation based studies in software engineering yet? CLEI electronic journal 16(1): 9-9.
García-García, J., Enríquez, J.G., Ruiz, M. et al. (2020) Software process simulation modeling: systematic literature review. Computer Standards & Interfaces 70: 103425.
Gitinavard, H. (2019) Strategic Evaluation of Sustainable Projects based on Hybrid Group Decision Analysis with Incomplete Information. Journal of Quality Engineering and Production Optimization 4(2): 17-30.
Gitinavard, H. and Mousavi, S. (2015) Evaluating construction projects by a new group decision-making model based on intuitionistic fuzzy logic concepts. International Journal of Engineering 28(9): 1312-1319.
Gitinavard, H., Mousavi, S.M., Vahdani, B. et al. (2020) Project safety evaluation by a new soft computing approach-based last aggregation hesitant fuzzy complex proportional assessment in construction industry. Scientia Iranica 27(2): 983-1000.
Haleem, M., Farooqui, M.F. and Faisal, M. (2021) Cognitive impact validation of requirement uncertainty in software project development. International Journal of Cognitive Computing in Engineering 2: 1-11.
Hamzeh, A.M., Mousavi, S.M. and Gitinavard, H. (2020) Imprecise earned duration model for time evaluation of construction projects with risk considerations. Automation in Construction 111: 102993.
Han, W.J., Jiang, L.X., Lu, T.B. et al. (2015) Comparison of machine learning algorithms for software project time prediction. International Journal of Multimedia and Ubiquitous Engineering 10(9): 1-8.
Hassan MS (2016) Software Development Life Cycle.
Hsieh, M-Y., Hsu, Y-C. and Lin, C-T. (2018) Risk assessment in new software development projects at the front end: a fuzzy logic approach. Journal of Ambient Intelligence and Humanized Computing 9(2): 295-305.
Koivisto, J. and Hamari, J. (2019) The rise of motivational information systems: A review of gamification research. International Journal of Information Management 45: 191-210.
Kolkman, D. (2020) The usefulness of algorithmic models in policy making. Government Information Quarterly 37(3): 101488.
Lalsing, V., Kishnah, S. and Pudaruth, S. (2012) People factors in agile software development and project management. International Journal of Software Engineering & Applications 3(1): 117.
Li, D., Deng, L., Zeng, X. et al. (2021) Dynamic simulation modelling of software requirements change management system. Microprocessors and Microsystems 83: 104009.
Liu, D., Wang, Q. and Xiao, J. (2009) The role of software process simulation modeling in software risk management: A systematic review. 2009 3rd International Symposium on Empirical Software Engineering and Measurement. IEEE, 302-311.
Liu, X., Li, D-Q., Cao, Z-J., et al. (2020) Adaptive Monte Carlo simulation method for system reliability analysis of slope stability based on limit equilibrium methods. Engineering Geology 264: 105384.
Lu, F., Chen, B., Qi, L. et al. (2020) PadMesh: a parallel and distributed framework for interactive mesh generation software. Engineering with Computers. 1-22.
Machuca-Villegas, L. and Gasca-Hurtado, G.P. (2018a) Gamification for improving software project management processes: A systematic literature review. International Conference on Software Process Improvement. Springer, 41-54.
Machuca-Villegas, L. and Gasca-Hurtado, G.P. (2018b) Gamification for improving software project: systematic mapping in project management. 2018 13th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1-6.
Machuca-Villegas, L. and Gasca-Hurtado, G.P. (2019) Toward a Model based on Gamification to Influence the Productivity of Software Development Teams. 2019 14th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 1-6.
Mahdi, M.N., MH, M.Z., Yusof, A. et al. (2020) Design and Development of Machine Learning Technique for Software Project Risk Assessment-A Review. 2020 8th International Conference on Information Technology and Multimedia (ICIMU). IEEE, 354-362.
Masoud, M., Abu-Elhaija, W., Jaradat, Y. et al. (2017) Software project management: resources prediction and estimation utilizing unsupervised machine learning algorithm. International Conference on Engineering, Project, and Product Management. Springer, 151-159.
Meder, M., Plumbaum, T. and Hopfgartner, F. (2013) Perceived and actual role of gamification principles. 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing. IEEE, 488-493.
Moldon, L., Strohmaier, M. and Wachs, J. (2020) How Gamification affects software developers: Cautionary evidence from a quasi-experiment on GitHub. arXiv e-prints. arXiv: 2006.02371.
Muszyńska, K. (2020) Gamification of communication and documentation processes in project teams. Procedia Computer Science 176: 3645-3653.
Najjar, M., Ghannouchi, S.A. and Ghannouchi, S. (2021) GaBPM: An attempt for the enhancement of BP performance through Gamification. Procedia Computer Science 181: 835-842.
Niazi, M., Mahmood, S., Alshayeb, M. et al. (2016) Toward successful project management in global software development. International Journal of Project Management 34(8): 1553-1567.
Perryer, C., Celestine, N.A., Scott-Ladd, B. et al. (2016) Enhancing workplace motivation through Gamification: Transferrable lessons from pedagogy. The International Journal of Management Education 14(3): 327-335.
Pospieszny, P., Czarnacka-Chrobot, B. and Kobylinski, A. (2018) An effective approach for software project effort and duration estimation with machine learning algorithms. Journal of Systems and Software 137: 184-196.
Rashid, E., Patnaik, S. and Bhattacherjee, V. (2012) Software quality estimation using machine learning: Case-Based reasoning technique. International Journal of Computer Applications 58(14).
Rodrigues, L.F., Oliveira, A. and Rodrigues, H. (2019) Main gamification concepts: a systematic mapping study. Heliyon 5(7): e01993.
Rus, I., Neu, H. and Münch, J. (2014) A systematic methodology for developing discrete event simulation models of software development processes. arXiv preprint arXiv:1403.3559.
Saremi, R.L. and Yang, Y. (2015) Dynamic simulation of software workers and task completion. 2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering. IEEE, 17-23.
Serrador, P. and Pinto, J.K. (2015) Does Agile work?—A quantitative analysis of agile project success. International Journal of Project Management 33(5): 1040-1051.
Shariati, M., Mafipour, M., Ghahremani, B. et al. (2020) A novel hybrid extreme learning machine–grey wolf optimizer (ELM-GWO) model to predict compressive strength of concrete with partial replacements for cement. Engineering with Computers. 1-23.
Singh, S. (2012) Gamification: A strategic tool for organizational effectiveness. International Journal of Management 1(1): 108-113.
Spanellis, A., Dӧrfler, V. and MacBryde, J. (2020) Investigating the potential for using Gamification to empower knowledge workers. Expert Systems with Applications 160: 113694.
Sulaiman, MAH. and Mansor, Z. (2018) Critical success factors in agile enterprise architecture: A conceptual paper. Advanced science letters 24(7): 5220-5223.
ul Hassan, I., Ahmad, N. and Zuhaira, B. (2018) Calculating completeness of software project scope definition. Information and Software Technology 94: 208-233.
Werbach, K. and Hunter, D. (2014) Gamificación: revoluciona tu negocio con las técnicas de los juegos. Pearson Educación.
Xi, N. and Hamari, J. (2019) Does Gamification satisfy needs? A study on the relationship between gamification features and intrinsic need satisfaction. International Journal of Information Management 46: 210-221.
Zhang, H., Kitchenham, B. and Pfahl, D. (2008) Reflections on 10 years of software process simulation modeling: A systematic review. International Conference on Software Process. Springer, 345-356.