Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Impacts of process audit review and control efforts on software project outcomes

This study examines the potential of using stage-wise process audit review and control (ARC) efforts in estimating overall effort and defects in a software project. Using archival data from 49 software projects that were based on the waterfall methodology, and obtained from a CMMI level 5 organisation, the authors found that higher ARC efforts at the requirement and build phases of a project were associated with an increase in overall project effort. Further, higher ARC efforts at the design and build phases were correlated with an increase in the number of defects delivered to the client at the end of the project. The predictive ability of the authors’ effort models was very high, with mean errors in the range of 3–4% of the overall project effort. They found that the mean ARC effort in their sample was 0.15 h/FP for the requirements stage, 0.31 h/FP for the design stage and 0.67 h/FP for the build stage. A project where the ARC effort for any of the three stages exceeded the respective benchmark, could be a candidate for deeper inspection to prevent excess effort or defects. Organisations can use their own data to develop similar benchmarks for their software project portfolios.

References

    1. 1)
      • 6. Bisi, M., Goyal, N.K.: ‘Software development efforts prediction using artificial neural network’, IET Softw., 2016, 10, pp. 6371.
    2. 2)
      • 8. Menzies, T., Koru, G.: ‘Predictive models in software engineering’, Empir. Softw. Eng., 2013, 18, pp. 433434.
    3. 3)
      • 7. Madeyski, L., Jureczko, M.: ‘Which process metrics can significantly improve defect prediction models? An empirical study’, Softw. Qual. J., 2015, 25, pp. 393422.
    4. 4)
      • 25. Lambert, D.: ‘Zero-inflated Poisson regression, with an application to defects in manufacturing’, Technometrics., 1992, 34, pp. 114.
    5. 5)
      • 38. Sutherland, J., Jakobsen, C.R., Johnson, K.: ‘Scrum and CMMI level 5: the magic potion for code warriors’. HICSS, Hawaii, 2008, p. 9.
    6. 6)
      • 18. Wong, W.E.: ‘Special section on software quality assurance: research and practice’, IEEE Trans. Reliab., 2016, 65, pp. 33.
    7. 7)
      • 17. Codabux, Z., Williams, B.J., Bradshaw, G.L., et al: ‘An empirical assessment of technical debt practices in industry’, J. Softw.: Evol. Process, 2017, 29, p. e1894.
    8. 8)
      • 1. Papatheocharous, E., Bibi, S., Stamelos, I., et al: ‘An investigation of effort distribution among development phases: a four-stage progressive software cost estimation model’, J. Softw.: Evol. Process, 2017, 29, pp. 1940.
    9. 9)
      • 4. Savolainen, P., Ahonen, J.J., Richardson, I.: ‘Software development project success and failure from the supplier's perspective: A systematic literature review’, Int. J. Proj. Manage., 2012, 30, pp. 458469.
    10. 10)
      • 33. Chari, K., Agrawal, M.: ‘Impact of incorrect and new requirements on waterfall software project outcomes’, Empir. Softw. Eng., 2018, 23, pp. 165185.
    11. 11)
      • 31. Menzies, T., Yang, Y., Mathew, G., et al: ‘Negative results for software effort estimation’, Empir. Softw. Eng., 2017, 22, pp. 26582683.
    12. 12)
      • 22. Harter, D.E., Krishnan, M.S., Slaughter, S.A.: ‘Effects of process maturity on quality, cycle-time and effort in software product development’, Manage. Sci., 2000, 46, pp. 451466.
    13. 13)
      • 2. Flyvbjerg, B., Budzier, A.: ‘Why your IT project may be riskier than you think’, Harv. Bus. Rev., 2011, 89, (9), pp. 601603.
    14. 14)
      • 39. Thomke, S., Bell, D.E.: ‘Sequential testing in software development’, Manage. Sci., 2001, 47, pp. 308323.
    15. 15)
      • 12. Ramasubbu, N.: ‘Governing software process improvements in globally distributed product development’, IEEE Trans. Softw. Eng., 2014, 40, pp. 235250.
    16. 16)
      • 16. Sabbagh, A., Walid, K., Gren, L.: ‘The connections between group maturity, software development velocity, and planning effectiveness’, J. Softw.: Evol. Process, 2018, 30:e1896. https://doi.org/10.1002/smr.1896.
    17. 17)
      • 3. Bloch, M., Blumberg, S., Laartz, J.: ‘Delivering large-scale IT projects on time, budget, and on value’ (McKinsey on Business Technology, USA, 2012), pp. 27.
    18. 18)
      • 35. Schulz, T., Radlinski, Ł., Gorges, T., et al: ‘Predicting the flow of defect correction effort using a Bayesian network model’, Empir. Softw. Eng., 2013, 18, pp. 435477.
    19. 19)
      • 37. Fenton, N., Neil, M., Marsh, W., et al: ‘On the effectiveness of early life cycle defect prediction with Bayesian nets’, Empir. Softw. Eng., 2008, 13, pp. 499537.
    20. 20)
      • 11. Krishnan, M.S., Kriebel, C.H., Kekre, S., et al: ‘An empirical analysis of productivity and quality in software products’, Manage. Sci., 2000, 46, pp. 745759.
    21. 21)
      • 30. Belsley, D.A., Kuh, E., Welsch, R.E.: ‘Regression diagnostics: identifying influential data and sources of collinearity’ (John Wiley & Sons, New York, 1980).
    22. 22)
      • 32. Cinnéide, M.Ó., Moghadam, I.H., Harman, M., et al: ‘An experimental search-based approach to cohesion metric evaluation’, Empir. Softw. Eng., 2017, 22, pp. 292329.
    23. 23)
      • 24. Khoshgoftaar, T.M., Gao, K., Szabo, R.M.: ‘An application of zero-inflated Poisson regression for software fault prediction’. Proc. of the 12th Int. Symp. on Software Reliability Engineering, Hong Kong, 2001.
    24. 24)
      • 26. Agrawal, M., Chari, K.: ‘Software effort, quality and cycle-time: a study of CMM level 5 projects’, IEEE Trans. Softw. Eng., 2007, 33, pp. 145156.
    25. 25)
      • 23. Bell, R.M., Ostrand, T.J., Weyuker, E.J.: ‘The limited impact of individual developer data on software defect prediction’, Empir. Softw. Eng., 2013, 18, pp. 478505.
    26. 26)
      • 10. Harter, D.E., Slaughter, S.A.: ‘Quality improvement and infrastructure activity costs in software development: a longitudinal analysis’, Manage. Sci., 2003, 49, pp. 784800.
    27. 27)
      • 5. Li, Z., Jing, X.-Y., Zhu, X.: ‘Progress on approaches to software defect prediction’, IET Softw., 2018, 12, pp. 161175.
    28. 28)
      • 14. Nidumolu, S.R.: ‘Standardization, requirements uncertainty and software project performance’, Inf. Manage., 1996, 31, pp. 135150.
    29. 29)
      • 13. Duarte, C., Henrique, C.: ‘Productivity paradoxes revisited: assessing the relationship between quality maturity levels and labor productivity in Brazilian software companies’, Empir. Softw. Eng., 2017, 22, pp. 818847.
    30. 30)
      • 19. Rogstad, E., Briand, L.: ‘Clustering deviations for black box regression testing of database applications’, IEEE Trans. Reliab., 2016, 65, pp. 418.
    31. 31)
      • 15. Software Engineering Institute.: ‘Capability maturity model integration (CMMI) version 1.1’, Software Engineering Institute, Pittsburgh, PA, August 2002.
    32. 32)
      • 27. McDonald, J.H.: ‘Handbook of biological statistics’ (Sparky House Publishing, Baltimore, Maryland, 2014, 3rdEdn.).
    33. 33)
      • 20. Ilyas, M., Khan, S.U.: ‘Software integration in global software development: challenges for GSD vendors’, J. Softw.: Evol. Process, 2017, 29, p. e1875.
    34. 34)
      • 9. Menzies, T., Krishna, R., Pryor, D.: ‘The promise repository of empirical software engineering data’, Available at. http://openscience.us/repo.
    35. 35)
      • 29. Anderson, T.W., Darling, D.A.: ‘A test of goodness of fit’, J. Am. Stat. Assoc., 1954, 49, pp. 765769.
    36. 36)
      • 36. Radlinski, Ł., Fenton, N., Neil, M.: ‘A learning Bayesian net for predicting number of software defects found in a sequence of testing’, Pol. J. Environ. Stud., 2008, 17, pp. 359364.
    37. 37)
      • 21. Ali, N., Lai, R.: ‘A method of requirements elicitation and analysis for global software development’, J. Softw.: Evol. Process, 2017, 29, p. e1830.
    38. 38)
      • 28. White, H.: ‘A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity’, Econometrica, 1980, 48, pp. 817838.
    39. 39)
      • 34. Rempel, P., Mäder, P.: ‘Preventing defects: the impact of requirements traceability completeness on software quality’, IEEE Trans. Softw. Eng., 2017, 43, pp. 777797.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-sen.2019.0185
Loading

Related content

content/journals/10.1049/iet-sen.2019.0185
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address