Interpreting the CMMI (R): A Process Improvement Approach, Second Edition

This appendix contains a list of metrics that your organization can consider using. For more information, review Chapter 17.

Level 2

Requirements Management

1. Requirements volatility (percentage of requirements changes)

2. Number of requirements by type or status (defined, reviewed, approved, and implemented)

3. Cumulative number of changes to the allocated requirements, including total number of changes proposed, open , approved, and incorporated into the system baseline

4. Number of changes requests per month, compared to the original number of requirements for the project

5. Number of time spent, effort spent, cost of implementing change requests

6. Number and size of change requests after the Requirements phase is finished

7. Cost of implementing a change request

8. Number of change requests versus the total number of change requests during the life of the project

9. Number of change requests accepted but not implemented

10. Number of requirements (changes and additions to the baseline)

Project Planning

11. Completion of milestones for the project planning activities compared to the plan (estimates versus actuals)

12. Work completed, effort expended, and funds expended in the project planning activities compared to the plan

13. Number of revisions to the project plans

14. Cost, schedule, and effort variance per plan revision

15. Re-planning effort due to change requests

16. Effort expended over time to manage the project compared to the plan

17. Frequency, causes, and magnitude of the re-planning effort

Project Monitoring and Control

18. Effort and other resources expended in performing monitoring and oversight activities

19. Change activity for the project plan, which includes changes to size estimates of the work products, cost estimates, resource estimates, and schedule

20. Number of open and closed corrective actions or action items

21. Project milestone dates (planned versus actual)

22. Number of project milestone dates made on time

23. Number and types of reviews performed

24. Schedule, budget, and size variance between planned versus actual reviews

25. Comparison of actuals versus estimates for all planning and tracking items

Measurement and Analysis

26. Number of projects using progress and performance measures

27. Number of measurement objectives addressed

Supplier Agreement Management

28. Cost of the COTS (commercial off-the-shelf) products

29. Cost and effort to incorporate the COTS products into the project

30. Number of changes made to the supplier requirements

31. Cost and schedule variance per supplier agreement

32. Costs of the activities for managing the contract compared to the plan

33. Actual delivery dates for contracted products compared to the plan

34. Actual dates of prime contractor deliveries to the subcontractor compared to the plan

35. Number of on-time deliveries from the vendor, compared with the contract

36. Number and severity of errors found after delivery

37. Number of exceptions to the contract to ensure schedule adherence

38. Number of quality audits compared to the plan

39. Number of senior management reviews to ensure adherence to budget and schedule versus the plan

40. Number of contract violations by supplier or vendor

Process and Product Quality Assurance (QA)

41. Completions of milestones for the QA activities compared to the plan

42. Work completed, effort expended in the QA activities compared to the plan

43. Numbers of product audits and activity reviews compared to the plan

44. Number of process audits and activities versus those planned

45. Number of defects per release or build

46. Amount of time/effort spent in rework

47. Amount of QA time/effort spent in each phase of the life cycle

48. Number of reviews and audits versus number of defects found

49. Total number of defects found in internal reviews and testing versus those found by the customer or end user after delivery

50. Number of defects found in each phase of the life cycle

51. Number of defects injected during each phase of the life cycle

52. Number of noncompliances written versus number resolved

53. Number of noncompliances elevated to senior management

54. Complexity of module or component (McCabe, McClure, and Halstead metrics)

Configuration Management (CM)

55. Number of change requests or change board requests processed per unit of time

56. Completions of milestones for the CM activities compared to the plan

57. Work completed, effort expended, and funds expended in the CM activities

58. Number of changes to configuration items

59. Number of configuration audits conducted

60. Number of fixes returned as "Not Yet Fixed"

61. Number of fixes returned as "Could Not Reproduce Error"

62. Number of violations of CM procedures ( noncompliance found in audits)

63. Number of outstanding problem reports versus rate of repair

64. Number of times changes are overwritten by someone else (or number of times people have the wrong initial version or baseline)

65. Number of engineering change proposals proposed, approved, rejected, implemented

66. Number of changes by category to code source, and to supporting documentation

67. Number of changes by category, type, and severity

68. Source lines of code stored in libraries placed under configuration control