In a previous blog, Root Causes of Project Failure, there were four root causes from research at the Institute for Defense Analyses.
In that Blog there were measures missing. Here's the details of those measures, defined in the Technical Measurement Guide. †
Since all projects operate in the presence of uncertainty, those measures need estimates before and after their use
- Before the project starts to assess the feasibility of success.
- During the project to assure the work is performed in accordance with (IAW) the plan.
- After project completion to capture and assess the lessons learned to build a reference class database for the next project.
Failure to do these actions is itself a root cause of project failure.
Key Performance Parameters
KPPs are considered the most essential for successful mission accomplishment. KPPs represent those capabilities or characteristics so significant that failure to meet the threshold value of performance can be cause for the concept or system selected to be reevaluated, or the program to be reassessed or terminated. Each KPP has a threshold and an objective value.
Trade studies typically may trade off everything, except a KPP. In other words, KPPs are non-trade-able. They flow from the operational requirements. They are documented in the Operational Requirements Document, the Capability Development Document, or the Capability Production Document.
Key System Attributes
KSAs are attributes considered most critical or essential for an effective capability but not selected as KPPs. KSAs provide decision makers with an additional level of capability prioritization below the KPP. A KSA does not have to be related to a KPP and there is no implication that multiple KSA’s equal a KPP.
Measures Of Effectiveness
MOEs are a measure of how well an operational task or task element is accomplished through using a system. The data used to measure the effect (mission accomplishment) comes from the use of the system in its expected environment.
MOEs often have green/yellow/red limits established early in the program and are tracked until they turn green or are demonstrated to be unachievable. The MOE can be stated either as a question or a declarative statement. The MOE is often stated in terms of accomplishment gained per cost incurred.
Measures of Performance
MOPs are components, or subsets, of MOEs. The degree-to-which
a system performs is one of a number of possible measures of how well
a system's task is accomplished. MOPs can be accumulated to assess an MOE that is not directly measurable. Several MOPs may be related to the achievement of a particular MOE.
MOPs supply supporting data to determine MOE status as it evolves over the life of a program. Together they determine what constitutes successful operations for the system. MOPs and MOEs are derived from requirements or the Concept of Operations. Their selection should be based on their ability to discriminate between levels of good performance.