Glad to share, it's always good to get wider use of techniques - that's often how improvements are made.
We run EV and ES together but typically only report on EV until it starts getting unreliable. Part of that is that I think there is some analysis that would be insightful if we can start to understand how the two systems vary throughout the project. I think the ES levels out any disparity from a large early delivery of equipment that would allow EV to show better performance that actually warranted.
We have a Recommended Practice, No. 55R-09, "Analyzing S-Curves" which mentions ES, but I'd like to collect data and discuss what insight examining both EV and ES curves yields and then get the RP updated so it fully discusses ES and the differences.
I've been kicking around the idea of submitting the Duration-Day EVM for an RP - it would get more attention that way.
Original Message:
Sent: 10-30-2024 05:28 PM
From: Kyle Palmer
Subject: The Power (and Pitfalls) of Metrics in Project Management
Chris,
Really appreciate you sharing that paper. I'm very interested in the duration-day concept, especially for projects that are nearing completion. As you mentioned, SPI becomes less and less reliable when nearing project completion and this appears to be a suitable alternative.
I'm envisioning a scenario of using standard SPI on projects up until a pre-defined project % complete is reached, at which time you can phase in the duration-day analysis. Will need to think more on that application, but appreciate you sharing this information.
Kyle
------------------------------
Kyle Palmer
Consultant
Dallas
kpalmer@k2consulting.com
Original Message:
Sent: 10-29-2024 01:27 PM
From: Christopher (Chris) Carson
Subject: The Power (and Pitfalls) of Metrics in Project Management
Kyle:
It sounds like we are in agreement, I advocate for the use of EVM on all projects, whether cost reimbursable or fixed price. I do think the difference is more related to fixed price contracts loading the price to the owner, so as you note, cost performance is less useful when Actual Costs are only a percentage of the BAC instead of a true assessment of current contractor costs.
I think you mentioned it earlier but EVM on fixed price contracts carry a risk that, if the project is running late, the schedule metrics during the final third or so of the project rapidly become unreliable so use of Earned Schedule is vital for accurate assessments. Since SV=0 and SPI = 1 at project completion, regardless of the completion date, we just can't rely on EVM in that situation.
But for me, that's a major reason why it matters if the contract is fixed price. I like using the schedule for invoicing so it forces more attention on the status.
My fellow Arcadian, Andrew Dick, and I wrote a paper using our version of EVM (loading duration-days, as we call it) that works very well on fixed price contracts and provides accurate metrics all the way to completion even if late. I've attached it, it's particularly useful if the schedule is not loaded with costs or other resources and it doesn't require a contractor to do anything in the way of loading. In our testing of the process, Andrew assigned arbitrary costs to the resources, and it seems to offer value on the cost side as well as the time side. Since the AC input to the EVMS is actual durations, the process allows for resource overruns, which means the BAC can be greater than the planned value, which emulates cost reimbursable results quite well. I've attached the paper.
Good discussion!
------------------------------
Christopher (Chris) Carson FAACE
Director of Program & Project Controls, Vice President
Virginia Beach
Chris.Carson@Arcadis.com
Original Message:
Sent: 10-29-2024 12:05 PM
From: Kyle Palmer
Subject: The Power (and Pitfalls) of Metrics in Project Management
Hi Chris,
In my experience, Earned Value can benefit project success regardless of the contract type. I've used Earned Value for cost reimbursable contracts and many fixed price contracts as well. What primarily differs between the two is the interest and engagement between the buyer and seller.
The buyer of a fixed price contract may not be interested in the cost side of Earned Value since their payment structure for the project has already been negotiated. However, they very well may have an interest in schedule performance (SPI) to gauge whether their project will be completed on time. Alternatively, the buyer of a cost reimbursable contract will often require both cost performance (CPI) and schedule performance (SPI) information since they are ultimately responsible for funding the project.
From the seller's perspective, I believe it is best practice to implement Earned Value Management regardless of the contract type. It is proven to improve project success when implemented correctly, and that's exactly what I've experienced in my past projects.
------------------------------
Kyle Palmer
Consultant
Dallas
kpalmer@k2consulting.com
Original Message:
Sent: 10-29-2024 11:34 AM
From: Christopher (Chris) Carson
Subject: The Power (and Pitfalls) of Metrics in Project Management
Kyle:
Are your contracts for which you are using earned value mostly cost reimbursable or fixed price?
------------------------------
Christopher (Chris) Carson FAACE
Director of Program & Project Controls, Vice President
Virginia Beach
Chris.Carson@Arcadis.com
Original Message:
Sent: 10-25-2024 11:00 AM
From: Kyle Palmer
Subject: The Power (and Pitfalls) of Metrics in Project Management
Hi Moj, I would very much agree with your quote above by Stephen Lesckha. In my experience as a project manager, earned value metrics are a necessary component of project success. At a basic level, earned value (EV), planned value (PV), actual cost (AC), cost variance (CV), and schedule variance (SV) can adequately summarize project progress. In my opinion, these metrics are simple enough where they can provide meaningful information to the project team regardless of the team's experience or background in Earned Value Management.
One of the more complex metrics that I've had great experience with is TCPI (To-Complete Performance Index). TCPI will tell you what CPI the project must run at to hit the current EAC. By comparing the TCPI vs past CPI performance, you can gain insight into how realistic your EAC is. For example, if the TCPI to hit your EAC is 1.1 and the project is performing at a 0.9, that project would need thorough corrective actions to improve performance and hit the EAC. If no corrective actions are in place, then the project may need to up their EAC to a more realistic target.
I completely agree with your statement above that the metrics can be misleading if interpreted incorrectly. I've experienced this in past projects and have seen the negative impact it can have. For this reason, with project teams and stakeholders that are less familiar with Earned Value Management, I always try to keep the metrics as simple as possible using EV, PV, AC, CV, and SV mentioned above. If I'm using more complex metrics, such as TCPI, I'll always give a quick disclaimer as to what the metric is and try to gauge the audience to verify whether they're understanding the interpretation.
------------------------------
Kyle Palmer
Consultant
Dallas
kpalmer@k2consulting.com
Original Message:
Sent: 09-04-2024 04:30 AM
From: Moj Kesheh
Subject: The Power (and Pitfalls) of Metrics in Project Management
Metrics are critical in project management. They help measure progress, inform decisions, and keep teams on track. However, relying on metrics alone can sometimes be misleading if not interpreted correctly. Today's quote reminds us of the importance of using metrics wisely:
Quote of the Day
"Without Metrics, You're Just Another Guy with an Opinion."
~ Stephen Leschka, Hewlett Packard
To what extent do you think metrics are essential in project management and control? Have you found them to be more helpful or misleading in your experience? Share the key metrics you have used in your projects and any insights on how they have influenced your outcomes, both positively and negatively. Let's discuss!
Thanks.
------------------------------
Moj Kesheh, PSP, FCIArb
Senior Director
Forensic & Litigation Consulting – Construction, Projects & Assets
FTI Consulting
London | United Kingdom
Moj.Kesheh@fticonsulting.com
------------------------------