Stop Guessing, Start Measuring

One of the most common mistakes in software project planning is using assumed or ideal numbers for team velocity and utilization. We often hear statements like:

Reality tells a different story.

What the Data Shows

Several years ago before the concepts supporting the Red Line Burndown crystalized, we were on a deep personal mission to understand what was driving inaccuracies in our ability to predict projects.  One of the first data-driven metrics that we looked at was utilization.  When we refer to utilization, we’re thinking about it in the classical project management sense – what percentage of the time are our teams actually working on the project.  We made assumptions like Software Engineers work 8 hours per day, 5 days per week. For example, if a team or individuals utilization is 80% and they work 40hrs per week, then they work 40 * 80% = 32hrs on a project each week.

The reason we chose utilization was that we thought that it would be reasonably easy to measure (assuming we could get our software engineers to track it).  At many companies, the thought track was “we’ll just have them fill out timecards.”  We knew that would likely immediately fail for all the typical reasons and instead focused on building an ecosystem that would create a closed loop project management process.

If we could track time using Jira with reasonable discipline (maybe to 10% accuracy) and share that data with the team, then perhaps we could create a system that would allow developers to learn how to create better estimates.  Initially we used rather rudimentary methods to review developer actuals (logged against Jira tasks) and over time started looking at larger datasets from many teams.  Here’s what we found…

Utilization Reality

Velocity Patterns

Why Measuring Matters

Using real data to determine velocity and utilization rates leads to:

  1. More Accurate Planning
    • Resource models based on actual performance, not optimistic guesses
    • Better prediction of project completion dates
    • Realistic capacity planning
  2. Improved Team Health
    • Sustainable pace of work
    • Reduced burnout
    • More accurate sprint commitments
  3. Better Business Decisions
    • Realistic project quotes and timelines
    • Informed staffing decisions
    • Clear capacity constraints

How to Measure Effectively

The Redline Burndown Gadget provides several key metrics:

For Story Point Projects

For Time-Based Projects

Common Pitfalls to Avoid

  1. The Utilization Myth
    • Incorrect utilization assumptions lead to burnout and decreased quality and unrealistic timelines
    • Buffer time is essential for learning, collaboration, and handling unexpected issues
  2. Ignoring Historical Data
    • Past performance is the best predictor of future performance, so start by baselining your team’s utilization or velocity
    • Team velocity stabilizes over time for a given project
    • Historical patterns reveal systemic issues
  3. Not Accounting for Context
    • Different types of work have different velocity patterns
    • Team composition affects overall productivity
    • Project phase impacts velocity (start-up vs. maintenance)

Recommendations

  1. Start Tracking Now
    • Use tools like the Redline Burndown Gadget to capture actual velocity and utilization
    • Track trends over at least 3-4 sprints
    • Review and adjust regularly
  2. Plan Conservatively
    • Start with 60% utilization for new projects (and if you’re using story points, then do some rough math over at least one quarter to determine actual velocity)
    • Use the lower end of your velocity range for initial planning
    • Build in buffer for discovered work (typically 20-30%)
  3. Communicate with Data
    • Share velocity and utilization metrics with your team and stakeholders
    • Use actual data to justify resource needs
    • Demonstrate improvement trends over time and measure the results

Conclusion

The difference between successful and struggling projects often comes down to how well they understand and use their velocity and utilization data. Stop guessing and start measuring. Your teams, stakeholders, and project outcomes will thank you.

Remember: The goal isn’t to maximize these metrics but to understand and work with them realistically. A sustainable pace based on real data leads to better quality, more predictable delivery, and healthier teams.