As agile methodologies take root and grow in organizations we see trends. One community corroborated trend is that organizations reduce friction during adoption if their slide decks reflect agile success measures. Quarterly review, annual budget review, annual business strategy, vision summits, all of these types of gatherings have something in common, they reflect on the measures of company success and use them to determine how the company handles money, resources, and vision. If you are pursuing agile adoption or transformation in your organization, it’s worth the time to think about your definition of success and how agile it is.
Judy I. Queue, Director of Software Quality and Compliance
Judy spends Monday afternoon compiling her team’s results within their cross-functional Scrum Teams for inclusion in the quarterly strategic review. She knows that her functional reports have embraced the agile spirit of contributing to the team as a whole instead of imposing definitions of what they will or won’t do within a team. It is her first slide deck since the new agile transformation movement and she hesitates when reconciling the quality and defect data from the agile teams with the same historic bar charts showing defects trends.
While the overall data on defects is clear, the previous bar charts don’t allow her to incorporate what she believes is the true value of the recent Agile practices, namely, that while defects increased in the short term, customer complaints about lack of features and browser compatibility have gone down. Software is launching less perfect but more quickly, resolving deeper customer needs and preventing site abandonment. The team is encouraged and motivated by the reduction in customer complaints, and even a few compliments. Its become quite a race to acquire positive customer feedback on long desired features and functionality and their determination is clear.
In addition, she is seeing a downward trend to those Agile produced defects. According to her reports, the testers and quality engineers are beginning to match pace with the developers while they are still developing. While it started uncomfortable for everyone, the teams seem to enjoy having a quality partner to ask the right questions when the ‘how’ of development is decided. She suspects that when they move into continuous integration and get more training on quality automation, those numbers will drop even further. Speed to delivery is a valuable indicator of success to her team.
The Iterative Approach
Judy believes that her version of the strategic slide deck will have a deep impact on agile transformation in the company, and that the value of the current agile implementations is real. She takes the question to her Agile Coach, Mason, who offers to walk through the agile manifesto with the goal of framing true success. They decide together that there is value in transforming what she reports each quarter but that historic data has value of the organization as well. They agree that she will show the critical historic metrics in summary and then focus the majority of her time on proposing one new strategic goal, speed to delivery, and showing how the historic data stacks against it.
She and Mason walk through the Manifesto and Judy decides that software timeliness and feature availability are part of her definition of software quality. She creates a visual radiator for Speed to Delivery vs Defects and prepares several backup slides that clearly state the value in case she needs them for discussion. She also does some homework with the product marketing team and team product owner to understand how they set feature priorities in the first place to be sure her metrics provide value to them as well.
Judy’s final slide deck causes a few waves as it circulates through the other directors for review before the quarterly strategic review. She and Mason remark that choosing one new metric, well researched and proven to give value, was a wise ice breaker. While not every stakeholder embraces her metric of speed to delivery as an indicator of success, the conversations it generates are new and vital to her colleagues. The topic of weighting delivery speed over defect counts is the most controversial. The conversation brings out the importance of product relevance to the company’s bottom line. A compromise is reached among her colleagues and the appropriate shifts in the defect versus delivery standards are updated in the quarterly strategic review slide deck. At the quarterly meeting Judy is pleased to see that a few other colleagues have taken her cue and proposed one or two additional metrics of success for their teams as well.
The Agile Manifesto, http://agilemanifesto.org/, is a flexible tool. In this case it was valuable to Judy as a way to determine what delivering value meant for her team in an agile framework. Here are a few questions Judy and Mason asked while considering her Strategic Deck.
- Individuals and Interactions – over processes and tools
- How do you represent your customer’s challenges and needs?
- Can you prove that your customer can successfully interact with your products?
- How much of your deck is about internal efficiencies vs customer momentum?
- Do you visit key customer cases? The user story behind the objective?
- Working software over comprehensive documentation
- Are your audits and their results focused on evaluating whether it works?
- Do you have metrics around documentation? Can you trace that value for the company?
- Customer collaboration over contract negotiation
- Are you measuring what your customers think of your products and services?
- Do you have certain products or services that profit more from deepening customer engagement?
- Responding to change over following a plan
- Are you measuring how deeply your customers have adopted your products?
- How does product relevance drive top line financials for my company?
Respond to Change
If your organization is in the midst of, or considering an agile transformation, be ready to respond to change in all parts of the organization. If the thought of introducing agile aligned success metrics into your Strategic Deck causes hesitation instead of excitement, it is an excellent opportunity for conversation with your agile coach and colleagues on how strategic goals and reporting can support an agile transformation.
- Are you in a transforming organization?
- Have you noticed a shift in success measures?
- Do you recognize ways they are/are not connected?