Agile assessment metrics for organization

Why is assessment needed?

Assessment is important to design an approach for agile adoption and helpful for organizations to measure effectiveness. The purpose should be to identify improvement areas and should evolve over the period. But many times organizations have to prepare a budget for agile adoption in advance to get approval for expenses from the board. They engage vendors to perform assessments to estimate costs.

There is no harm in doing it as long as the vendor act as facilitator than judge. Although I personally believe that need of agility should get established before assessment start so result get aligned with need. Only assessment may not help in understanding reality at ground.

Arguments given in support of assessment always get liked with estimation of implementation cost. Some estimate needed for budgetary approval if organization culture demands. Another argument is to design customized training, coaching and mentoring based on reality as every organization culture is different.

How to design an assessment?

What will be the parameters for assessment? I believe at the highest level, the Assessment approach should assesses agility on four dimensions:

• Revenue of an organization (Top Level)
• Operating cost of an organization (Bottom Level)
• Customer satisfaction (CSAT)
• Employee Satisfaction (ESAT)

Every further assessments must be linked with above dimensions. Assessment should be helpful in identifying improvement areas (one time/ continuous). Must be owned by leaders and team collectively. Facilitators should help to assess by innovative ideas. Another area needed attention is the way of collecting data. Data should get generate automatically by creative sessions, games and activities etc.   

How these assessments can be designed pointing back to above four dimensions?

Enterprise Agility (Top Line, Bottom Line, CSAT, ESAT) – culture, structure, transparency, learning, innovation and social

Suggested activities – Causal loop diagram, Impact Mapping, Skilled Facilitator workshop and some game related to context switching, queueing theory etc.

Business Agility (Top Line, CSAT) – customer engagement, collaboration, time to market, service and revenue

Suggested activities – Impact mapping, game for time to market, empirical process control and prioritization etc.

Team Agility (Bottom Line, ESAT) – team building, automation, innovation, technical Excellency, learning and sharing

Suggested activities – Game related to 5 dysfunctions of team, working without titles, test first vs code first, emergent design and value stream mapping etc.

Samples metrics that can be further modified based on organization culture.

Team Agility:-

1. Team is meeting daily to assess progress
2. Team members trust on each other
3. Team owns success and failure as team
4. Team owns code collectively and not individually
5. Team members estimate PBIs collectively
6. Everyone in team has gone through basic agile workshop
7. Everyone agreed to work in self-managing team
8. Everyone understand the value of collaboration
9. Team conducting regular retrospective to improve processes
10. Team care about whole product and not just individual goal

Business Agility:-

1. Everyone from team joining Product Backlog Refinement
2. Business representative attending Refinement Session
3. PBIs are ready for development prior to development start
4. Business representative available for clarification whenever team wanted
5. Business representative joins Planning session
6. Team always define clear goal for development during Planning
7. Business representative understand cost of rework
8. Business representative care about cost of delay
9. Business representative measure time to market
10. Business representative prioritize PBIs based on business value

Technical Practices and Quality:-

1. Team has adopted Continuous Integration practices
2. Team write unit test before writing code
3. Team practice pair programming and peer review
4. Team automate test for regression and integration testing
5. Team is focusing on continuous delivery
6. No of defects per story
7. First time right
8. release Rollback
9. Cycle time for defects/ production change
10. Lead time for defects/ production change

Culture and Knowledge creation:-

1. Investment on learning
2. Culture sanitization program
3. Transparency in performance appraisal
4. Transparency in promotion
5. Reduction of roles
6. Time for innovation
7. Promoting innovative ideas
8. Platform to share knowledge
9. Building leadership
10. Removing fear

Need help in assessment? Reach out to us at connect@agilemania.com.