And I totally agree with "Recommend that the evaluator not have any prior association with auditee, particularly not training or financial" if the evaluation is done outside the training. So a consultant would not certify ppl at a client site as part of some other consulting engagement.
But I'm not convinced of the practicality of doing audits.
I've been thinking about scalability. I've heard estimates of the number of CSMs minted ranging from 20K CSMs certified to 50K. If we're talking that kind of scale, as desirable as one-on-one evaluation is, I just don't see how to scale up the number of auditors to meet the demand.
Further, the cost of the evaluation would be so high that it would be a significant barrier for most companies & individuals. I believe that certification schemes succeed when people feel pressure to get a certification "because everyone else has it." If the barriers to getting it are *too* high, the certification won't catch on. And that would leave the door open for something evil to take over the market.
So I have a suggestion:
What if, like the current CSM, you get the certification by attending the class? BUT, unlike the CSM, performance in the class affects the results.
So imagine there's a 5 day class.
In class, we spend mornings on the content, and afternoons working on a realistic project.
That means they'd be writing real code to implement realistic stories in a simple enough domain. Perhaps there would be some starting code in place. The goal would be to have the project be something that any group with members who have rudimentary development skills *should* be able to succeed in delivering. Like my WordCount simulation, the complexity would not be in the system being implemented but rather in the interactions between the members implementation team.
So...if the team manages to deliver a project that meets the needs of the "customer" (played by the instructor/facilitator with standard guidelines in place for what constitutes "acceptable"), then everyone who participated in creating the final result is certified.
Active participation of some kind is mandatory. If someone consistently skips out - plays hooky - they will be warned and ultimately will be exempted from the class. One of my gov't clients does something like this: if a participant fails to show up for at least 80% of the class, they do not get "credit" for the class in their HR file.
In addition, instructors can award a "With Honors" designation to individuals who distinguish themselves. Guidelines for awarding With Honors would be based on the seven areas y'all already developed to help ensure consistency. And the record of someone's achieving Honors would include the name of the instructor who awarded it.
This suggestion has 3 important implications:
1. The team as a whole succeeds or fails. They become keenly aware that they will not be certified if they can't figure out how to work as a team. The instructor may have to coach team members who don't play well with others. But in general, the team -- whatever random collection of people end up in the class -- will have to demonstrate that they can collaborate. I expect that the vast majority of classes will succeed & be certified - and I also suspect that for some who don't know how to work well with others they will gain deep and necessary learning about how to do so that will make them better Agile developers.
2. The barriers to getting the basic certification are low, increasing the likelihood that this certification scheme will gain popularity and thus will ultimately meet the market demand for a certification.
3. There is room for individual recognition to those who deserve it, and that recognition is based on the individual's performance in a realistic situation. So, it's not as good as a one-on-one assessment, but I think it's more scalable.
Whadya think?
Elisabeth
------------------------------------------
Elisabeth Hendrickson
Quality Tree Software, Inc.