



© 2021 Quality Digest. Copyright on content held by Quality Digest or by individual authors. Contact Quality Digest for reprint information.
“Quality Digest" is a trademark owned by Quality Circle Institute, Inc.
Published: 06/29/2011
You’ve heard about “measuring training effectiveness” but aren’t quite sure how to do it. You’ve been filling out training attendance sheets for as long as you can recall, and they have served the purpose. So why is training effectiveness all of the sudden a topic of discussion, and what exactly is required to demonstrate it?
When it comes to assessing training effectiveness, training attendance sheets are the bare minimum. If you think about it, all they indicate is that a person attended the session on whatever topic was taught. But did he understand, comprehend, or even listen to the information? An attendance sheet attests that there was a warm body present during the training, but that’s about it. You have yet to determine if this person’s competency was enhanced by the training or if it improved his performance and really benefited his position and the organization.
If you have solely relied on training attendance sheets to measure training effectiveness, you are not alone. They have long served as the line of least resistance in many organizations. Although this may be acceptable in some cases, it should definitely not be the norm or the standard.
Many organizations started using training attendance sheets when they began their journey toward improving quality. This tactic may have been good initially, but it was definitely not meant to be a long-term solution. Think about going from 0 to 60 mph: Wouldn’t you say it’s easier, and even necessary, to go from 0 to 30 mph first and then accelerate to 60 mph? That’s how an organization with no training program at all would reason. If it establishes a training class, that’s great, and so is the attendance sheet. They are magnificent improvements over nothing but never meant to be the end of the process.
So what’s behind the sudden interest in measuring training effectiveness? Is it because the new revision of ISO 9001 will require it? Or is it because auditors are getting asked to look for it? Well, yes and yes. To revisit the speed metaphor, many companies just never left the 30 mph speed and have used training attendance sheets as a measure of effectiveness ever since. However, whatever category you think your company falls under, you should definitely consider enhancing the way you measure training effectiveness because it will indeed help your organization improve as well as obtain more out of its current training program.
Yes and no. To a certain extent, performance reviews measure training effectiveness because you can see if the employee’s performance meets the job requirements. But a performance review is a reliable training-assessment tool only if the training you provided was directly tied to enhancing the employee’s knowledge of her job. Moreover, because performance reviews are not always conducted right after training (in fact, sometimes months or years might elapse between the training and a performance review), then it is hard to tell whether a specific training class was effective in improving the employee’s performance.
But, you argue, if the performance has improved, then surely the training was effective regardless if it was conducted one month or one year ago. Not so fast. It could also be that the person learned by trial and error—i.e., after 12 months of mistakes, she has finally learned the process, and her performance is now acceptable. The problem is you might not have been aware of all those errors. They might have shown up as slow task completion, a higher rework rate, or a lower yield—none of which can be directly attributed to the specific employee. If your performance review process is robust, then you may catch this; otherwise, you might give this person high marks when in fact she was trained by accident.
There other ways to measure training effectiveness besides attendance sheets and performance reviews. They range from simple to complex, but overall, they are much better than the options presented above.
For classroom or web-based training, evaluate after the training is completed. If you’re considering web-based training, pay special attention if your software can change questions for each user. In our web-based QMS learning module, we are able to create tests with multiple questions and show each user only a portion of them; thus, each test rotates the questions being shown.
For hands-on training, require a demonstration of skills gained after the training. Hands-on training is particularly good for manual tasks and even some computer tasks. You can build this into a web-based training so that an employee must test his skills in real time as he learns them.
Pre- and post-training evaluation. This is helpful for any training, and in my view is the optimum way to measure training effectiveness. You measure what the employee knew before the training and what she knows after it. Because this method gives you a before-and-after picture, you will not only be measuring how much the employee learned but also just how good the training materials or the instructor were. This method works for both hands-on and classroom- or web-based training.
Training certificate for off-site or outsourced training. Of course, if the organization providing the training doesn’t measure training effectiveness, then a training certificate amounts to an overrated training attendance sheet. Whether there were warm bodies or zombies, everyone gets the same certificate. So this metric must take into consideration the quality of the training supplier.
Your choice depends on your organization’s processes and what best suits your company to ensure that employees retain the topics being taught. However, I urge you to pick from the enhanced methods discussed here and give training attendance sheets and performance reviews a supporting role. It’s important not to sacrifice results for complacency. You must be convinced—and have the metrics to back you up—that you are providing not only great training but also measuring how good it was. That way, both the company and its employees can improve. So don’t be shy: just pull out your evaluation test and remind everyone that it is a measurement of effectiveness that will help your company reach its goal of world-class status.
Links: