{domain:"www.qualitydigest.com",server:"169.47.211.87"} Skip to main content

User account menu
Main navigation
  • Topics
    • Customer Care
    • FDA Compliance
    • Healthcare
    • Innovation
    • Lean
    • Management
    • Metrology
    • Operations
    • Risk Management
    • Six Sigma
    • Standards
    • Statistics
    • Supply Chain
    • Sustainability
    • Training
  • Videos/Webinars
    • All videos
    • Product Demos
    • Webinars
  • Advertise
    • Advertise
    • Submit B2B Press Release
    • Write for us
  • Metrology Hub
  • Training
  • Subscribe
  • Log in
Mobile Menu
  • Home
  • Topics
    • 3D Metrology-CMSC
    • Customer Care
    • FDA Compliance
    • Healthcare
    • Innovation
    • Lean
    • Management
    • Metrology
    • Operations
    • Risk Management
    • Six Sigma
    • Standards
    • Statistics
    • Supply Chain
    • Sustainability
    • Training
  • Login / Subscribe
  • More...
    • All Features
    • All News
    • All Videos
    • Contact
    • Training

Gaming the Metrics

Use metrics to guide improvement, not measure the performance of people

Tom Pyzdek
Wed, 01/11/2012 - 13:20
  • Comment
  • RSS

Social Sharing block

  • Print
  • Add new comment
Body

One of the cornerstones of quality and lean Six Sigma is data: “We insist on it.” “Don’t tell us what you think the situation is; let the data do the talking.” “In God we trust—all others bring data.” You get the idea.

ADVERTISEMENT

An unfortunate side effect of this emphasis is the proliferation of useless data. If the useless data weren’t used, then collecting the data would merely be a waste of time. But if a person’s performance is being measured by these data, you can bet your last euro that the measurements will get a lot of attention, and it will drive a lot of behavior. And if the system doesn’t change, there’s still one way to make the measurements look better: cheat.

 …

Want to continue?
Log in or create a FREE account.
Enter your username or email address
Enter the password that accompanies your username.
By logging in you agree to receive communication from Quality Digest. Privacy Policy.
Create a FREE account
Forgot My Password

Comments

Submitted by jandell on Thu, 01/12/2012 - 19:17

Good Article

You hit the nail on the head, Tom! Are we going to use the data to whack people with, or are we going to use the numbers to help people improve and succeed? Gee, which one stands the better chance of getting us the outcomes we want? (Correct answer is: "Duh!")

  • Reply

Submitted by Ryan E. Day on Fri, 01/13/2012 - 09:33

In reply to Good Article by jandell

I spent more than 30 years of

I spent more than 30 years of my life in high volume production/maintenance both a grunt and a supervisor. In both roles I counted on such metrics to evaluate first my performance and then others'. Metrics can only be "gamed" by those in charge being as they are the ones who set the parameters of the game. As a grunt (a term I use proudly), neither I nor my fellow trench-mates, had the liberty to change any part of the metric du jour. My only option was to either find the most efficient way of doing my particular task or not. While I chose the former path, some coworkers chose "not". We didn't have the option to change either the particular item to be produced nor how many were required to meet quota. We did have direct influence over quality. As a supervisor, I still didn't have the luxury of changing volume required and my influence over quality was converted to using the available employees in the most efficient manner possible. My point is that when the discussion concerning the use of metrics in production is limited to "other than Russian production from Hell" the whole notion of gaming metrics is relegated to upper management and rarely has any bearing on the floor-level employee. We were pretty much masters of our own employment destinies.
  • Reply

Submitted by mgraban on Fri, 01/13/2012 - 15:10

Gaming

I always cite Brian Joiner who wrote in Fourth Generation Management that there are three things you can do to hit your numbers:

1) Improve the system

2) Distort the system

3) Distort the numbers

#2 and #3 are easiest in the short term, sadly. I've seen a lot of it in my career. 

Another side effect of the data talk is the unfortunate quote "If you can't measure it, you can't manage it." That's often wrongly attributed to Dr. Deming, when he taught the exact opposite - that some of the most important things in a business can't be measured.

  • Reply

Submitted by Patricia O'Rourke (not verified) on Fri, 07/13/2018 - 04:21

Exaggerating

I was NOT exaggerating. I documented FACTS. I learned use of 6 Sigma at Motorola where I worked 1989 to 2002. I presented the FACTS to managers in the quarterly quality presentations. As a safety professional I KNOW facts from fiction

  • Reply

Add new comment

Image CAPTCHA
Enter the characters shown in the image.
Please login to comment.
      

© 2025 Quality Digest. Copyright on content held by Quality Digest or by individual authors. Contact Quality Digest for reprint information.
“Quality Digest" is a trademark owned by Quality Circle Institute Inc.

footer
  • Home
  • Print QD: 1995-2008
  • Print QD: 2008-2009
  • Videos
  • Privacy Policy
  • Write for us
footer second menu
  • Subscribe to Quality Digest
  • About Us
  • Contact Us