Featured Product
This Week in Quality Digest Live
Six Sigma Features
Harish Jose
How to generate an OC curve based on sample size and number of rejects
Frances Brunelle
When quality is documented and addressed, the ability to get top asking price is improved
Donald J. Wheeler
Do you know what really happens in phase two?
Anthony D. Burns
It’s overhyped and virtually of no benefit in production. The essential production tool is the control chart.
Harish Jose
Users ultimately determine the purpose of any device

More Features

Six Sigma News
Floor symbols and decals create a SMART floor environment, adding visual organization to any environment
A guide for practitioners and managers
Making lean Six Sigma easier and adaptable to current workplaces
Gain visibility into real-time quality data to improve manufacturing process efficiency, quality, and profits
Makes it faster and easier to find and return tools to their proper places
Version 3.1 increases flexibility and ease of use with expanded data formatting features
Provides accurate visual representations of the plan-do-study-act cycle
SQCpack and GAGEpack offer a comprehensive approach to improving product quality and consistency
Customized visual dashboards by Visual Workplace help measure performance

More News

Steven Ouellette

Six Sigma

Why Doesn’t SPC Work? Part 3

The chart isn't strange, it's just misunderstood.

Published: Wednesday, August 19, 2009 - 04:00

Over the past couple of articles, we have explored how an incomplete understanding of how SPC limits are calculated can lead to constructing control charts that look strange.  But using some of the things I mentioned, hopefully you can see that these “strange” control charts actually reveal quite interesting information about what is going on (and what to do about it).  In the last article I left you with a weird looking control chart to see if you could figure out what was going on in the process.  Instead of throwing out the chart and concluding that “SPC doesn’t work here,” let’s take a look at that and see what we could have learned about the process.

Here is the X-bar and R chart similar to the one I left you with last time:
 
 
Figure 1 - A Strange X-bar and R Chart

I am getting an out-of-control signal indicated by the red points on the means plot – the means are staying in the center third of the chart (within ± 1 standard error).  And yes, it is out of control, since we don’t expect to see the means that close to the centerline.  As we talked about last time, a neat thing about control charts for continuous data like these is that the limits on the means chart are calculated from the dispersion, the range in this case, not the variation of the means (or even the raw data) themselves.  So the dispersion of the means is much less than that predicted by the ranges.

Now, you could treat those means as individuals and put them on an individuals and moving range chart:
 
Figure 2 - Plot of Average Thickness as Individuals

This chart might lead you to think that the process is stable.  And in a way it is, but this may be the right answer to the wrong question.  The right question is: Why was the first chart so weird, and what does that tell us about our process?

Like the example in the last article, it has to do with the sources of variability being different between and within samples.  So I’d reason it through like this:

“Hmm, the limits on the mean chart are too wide.  Since the limits come from the average range, the average range is too large compared to the actual variation I see in the means.  So there needs to be some additional component of variability within each sample that is not present between the samples.  What could cause that?”

Depending on the process, there are different things it could be, so I asked my client how the samples were taken.  He said that once every hour they took a sample of the product at five locations across the width of an oven.  I said, “Aha!  Your product varies in thickness across the width of the oven!”  He said he didn’t know – they had never checked that, but it was possible.  I generated control charts for each of the five locations, the two edges, the two quarter points, and the center:
 
 
 
 
 
Figure 3 - X and Moving range in five different oven locations

What we actually have here is five different process streams (well, maybe three since the two quarter points and the two edges might actually be coming from the same distributions) – each location across the width of the oven is in control, but at a different mean thickness. (Notice where the averages of the means are – even without a hypothesis test we know that at least the center and edges are significantly different, since the first chart was out of control.)  When we grouped them together as a “sample,” we were unknowingly putting two components of variation in the range: the common cause variability as well as variation due to being different average thicknesses.  So while the overall average thickness across the entire oven was stable (as we can see from the averages-as-individuals chart), the range was higher than anticipated because the center tended to be thicker than the edges.  This resulted in a large average range which in turn inflated the limits on the X-bar and R chart.

(Stats geek note: Interestingly, in this case a one-way random-effects ANOVA does not signal a difference as it did for the example in the last article.  ANOVA is very powerful since it is a one-tailed test for a non-directional hypothesis, but it is based on the assumption that the within variability truly characterizes the minimum variability in the process.  So in this case, while we get a suspiciously low F-ratio of 0.188, we can’t reject the null of an ANOVA in that direction no matter how crazy low the F-ratio is.)

This turned out to be very important for the business.  The reason that they were interested in thickness is that they were stacking multiple pieces of this product into a box.  If the product was too thin, it rattled around in the box, possibly breaking the product.  If it was too thick, they couldn’t fit enough into the box to meet the minimum amount.

In the short term, they could use their knowledge of the different thicknesses to pack across the width of the oven, rather than down the length, so as to get the right amount at the right height on average.  If they needed a few thinner ones or thicker ones to round out the box, they knew exactly where to find them.  However, this involved a lot of non-value adding time spent sorting, so in the longer term, they would investigate why there was a thickness profile across the width.  By reducing or eliminating the differences, they could standardize the number per box, pack from anywhere in the oven, and reduce the size of the packaging since the overall variation was reduced.

And at this point, I hadn’t yet stepped out onto the factory floor.

If you know how to read them, those “weird-looking” SPC charts can tell you something about a process that you've never seen, something that even the people who run the process don’t know.  It's a useful and valuable skill for those, like Black Belts, that are looking to improve a process with which they are unfamiliar.

Next month, I’ll finally finish off this miniseries with a few other ways that people misinterpret what their control charts are saying or by misusing these tools.

Discuss

About The Author

Steven Ouellette’s picture

Steven Ouellette

Steven Ouellette is the Lead Projects Consultant in the Office for Performance Improvement at the University of Colorada, Boulder. He has extensive experience implementing the systems that allow companies and organizations to achieve performance excellence, as well as teaching Master's-level students the tools used in BPE. He is the co-editor of Business Performance Excellence with Dr. Jeffrey Luftig. Ouellette earned his undergraduate degree in metallurgical and materials science engineering at the Colorado School of Mines and his Masters of Engineering from the Lockheed-Martin Engineering Management Program at the University of Colorado, Boulder.

Comments

SPC Requires Normal Distributions?

As Wheeler has done such a good job pointing out, Shewhart never did say that a normal distibution is required. In fact, he used the Camp-Meidel Inequality to base his work on, which is applicable to any data stream.

And I agree with the previous comment, that one of the reasons for an SPC chart it to detect process instability, so how can you require statistical stability?

SPC works.

SPC charts are great tools, but like any other tool, one should use caution when using them.
The basic requirements for using SPC charts are that the process is statistically stable and that the data is noramlly distributed.
In the case that was presented, the later requirement is no met.
I digitized the data from the 5 location charts and found that at each location the data is normal, but when you pool the data the distribution is definitely not normal.
The fact that the population is not normally distributed doesn't mean that we can not use SPC charts. There are different ways of dealing with this type of situations and I'll be happy discuss them (if there is any interest).

Best ,
Michael Tzori

normality and the process behavior chart

In his book titled "Normality and the Process Behavior Chart", Dr. Donald Wheeler says..."Three-sigma limits are sufficiently general to use with all types of data. Therefore, we do not have to wait until our data are "normally distributed" before we use three-sigma limits. Nor do we have to transform our data to make them "more normal". So neither the computations nor the use of three-sigma limits establishes a rigid link between the process behavior chart (control chart) and the normal distribution."

Besides, SPC charts do not require the process to be statistically stable. In fact, we use them in order to know when a process is stable or is not.

Thanks for reading and

Thanks for reading and replying!

Actually GMARCH and Jose...
Dr. Wheeler is a great guy, but his ongoing notion that normality is not needed for individuals charts is dead wrong (and demonstrably so). (Of course, x-bar type charts are less sensitive to departures from normality due to the central limit theorem.) Individuals charts are highly susceptible to producing alpha error (adjusting the process when it doesn't need it) and beta error (missing a process shift when it occurs) with departures from normality.

One can sympathize with the attitude, "Ennh, well assuming normality when it really isn't is close enough, and I will take the cost hit in unnecessary adjustments and missed signals in order to avoid having to do those hard [sic] normality tests and those difficult [sic] adjustments to the chart"... if one is in the 1970's and doing hand calculations. However, with modern software, these are easy to do, so why not do it the right way and save yourself money and aggravation?

Testing for normality is ALWAYS important when you get to measuring capability, regardless of chart type since those indices are calculated on the raw data, not the random sampling distribution of the averages. (Unless, of course, your customer cares about your ability to hit specs on average - NOT!) If you didn't take distribution shape into account, you would calculate your capability indices from formulae that assume normality from an estimate of the standard deviation that itself is generated from the theoretical distribution of a dispersion statistic assuming a normal distribution! That is crazy talk! The resulting "capability" will have nothing to do with your actual ability to meet specification. (You could use process performance metrics to quantify past performance which are kind of independent of shape and state control, but you can't calculate capability, which is a statement about future performance...)

And believe me, Deming and Shewhart knew full well the dependencies of the INDIVIDUAL charts and capability indices on the assumption of normality. (My old boss and now colleague Dr. Jeff Luftig worked for Deming at Ford and he is mentioned in Out of the Crisis if you want to look it up.)

Now on to Michael's comment...

As the other comments pointed out, SPC is the tool with which we determine if a process is in control - it would be odd to require a process to be in control before using the tool to determine if it is in control! However, it is true that if the chart indicates a process is out of control, you can't predict what the process is going to do in the future, nor can you use the estimated standard deviation nor can you calculate capability indices because you have no clue as to what it is going to do next. What you CAN and SHOULD do is use the control chart to identify and eliminate the sources of unexpected variation that is throwing it out of control. (Which is another reason why when using the individuals chart it is so important to check for normality - if the process is in control and non-normal, you will end up trying to chase down and trying to fix "differences" that are actually part of the random distribution.)

As above, the central limit theorem does protect you against non-normality of the population if you are using one of the x-bar type charts (the bigger the sample size, the more non-normal the population can be). But it is easy to adjust an individuals chart for non-normality, and it is just as valid once it is. Many processes in real life are totally in statistical control and non-normally distributed, so an individuals chart adjusted for whatever non-normality you have will still give you what you want: a heuristic for determining when to react and when not to. Plus, you can calculate capability for these non-normal but in control processes.

Michael, if you re-read the article, I think you will see why the aggregate data are non-normal - it is the sum of five (or three) normal distributions with different means (so it is probably platykurtic). The correct approach is to plot each "stream" on an individuals chart (and as you say, the streams are normally distributed so we can use the default calculations for the limits). In fact, even if the aggregate data happened to pass a normality test (beta error!) we STILL would not want to put the data on an x-bar and R chart because of the out of control condition on the means indicates something weird about the sources of variation. And don't forget that we also want to continue our investigations into why there is that difference across the width.