All too often the topic of fixing dirty data is neglected in the plethora of online media covering artificial intelligence (AI), data science, and analytics. This is wrong for many reasons.
Last month we looked at analyzing observational data. Here we will consider experimental data and discover a weakness in the way they are obtained that can contribute to
Do you ever feel like you’re spending money like crazy on marketing and getting little or nothing in return? If so, you might be tempted to pull the plug on marketing altogether. That would be a big mistake.
"Establishing a timeline" Credit: WRme2
Most of the world’s data are obtained as byproducts of operations. These observational data track what happens over time and have a structure that requires a different approach to analysis than that used for experimental data.
I’m a chemical engineer. The fundamentals of the chemical engineering profession were laid down 150 years ago by Osborne Reynolds.
On the face of it, it seems to be impossible for skewed variables to add up to a normally distributed result. Yet both common experience and mathematical theory combine to show us that this does indeed happen.
Management requires prediction. However, when making predictions it is easy to torture the data until they surrender and tell you what you expect to hear.
In the 1950s, Eizaburo Nishibori, a member of JUSE, and Sigeiti Moriguti of Tokyo University invited W. Edwards Deming to lecture on statistical methods for business in a session sponsored by the Keidanren, the most prestigious society of Japanese executives, under the leadership of its chairman, Ichiro Ishikawa (also president of JUSE).
Credit: The Deming Institute
Editor’s note: The following is from a transcript of a forgotten speech given in Tokyo in 1978 by W. Edwards Deming for the Union of Japanese Scientists and Engineers (JUSE). Because the original was a poor photocopy, there are small portions of text that could not be transcribed.
One of the most common questions about any production process is, “What is the fraction nonconforming?” Many different approaches have been used to answer this question.