Horses for courses, how to pick your winning QA system

First presented at the NZOQ Annual Conference in Queenstown, October 2008

Horses for courses – Picking your winner when it comes to quality improvement systems

Ian Hendra, Clearline Services Ltd. Lower Hutt

 

Introduction

There are myriad systems and gizmos that you read about and even get trained in that offer to do “continual improvement” for you. ​​ Unfortunately,​​ there’s little advice about the one to back except from sales pitches. ​​ The point of this paper is to describe the history of where some of​​ the more famous systems came from and what they were trying to achieve. ​​ That way, you might have a basis upon which to choose the right one or more, of course.

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\FirstPastThePost.jpg

Starting Gate

In all organisations QA has to deal with a dilemma when it comes to where the funding comes from – and you can’t undertake any realistic continual improvement project without funding. ​​ The Venn diagram at Figure 1 shows the interrelationship between the three primary stakeholders being owners, staff and customers. ​​ The dilemma is that whilst revenue comes only from customers, staff and owners desire to share the rewards from margins added to costs. ​​ Hence funding for continual improvement represents a draw on staff remuneration and/or owners’ return on investment. ​​ So it helps to know whose interests are being served best by the various continual improvement systems around. ​​ We’ll return to this at the end of the paper.

 

The field

Let’s deal with a field of seven. ​​ There are more for sure, but these represent the main runners.

  • Lean​​ 

  • Deming & TQM

  • Zero Defects​​ 

  • Six Sigma

  • Investors in people​​ 

  • ISO 9000​​ 

  • Baldrige Business Excellence

 

Lean

First of all, you might think “Why isn’t he talking about “Lean Six Sigma”? ​​ That’s because they’re different and have different roots. ​​ We’ll cover Six Sigma later.

In 1990,​​ Womack, Jones & Roos​​ wrote a book called​​ "The Machine That Changed The World". ​​​​ The book is a history of automobile manufacturing that combines the development in Japanese, American and European assembly plants. ​​ 

They coined the phrase Lean Manufacturing to describe processes that optimised efficiency: Cell manufacturing, pull scheduling (Kanban) and 5S (Sort, Shine, Set-in-place, Standardise, Sustain) are among the tools that emerge. ​​ 

But they’re not new, they hail from Eichi Toyoda and Taichi Ohno (Toyota Production System), back through Henry Ford, through Frank Gilbreth (process charts and time & motion study), Frederic Wilmslow Taylor (standardised work) back to Eli Whitney in the 1850s and his innovation of interchangeable parts. ​​ Some say it stretches back even to ancient Rome...and it’s nothing no more than common sense.​​ 

Its target is operational efficiency.

 

Deming & TQM

Dr W. Edwards Deming remains perhaps the most influential of all when it comes to modern quality assurance systems. ​​ Born in 1900, he became a statistician, and worked for US Bureau of Statistics. ​​ Process management through performance management and reducing variation were the basis of his approach. ​​ Figure 2 sums it up.

During the 1920s he worked at Western Electric’s Hawthorne Works alongside Dr Walter Shewhart the father of Statistical Quality Control (SQC). ​​ During WW2 he taught Shewhart’s methods to US suppliers for the war effort and in 1947 went to occupied Japan with Gen MacArthur. ​​ He taught SQC (forgotten in the US by then) as the means to rebuild Japan’s decimated manufacturing industry.

Again,​​ derived from Shewhart’s work, he coined the Plan-Do-Check-Act model as the “scientific method” for continual​​ improvement​​ projects at this time. By 1951, so impressed were the Japanese with the outcomes of Deming’s work, they set up The Deming Prize and he was​​ officially​​ honoured with the equivalent of a knighthood.

In 1980 in US, NBC produced a White Paper and aired a TV show called “If Japan can…why can’t we?” that chewed over why US manufacturing was in decline whilst Japanese industry was leading the world. ​​ 

It discovered that Japan’s success was due to an almost unknown American, Dr W Edwards Deming. ​​ Deming appeared on the show and was highly critical of American management “America should export everything it can except American management!” ​​ 

In a way it was the Watergate of the day, but Deming started teaching again, using the “Red Bead Experiment”. ​​ He was already working with Nashua, but soon Ford, GM, Dow, Hughes and many more became interested. ​​ He promoted his 14 Points, the 5​​ Deadly Diseases, and the Obstacles and the seven Quality Control tools that are still taught on NZOQ’s Certificate of Quality Assurance.

1981 GOAL (The Growth Opportunity Alliance of Lawrence) was formed. ​​ “The Japanese have been using Deming techniques for 35 years but no-one was interested so none of it is in English”, so wrote Bob King, founder of GOAL. ​​ The Memory Jogger series of books was launched and with it the training necessary to underpin Deming’s work. ​​ In the background​​ too, Dr Joseph Juran’s​​ famous work on Quality Control​​ served as reference. ​​ Soon Quality Function Deployment methods came along to provide tools that would better engage senior managers and the TQM movement was alive and well. ​​ Dr Deming died in 1993. ​​ 

Once again, operational efficiency was the theme.

 

Zero Defects

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\zero-defects.jpg

During the 1970s, large companies in the automotive industry tried to cut costs by reducing their quality inspection processes and demanding that their suppliers dramatically improve the quality of their supplies. Whilst this was de rigueur in Japan and they understood how it was done, it was tiger country elsewhere. ​​ 

PhilipCrosby

In 1979 Phil Crosby, ex Quality Manager for ITT,​​ wrote “Quality is Free – how to manage quality so that it becomes a source of profit for your business”. ​​ He focussed on management failure as the principle cause of poor quality using his Quality Maturity Grid (still one of the best tools...) and a programme to facilitate improvement. ​​ 

Of particular note, he introduced the four concepts of Zero Defects as follows...​​ 

1. Quality is conformance to requirements,

2. Defect prevention is preferable to quality inspection and correction,

3. Zero Defects is the quality standard,

4. Quality is measured in monetary terms – the Price of Non-conformance (PONC), hence “Quality is Free”.

Crosby brought a down-to-earth realistic approach that contrasted with the academic morés of Deming and Juran. ​​ 

And again, operational efficiency was the theme.​​ 

 

Six Sigma

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\lean-six-sigma.png

Despite the hype and current fascination with Six Sigma as a silver bullet, there’s not much to it that wasn’t there before.

 

Developed as an in-house project by Motorola in 1987, following a takeover by Japanese interests, "six sigma” derives its name from the Gaussian distribution (bell curve) and that at​​ +/- 6 standard deviations (sigmas), only 3.4 parts in a million fall outside the limits. ​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\six-sigma-6-638.jpg

It follows that if you can reduce variation in the process so that six-sigma applies to reject levels, the process is very efficient. ​​ To get a scale here Shewhart and Deming worked on​​ +/-3 sigma​​ (99.7%) but high-quality semiconductor production is much better than six sigma and so is air travel!​​ 

The particulars of the methodology were first formulated by Bill Smith at Motorola in 1986.

Six Sigma was originally developed as a set of practices designed to improve manufacturing processes and eliminate defects, but its application was subsequently extended to other types of business processes a. ​​ 

Based heavily on a PDCA methodology called DMAIC (design, measure, analyse, improve, control) six sigma got a huge boost when Dr Jack Welch, Chairman & CEO of General Electric (GE) took it on board as a company standard. ​​ Welch attributes the influence of Six Sigma as of significance in bringing about GE’s turnaround.

The fact remains that Six Sigma was heavily inspired by six preceding decades of operational quality improvement methodologies such as quality control, TQM, and Zero Defects, based on the work of pioneers such as Shewhart, Deming, Juran, Ishikawa, Crosby, Taguchi and others.​​ 

But, once again, operational efficiency was the theme.

 

Investors in people

 

Now for something completely different. ​​ 

The Investors in People standard was written in the UK. ​​ It’s a standard for the development of people within an organisation and it too is based on a kind of PDCA methodology.

Initially it was administered through a section in the Department for Education and Employment (DfEE).​​ 

Investors in People UK was formed in 1993 to take national ownership of the Standard, protect its integrity and ensure its successful promotion and development

As demand for, and interest in, the Standard grew the section became Investors in People UK.​​ 

Although the company is, by​​ definition,​​ UK based and orientated in its operations, interest from overseas has given the Standard an international dimension, both in terms of protection and development. ​​ It has been most well received. ​​ Cranfield School of Management estimates there were about 40,000 registrations in 2008, covering 7.5 million people in the UK’s workforce. ​​ This time the focus is on people.

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\investors-in-people.png

You won’t be alone here​​ in the notion that your people are the​​ key. ​​ Builder of billion-dollar enterprises eight times over, Sir Richard Branson​​ said…

"Convention dictates that a company should look after its shareholders first, its customers next, and last of all worry about its employees. Virgin does the opposite. For us, our​​ employees matter most. It just seems common sense to me that, if you start off with a happy, well-motivated workforce, you’re much more likely to have happy customers. And in due course the resulting profits will make your shareholders happy."

 

ISO 9000

When the defence of your realm and the safety of your troops is your major concern, it’s not hard to understand that you need reliable supplies of armaments, vehicles, clothing, fuel and food. ​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\Soldiers.jpg

You need assurance that your procured​​ matériel​​ will work right first time, every time. ​​ And you don’t want to be dependent on suppliers who may be out of reach. ​​ You need to manage the tactical risks, in other words.

 

In 1969 the Allied Quality Assurance Procedures (AQAPs) appeared from work undertaken from 1955 during the Cold War by committee AC-250 of the North Atlantic Treaty Organisation (NATO). ​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\NATO.JPG

AC 250 was a committee of experts in quality assurance, and it still is; see the references for its URL. Their concern was how to assure supplies for a defence in Western Europe when the Atlantic was all but closed to shipping as it had been almost for most of WW2. ​​ Winston Churchill regarded the Battle of the Atlantic as the longest of the war and the advent of Soviet​​ nuclear-powered​​ submarines made it almost impossible to defend.​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\Officers_on_the_bridge.jpg

 

The AQAPs were all about how to select suppliers to ensure that what was wanted was actually delivered, but they focussed on the importance of ensuring that quality and safety were designed into products. ​​ NATO had learned from experience that quality and safety could not be inspected into product after it had been made.

AC 250 had made the breakthrough when they realised that effective management was the key. ​​ Accordingly, they set up a set of 20 criteria against which to assess supplier management systems. ​​ If a supplier’s systems were successfully assessed as meeting the criteria, NATO would buy from them, if they didn’t...etc, etc – simple as that. ​​ 

Taken seriously and applied properly, the criteria gave a good measure of a supplier’s capability but they stopped short of describing a specification for a full quality system: this is a point missed by supporters and detractors of ISO 9000 alike. ​​ There are three obvious reasons.​​ 

  • Quality systems are unique to each organisation, what suits in one place won’t suit in another, so there is no such thing as a common specification. ​​ 

  • It would never have been possible to assess the effectiveness of a full quality system within the time that was allowed for assessment. ​​ 

  • With national security in mind it made no sense at all to expect contractors to​​ expose their IP​​ when it came to classified designs and processes even if the external assessors were from MoD itself. ​​ 

These three constraints apply equally to ISO 9001 certification these days, of course. ​​ The time allowed for assessment is so small as to be almost meaningless in many cases, so there is almost total reliance on the client’s​​ self-declaration. ​​ Likewise,​​ for commercially sensitive information, certification body clients have a duty to their stakeholders to protect their IP.

Buzz words change but people don’t so many would call the whole ISO 9000 thing risk management and likely be unaware that NATO’s AQAP standards became BS 5750 in 1979 and ISO 9001 in 1987. ​​ Some might call it Supply Chain Management and others Project Quality Assurance and be just as unaware.

It’s notable too that from this work, the whole ISO 9000 movement grew, and with it a whole new profession concerned with quality assurance management.

Since its adoption as an international standard in 1987, ISO 9001 has become the most successful standard the world has ever seen. ​​ The 2007 ISO survey counted 951,486 certifications to ISO 9001:2000 in 175 countries, with about 20% in China. ISO 9000 is about having a closed loop management system visible to your customers. ​​​​ The following image is from ISO 9001:2015.

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\ISO9k15Fig2.jpg

 

​​ Baldrige Business Excellence

 

Howard Malcolm Baldrige Jr was Secretary of Commerce in the Reagan administration from January 1981 until his untimely death in a rodeo accident on July 25 1987; his service was one of the longest in history. ​​ He was a proponent of quality management as a key to​​ the USA’s​​ prosperity and long-term strength. ​​ He took a personal interest in the legislation that became the​​ Quality Improvement Act of 1987​​ and helped draft one of the early versions.​​ 

In recognition of his contributions, Congress named the annual award for product quality in his honour. ​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\malcom-baldrige-2.jpg

The approach taken by the Criteria for Business Excellence that bear his name is a whole business approach in which business performance is the most heavily weighted factor. ​​ The criteria are amended annually and by national business excellence “franchises” to meet national needs. ​​ Candidates apply to have their score against the criteria validated by an assessment team of peers. ​​ 

C:\Users\Ian Hendra\AppData\Local\Microsoft\Windows\INetCache\Content.Word\Baldrige+Excellence+Framework+and+Criteria+for+Performance+Excellence.jpg

In America, Baldrige Awards are under the auspices of the National Institute for Science & Technology (NIST) and awards are presented annually by the President. ​​ Here in New Zealand the criteria are under the auspices of the New Zealand Business Excellence Foundation (NZBEF) and awards are presented by the Prime Minister.

Baldrige Business excellence is the Rolls Royce, it covers the whole organisation and probably has the best potential for expediting improvement.​​ 

It stands in stark contrast to the BS5750/ISO 9001 minimalist approach adopted in the UK under the UK National Quality Campaign.

 

The Finish

 

Let’s revisit Figure 1. ​​ 

 

Figure 3 shows that only ISO 9001 comes at quality assurance from the customer’s side of the supply contract, and only Investors in People focuses exclusively on the​​ 

workforce. ​​ Only Baldrige takes the holistic view. ​​ All the rest are focussed on operational efficiency from an owner’s perspective in terms of reducing waste and improving returns. ​​ 

Maybe this gives a rationale for picking your winner;

If your customers are demanding access and visibility of your quality systems, ISO 9000 is for you, but don’t forget that just doing enough to get the certificate won’t help you and won’t impress your customers because unless you commit to it, “applying” ISO 9001 doesn’t work, although if you’re a “good business”, you’ll probably comply by default. ​​ The requirements are only the tip of the iceberg. ​​ 

There are two scenarios that make it useful. ​​ Use it if getting the certificate doesn’t matter. ​​ Use it if it helps you get work but don’t think of it as a chore. ​​ What you put in is what you get out. ​​ If it does nothing for you don’t blame the auditor or the certifier. ​​ On the other hand, if you do commit to ISO 9001, you get a closed loop quality system that enables you to hold gains made anywhere, and that’s important with respect to all the other methodologies.

If you believe your staff are your key to quality assurance then pick Investors in People. ​​ You wouldn’t be alone in taking this view. ​​ Builder of billion dollar business eight times over, Sir Richard Branson said​​ “Convention dictates that a company should look after its shareholders first, its customers second, and last of all, worry about its employees. Virgin does the opposite. For us, our employees matter most. It just seems common sense to me that, if you start off with a happy, well-motivated workforce, you’re much more likely to have happy customers. And in due course the resulting profits will make your shareholders happy.”​​ 

Next if your main concern is to improve operational efficiency and reduce variation, or in other words, get a better return on your owner’s buck, then pick from the rest. ​​ Most lead you to develop a good view of the customer’s requirements, but they work at the coal face level. ​​ And of course, they don’t work at all without staff co-operation, a closed loop management system to hold the gains and the commitment of your top management.​​ 

Finally, if you want to boost your QA system in a holistic way, use Baldrige Business Excellence Criteria, but once again note that it requires your people to cooperate, a closed loop system and management commitment.

 

Conclusions

Any of the systems described will produce improvement. ​​ Knowing where to start and how to hold the gains is important. ​​ Knowing which problem to solve first is the key. ​​ Hopefully figure three provides a route to help with that. ​​ One organisation shied away from Six Sigma and Baldrige Business Excellence. ​​ They used the ISO 9000:2000 model redrawn to emphasise PDCA, include all the primary stakeholders and link to governance areas. ​​ Then they plugged in the TQM tools (7QC & 7MP) in GOAL/QPC’s Memory Jogger II at each step and trained all their senior managers in how to use them.

But there’s a sting the tale, and a frustrating one it can be: none of these continual improvement systems and processes work unless top management wants it.

Top management commitment to the extent of providing demonstrable focussed leadership is an absolute necessity. ​​ That means they have to deliver more than smart talk (as described by Pfeffer and Sutton), they have to get in there, engage at the intellectual level and do the hard yards. ​​ David Crosby’s excellent article “What should the Quality Manager Do?” in Quality Digest from March this year made the point well. ​​ The conventional world of business doesn’t focus on QA even though ensuring the supply of deliverables at the right quality is the only reason managers are there. ​​ To many top managers QA doesn’t exist or it’s “detail” for someone else to worry about. ​​ So, if ever you hear something like “I haven’t got time for this, I’m too busy running the business” you’re in trouble, you’re dealing with a dinosaur, or someone who soon will be. ​​ One the other hand, if you get a bite and a budget go for gold but spend wisely – use figure three and find the easy gains, the “low hanging fruit”...or is that the terminology of smart talk??

 

 

References –​​ 

http://www.strategosinc.com/ ​​​​ 

The Lean Enterprise Memory Jogger – GOAL/QPC 2002

http://en.wikipedia.org/wiki/W._Edwards_Deming​​ 

“Dr Deming The man who taught the Japanese about quality” Rafael Aguayo, Mercury 1990, ISBN 1 85251085 4,​​ 

“The Deming Management Method”, Mary Walton, Penguin Group, 1988, ISBN-13: 9780399550003

The Quality Control Handbook – 3rd​​ Edition J M Juran McGraw Hill 1971 ISBN 0 07 033175 8

The Memory Jogger II GOAL/QPC 1994

http://www.philipcrosby.com/​​ 

“Quality is Free - The Art of Making Quality Certain”, Philip B Crosby, McGraw Hill, 1979, ISBN 0 07 014512 1

http://en.wikipedia.org/wiki/Six_Sigma​​ 

“Jack” Dr Jack Welch, Warner, 2001, ISBN 0 7553 1043 8

The Six Sigma Memory Jogger II GOAL/QPC 2002

http://www.investorsinpeople.co.uk/Pages/Home.aspx ​​​​ http://www.iipnz.co.nz/​​ for the IPP standard itself ​​ 

http://www.som.cranfield.ac.uk/som/dinamic-content/news/documents/iipmikebourne.pdf​​ for the Canfield report ”The Impact of Investors in People on People Management Practices and Firm Performance”

http://www.nato.int/structur/AC/250/html/english/welcomepageenglish.htm​​ 

http://en.wikipedia.org/wiki/Battle_of_the_Atlantic_%281939%E2%80%931945%29​​ 

http://en.wikipedia.org/wiki/ISO_9001​​ 

The New Requirements for Defence Procurement - MoD Procurement Directorate 1972 HMSO

The ISO 9000 family of standards is available from Standards New Zealand at​​ www.standards.co.nz

http://www.nzbef.org.nz/​​ for the criteria and how to apply them

http://en.wikipedia.org/wiki/Malcolm_Baldrige,_Jr.​​ 

http://www.baldrige.nist.gov/​​ 

“Losing my virginity - the autobiography” Richard Branson, Virgin Books 1998, ISBN 1 74051 183 2

“Business Stripped Bare - Adventures of a Global Entrepreneur” Richard Branson, Virgin Books 2008, ISBN 9780753515020

http://www.qualitydigest.com/inside/fda-compliance-column/what-should-quality-manager-do.html​​ 

“The Smart Talk Trap” - Jeffery Pfeffer & Robert I Sutton, Harvard Business Review May-June 1999

 

*************************************