Determining the correct process metrics is critical to ensuring that departments within companies meet desired goals. In Six Sigma, this is done by identifying metrics that are critical to quality (CTQ). Process leaders meet with key process stakeholders, and through various discussions about what is and is not important to stakeholders, CTQs are determined.

For example, in a software company, a CTQ might be the on-time delivery of software products. In a service company, a CTQ might be customer satisfaction or the average number of customers willing to recommend the company’s products and services to someone else. In an insurance company, a good CTQ might be the number of claims paid on time. In a restaurant, a CTQ might be the average number of empty tables during peak periods. In an airline, a CTQ might be the average number of departures and arrivals on time. Regardless of the CTQ that is determined, a baseline is established and the CTQs become key metrics that are actively monitored on a quality metrics dashboard. If a negative variance occurs in the CTQ metric relative to its baseline, some type of root cause analysis is performed to determine the cause of the variance so that the group can correct it.

While on the surface this may seem complicated, it’s really no different than driving a car to and from work. For example, suppose you are driving on a highway where the speed limit is 35 miles per hour (mph). In this case, 35 mph is the reference speed. A variation of plus or minus 5 mph (ie driving 30 or 40 mph) is acceptable; however, if your speed reaches 45 mph, then you could adjust to a slower speed to avoid getting a speeding ticket (and avoid getting into an accident). His root cause analysis determined that he was speeding because he wasn’t paying attention; therefore, he took corrective action by slowing down to match the posted speed limit. Monitoring your speed and taking corrective action happens constantly while driving to and from work or while driving your car in general. This is exactly the type of analytical process monitoring that organizations need. Feedback from checking key metrics in real time (or near real time) is what organizations use to determine if corrective action is needed.

I once led a team of software engineering product testers whose primary goal was to test the products that the software development team delivered to them. The testers believed that they were very good at finding problems with the products they received. Due to their efforts, they positively impacted the quality of our software products. When I asked them if they knew for sure that they were positively affecting the quality of the product, they said that they really felt that they were. They quantified that sentiment by, among other things, measuring the total number of defects (i.e. bugs) found during their testing cycles. If they found a lot of bugs in the products, then they felt like they were doing it right.

The good news is that they at least had a metric, but this metric does not indicate the efficiency of their testing process or the overall quality of the products they tested. For example, they weren’t measuring how many of their test cases they had to run manually versus automated. The more automation they had, the less resources were required to run the tests. At the same time, the more automation they had, the more it would indicate the repeatability of their process. They were not monitoring the percentage of test cases that passed versus those that failed, which would indicate the effectiveness of the test cases themselves. Also, they weren’t measuring how many of the bugs they found were fixed when all product testing cycles were complete, etc.

Therefore, we created a larger dashboard to track not only the outcome of the testing effort (ie, the number of bugs found per product), but also the efficiency and effectiveness of the testing effort. Going back to our car analogy, this would be equivalent to not only observing the speed at which we were driving (ie looking at the speedometer), but also included keeping an eye on the gas and oil pressure gauges.

In short, monitoring key process metrics is critical to the success of teams, departments, organizations, and businesses alike. Without relevant information, it is almost impossible to make clear business decisions based on anything other than gut feeling, a not very scientific approach to running a business! Measurement allows organizations to adapt what they do bit by bit, reducing the number of far-reaching process changes that might be needed in the long run if process metrics were not in place. If organizations don’t measure how effectively they are operating, or if they don’t measure processes in a thoughtful way, these processes are not measurably efficient. Imagine driving your car to and from work every day without a gas gauge. You would literally have to guess when it is time to refuel your vehicle. This would be even more difficult if you weren’t driving the same route every day due to detours and other road conditions that occur from time to time.

Companies need to define their “measurement dashboard” and ensure they are constantly monitoring their key quality-critical metrics for continued success.