Quality Metrics and the Way to Continual Improvement and Business Continuity

Recommendation

16/17 May 2023

Quality Oversight - Live Online Training
Supervision of the Pharmaceutical Quality System: Challenges and Opportunities

In 2015 the US Food and Drug Administration (FDA) had started an initiative in order to use so-called quality metrics for the planning of their risk-based inspections. The FDA wishes that, after it has come into force, manufacturers will convey defined quality scores to the FDA via an electronic portal. The FDA will use these to calculate specific statistics which are supposed to allow for risk-based management and planning by the FDA. Read more about the curent status of the Quality Metrics Initiative that started with a voluntary Phase. 

But Quality Metrics are not new. And they are useful!

Quality Metrics have already been used in pharmaceutical industry for years - mainly internally to measure operational performance. But quality can be measured on different levels and for many processes. Done in the right way, Quality Metrics can enable companies to reach a high quality performance. They will benefit from a continuous improvement in both operational performance and GMP compliance. And both are important for the continuity of business and product supply.

Let's start with some definitions:

• Metric: a measure against a standard (standards of measurement by which efficiency, performance, progress, or quality of a plan, process, or product can be assessed)
• Indicator: provides indication of performance (qualitative or quantitative), e.g., to evaluate success of an organisation or activity
• KPI: key performance indicator; target critical areas of performance (not all indicators are key)

They all should help to develop, collate and analyse information that provides current performance feedback, anticipates future needs and enables actions. For this, data must be accurate, timely appropriate, correctly analysed and meaningful.

So the following  points should be considered when developing Metrics and KPI's.

• Quantitative vs. qualitative data
• Normally data is required to be SMART (Specific Measurable Accepted Realistic Time Bound) although data "for information" can be useful, especially when starting, to establish a baseline
• Measure product specific/operational quality performance, the performance of the overall quality system and Quality Culture
• Adequate indicators to show compliance with regulations
• Only a few selected KPIs for senior management, more for local management
• Measure performance(s) in all areas with resources invested for quality activities
• Quality metrics and KPIs which should be common across global sites and offices to allow visual information and data sharing

And where are the pitfalls?

• Too many metrics, complex and time-consuming
• Driving wrong behaviours and actions can lead to unintended consequences in order to achieve metrics target
• Actions without understanding the context surrounding the results
• Not all have same value - determine the crucial few!    
• Metrics alone will not deliver. Metrics not meeting targets should lead to actions

The outputs of process performance and product quality monitoring are the key for continual improvement. The necessary changes can be identified, introduced, monitored and controlled to continually improve processes and systems.

In the end Quality Metrics will enable companies and regulators to benefit from a continuous investment in GMP to guarantee a high quality performance and the continuity of quality product supply.

Source: presentation by Ann McGee, McGee Pharma International, Ireland at the ECA event Quality Metrics to foster Continual Improvement