In 2015 the US Food and Drug Administration (FDA) had started an initiative in order to use so-called quality metrics for the planning of their risk-based inspections. The FDA wishes that, after it has come into force, manufacturers will convey defined quality scores to the FDA via an electronic portal. The FDA plans to use these to calculate specific statistics which are supposed to allow for risk-based management and planning by the FDA. The Quality Metrics Initiative then started with a voluntary phase and a revised draft guidance was published in November 2016. However after this it became a little quite. Since the initiative started, a lot of feedback was given by industry; they feared additional efforts and expenses.
In 2018 FDA announced two updated programmes: the Quality Metrics Feedback Program and the Quality Metrics Site Visit Program. FDA now also wants to focus on the benefits for industry, saying that with implementing a quality measurement program, "companies improve their overall quality systems" and finally product quality.
And FDA is right: Quality Metrics are useful and beneficial!
Quality Metrics have already been used in pharmaceutical industry for years - mainly internally to measure operational performance. But quality can be measured on different levels and for many processes. Done in the right way, Quality Metrics can enable companies to reach a high quality performance. They will benefit from a continuous improvement in both operational performance and GMP compliance. And both are important for the continuity of business and product supply.
Let's start with some definitions:
They all should help to develop, collate and analyse information that provides current performance feedback, anticipates future needs and enables actions. For this, data must be accurate, timely appropriate, correctly analysed and meaningful.
So the following points should be considered when developing Metrics and KPIs:
And where are the pitfalls?
The outputs of process performance and product quality monitoring are the key for continual improvement. The necessary changes can be identified, introduced, monitored and controlled to continually improve processes and systems,
In the end Quality Metrics will enable companies and regulators to benefit from a continuous investment in GMP to guarantee a high quality performance and the continuity of quality product supply.
Source: presentation by Ann McGee, PharmaLex Ireland, at the ECA event KPIs and Quality Metrics