Quality Metrics, KPIs & Working Under SLA

Every earlier lesson in this module covered QC, the PVQS, and CAPA as processes. This lesson covers the numbers those processes actually produce — because in most PV operations teams, whether at a CRO or in-house, day-to-day performance isn’t judged narratively. It’s judged against a small set of tracked metrics, and understanding what they mean and how they’re built is part of being operationally ready, not just theoretically correct.

The two metrics that dominate are case quality score and on-time submission compliance. A commonly cited industry target is a quality score above 95%, with minimal rework or resubmission required — built directly from QC findings on individual cases, so every QC comment from the earlier lessons in this module isn’t just feedback, it’s a data point rolling up into a team-level number. On-time compliance targets effectively 100% adherence to regulatory submission deadlines, and it’s tracked because the real-world baseline genuinely isn’t perfect: EMA’s own EudraVigilance Annual Report recorded 94.9% compliance with the 15-day expedited ICSR reporting requirement in 2017 — a reminder that hitting the clock consistently takes active management, not just knowing the rule exists.

Deviations that pull these numbers down tend to cluster into a few recognizable categories: late case submissions, seriousness misclassification, and narrative inconsistencies — for example, a structured field marking a patient as female while the narrative text describes a male patient, a mismatch QC is specifically trained to catch. Each of these is usually a coachable, specific habit rather than a random error, which is exactly why CAPA (covered earlier in this module) treats a pattern of deviations as something to fix systemically rather than case by case.

These metrics get made visible through dashboards — built in tools like Tableau or Power BI, often sitting on top of a quality management system like Veeva QMS or Sparta TrackWise — tracking case timelines, overdue submissions, audit findings, and CAPA progress in one place. That’s the same operational picture a QPPV or auditor reviews when assessing whether a PV system is genuinely working, not just documented as working — tying this lesson directly back to the PSMF and audit content earlier in this module.