A-P06 · TOPIC · resilience-metricsGRA dossier · service level R0
GRAFinancial Cyber and Operational ResilienceIn development
Topic dossier · Financial Cyber and Operational Resilience

Resilience metrics

Boards and supervisors want to know whether resilience is improving. Metrics such as outage duration, recovery time against tolerance, incident counts and control effectiveness help, but each can mislead. This page sets out which resilience metrics exist, what they show and hide, how they are collected, and who decides how they are used.

01In brief

The short answer.

Operational resilience metrics are measures used to judge whether a financial firm's resilience is adequate and improving, such as time beyond tolerance, customer-impacting incidents, availability, patch latency and control effectiveness. Each can mislead alone. Boards, risk officers, supervisors and internal audit decide how they are used.

02Spatial finance

Settlement dependencies, and what fails with a node.

How a failure at one financial centre can spread through settlement links. Design links, not real dependencies.

Sixteen financial centres, and how a failure at one spreads through settlement links.Design links, not the real dependencies of any infrastructure.
03Console

Important business services, in outline.

The working screen behind this subject: its structure, terms and states. Names are placeholders and values illustrative.

Important business services

Resilience metrics · Bank B services · Self-assessment 2

One service outside toleranceGRA · Financial Cyber and Operational Resilience

Services vs impact tolerance

Make a payment31Cloud region lossOutside
Access cash1915Cyber attackWithin
Mortgage servicing6347Data centre lossWithin
Claims payment2746Third-party failureOutside

Dependency map

people · process · technology · third parties

Remediation

  1. R-1Second claims platform supplierExit plan tested168 d
  2. R-2Immutable backups for paymentsCyber recovery113 d
Important business services: the screen's structure, terms and states for Resilience metrics.Placeholder names and illustrative values; a design, not a record or a live system.
04The question

Resilience metrics: how the risk develops.

Tolerances, metrics and measurement limits. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanism

Counts reward under-reporting

Incident counts fall when detection is weak or definitions narrow. A falling count can mean worse visibility, not better resilience.

Mechanism

Averages hide the tail

Average recovery time can look good while the worst incidents, which matter most, take far longer.

Mechanism

Outcome metrics matter most

Measures tied to services, such as customer impact and time beyond tolerance, connect resilience to harm better than technical uptime.

Mechanism

Leading and lagging indicators

Lagging measures show past incidents; leading measures such as patch latency and test coverage show exposure before failure.

05Key terms

Terms used on this page.

Each term as this page uses it. Where a standard-setting body defines the term, the wording follows that body.

TermDefinition
Lagging indicatorA measure of past outcomes, such as incidents that have already occurred.
Leading indicatorA measure of current exposure that warns of possible future failures.
Time beyond toleranceThe time a service was disrupted beyond its impact tolerance.
06Indicators

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Time beyond impact tolerancehours per service per yearannualIncident recordsREPORTED
Customer-impacting incidentscount and customers affectedannualIncident recordsREPORTED
Service availabilitypercent of operating timemonthlyMonitoringOBSERVED
Patch latency for critical vulnerabilitiesdaysmonthlyVulnerability managementOBSERVED
Test coverage of important servicesshare tested in the yearannualTest recordsDECLARED
Control effectiveness ratingsshare of key controls rated effectiveannualControl testingDECLARED
07Canvas

From sources to decisions.

The topic as a computational graph: named sources feed the methods, an evidence review gates the outputs, and the decisions stay with the authorities that hold them.

Pipeline canvas · Resilience metrics as a run graphDesign, not a record
Resilience metrics: incident response across CSF 2.0 functionsAn adverse event is detected and triaged; response analyses, contains and communicates; recovery restores services from clean backups; improvement and governance close the loop with lessons and reporting. Design of the process, not a record of a run.

Fig. 02Nodes carry their type, two metric rows and a state; connectors show what feeds what; dashed frames name the owners; the timeline is the cadence. Design of the pipeline, not a record of a run.

08Sources

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

SourceWhat it givesLicence class
UK operational resilience self-assessment requirementsExpectations for documenting and measuring resilienceFree, Bank of England and FCA terms
BCBS operational risk loss data standardsLoss data collection for banksFree, BIS terms
ORX operational risk loss data consortium publicationsAggregated operational loss dataMembers only; public summaries free to read
NIST Cybersecurity Framework 2.0 measurement guidanceMeasuring cybersecurity outcomesPublic domain
Supervisory feedback on resilience metricsObservations on firms' metricsFree, terms per supervisor
09Decisions

Who decides, and what the evidence serves.

Financial Cyber and Operational Resilience prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Who decidesThe questionEvidence this page serves
Boards and risk committeesWhich metrics to monitor and what thresholds trigger actionMetric definitions and history
Chief risk officersHow to combine metrics into a view of resilienceData quality and coverage evidence
SupervisorsWhich metrics to request and compareFirm submissions and sector data
Internal auditWhether metrics are accurate and completeData lineage and controls

Outputs this topic produces

  • Guide to resilience metrics and their pitfalls
  • Method note on service-based outcome measures
  • Brief on leading and lagging indicators
  • Questions for boards reading resilience dashboards
10Core questions

What measurement asks.

  • What is the maximum tolerable disruption for each important service, expressed in time, volume or harm?
  • Which indicators give early warning that a service is drifting towards its tolerance?
  • How can resilience be compared across firms or over time without creating misleading rankings?
  • Which aspects of resilience resist measurement, and how are they assessed instead?
  • How should metrics account for dependencies on providers whose performance the firm cannot observe directly?
11Mechanisms

What metrics can and cannot show.

Metrics are most useful as prompts for questions rather than as verdicts. A recovery time that improves while the dependencies behind it grow more concentrated is not a real improvement.

Tolerances

Defining harm

Tolerances translate harm to customers and markets into measurable limits.

Indicators

Leading and lagging

Lagging metrics record what happened; leading indicators try to signal trouble ahead.

Limits

Goodhart's law

When a measure becomes a target, it can be managed at the expense of the outcome it was meant to track.

12Methods and limits

Approaches to measurement.

  1. 01

    Recovery time and point objectives

    Targets for how fast systems recover and how much data may be lost. Limits: system targets may not reflect service outcomes.

  2. 02

    Service-level tolerance tracking

    Measuring disruption against tolerances in tests and incidents. Limits: incidents are rare, so evidence is limited.

  3. 03

    Dependency concentration indicators

    Measures of reliance on shared providers, using network science. Limits: describe exposure, not likelihood.

  4. 04

    Qualitative maturity assessment

    Structured judgement of capabilities, informed by resilience engineering. Limits: subjective and prone to optimism.

13Methods

How it is studied, and what the methods cannot say.

  1. Reliability and resilience engineeringService and dependency mapping · Recovery strategy comparison · Learning reviewsApplied here
  2. Network science and contagionSector dependency maps · Outage propagation · Software component networksApplied here
  3. Cybersecurity and cryptographyIdentity and privileged access · Detection and response capability · Threat-led testingApplied here
14Questions

Questions and answers.

Is availability a good resilience metric?
It is useful but incomplete; high average availability can hide long outages of important services and says nothing about data integrity.
What is time beyond tolerance?
The time a service was disrupted beyond its impact tolerance, a direct measure of whether resilience objectives were met.
What are leading indicators of resilience?
Measures of exposure before failure, such as patch latency, test coverage and single points of failure, that warn before incidents occur.
Can resilience be reduced to a single score?
No. Single scores hide important differences and invite gaming. A set of measures plus judgement is more informative.
Does the platform publish resilience rankings?
No. GRA does not rate or rank firms.
What is an impact tolerance?
The maximum level of disruption to an important business service that a firm judges tolerable, usually expressed as a time limit.
Why do common definitions matter?
Because without them, supervisors and the industry cannot compare evidence across firms or aggregate it to see sector-wide exposure.
Financial Cyber and Operational Resilience

Bring your expertise to this field.

The current service level is R0: information and enquiries. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

Skip to toolbar