A-P06 · TOPIC · operational-resilience-testiGRA dossier · service level R0
GRAFinancial Cyber and Operational ResilienceIn development
Topic dossier · Financial Cyber and Operational Resilience

Operational resilience testing

Testing shows whether resilience plans hold. Firms run severe but plausible scenario tests against impact tolerances, failover and restore tests, threat-led red-team exercises and joint exercises with peers and authorities. This page sets out the main test types and what each shows, where testing gives false comfort, the records produced, and who decides.

01In brief

The short answer.

Operational resilience testing is how financial firms check that important services stay within tolerance under disruption, through scenario tests, threat-led red-teaming, failover and restore tests and joint exercises. Its value depends on scenario severity and remediation. Boards, authorities, testing teams and internal audit hold the decisions.

02Spatial finance

Settlement dependencies, and what fails with a node.

How a failure at one financial centre can spread through settlement links. Design links, not real dependencies.

Sixteen financial centres, and how a failure at one spreads through settlement links.Design links, not the real dependencies of any infrastructure.
03Console

Important business services, in outline.

The working screen behind this subject: its structure, terms and states. Names are placeholders and values illustrative.

Important business services

Operational resilience testing · Bank B services · Self-assessment 3

One service outside toleranceGRA · Financial Cyber and Operational Resilience

Services vs impact tolerance

Make a payment25Cloud region lossWithin
Access cash198Cyber attackWithin
Mortgage servicing6653Data centre lossWithin
Claims payment4551Third-party failureOutside

Dependency map

people · process · technology · third parties

Remediation

  1. R-1Second claims platform supplierExit plan tested158 d
  2. R-2Immutable backups for paymentsCyber recovery47 d
Important business services: the screen's structure, terms and states for Operational resilience testing.Placeholder names and illustrative values; a design, not a record or a live system.
04The question

Operational resilience testing: how the risk develops.

Severe but plausible scenario design. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanism

Scenarios set the challenge

Tests are only as hard as the scenarios chosen. Mild scenarios confirm plans; severe ones expose weaknesses.

Mechanism

Red teams find what audits miss

Threat-led testing uses real attacker techniques against live systems, finding weaknesses in detection and response that control checklists miss.

Mechanism

Findings decay without action

Unremediated findings repeat in later tests. Tracking each finding to verified closure turns testing into improvement.

Mechanism

Joint exercises test coordination

Exercises with suppliers, peers and authorities reveal communication and decision gaps that sit between organizations.

05Key terms

Terms used on this page.

Each term as this page uses it. Where a standard-setting body defines the term, the wording follows that body.

TermDefinition
Red-teamingSimulating a real attacker's campaign to test an organization's detection and response.
Restore testA test that recovers systems or data from backup to confirm recovery works.
Remediation trackingFollowing each test finding until fixes are made, tested and verified as closed.
06Indicators

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Scenario tests completed for important servicescountannualFirm recordsDECLARED
Threat-led penetration testscountperiodicAuthority recordsOFFICIAL
Critical findings remediated on timeshareperiodicRemediation trackingDECLARED
Restore tests passedshareannualTest recordsDECLARED
Joint exercises with suppliers or sectorcountannualFirm recordsDECLARED
Tests involving severe destructive scenariosshare of testsannualTest recordsDECLARED
07Canvas

From sources to decisions.

The topic as a computational graph: named sources feed the methods, an evidence review gates the outputs, and the decisions stay with the authorities that hold them.

Pipeline canvas · Operational resilience testing as a run graphDesign, not a record
Operational resilience testing: operational resilienceImportant business services are identified and impact tolerances set; people, processes, technology and third parties are mapped; severe but plausible scenarios test whether services stay within tolerance; vulnerabilities are remediated and the board self-assesses. Design of the process, not a record of a run.

Fig. 02Nodes carry their type, two metric rows and a state; connectors show what feeds what; dashed frames name the owners; the timeline is the cadence. Design of the pipeline, not a record of a run.

08Sources

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

SourceWhat it givesLicence class
TIBER-EU frameworkThreat intelligence-based ethical red-teamingFree, ECB terms
DORA threat-led penetration testing standardsEU testing requirementsFree, EU reuse terms
CBEST frameworkUK threat-led testingFree, Bank of England terms
Hong Kong Monetary Authority iCAST and similar frameworksTesting frameworks in other jurisdictionsFree, terms per authority
Supervisory reports on scenario testing practiceObservations on firms' testingFree, terms per supervisor
09Decisions

Who decides, and what the evidence serves.

Financial Cyber and Operational Resilience prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Who decidesThe questionEvidence this page serves
BoardsWhich scenarios to test and whether results are acceptableTest results and remediation status
AuthoritiesWhich firms must run threat-led testsFrameworks and risk assessments
Testing teamsHow to design tests safely and realisticallyFramework requirements
Internal auditWhether testing is adequate and findings closedTest and remediation records

Outputs this topic produces

  • Guide to operational resilience test types
  • Method note on severe scenario design
  • Brief on remediation tracking
  • Questions for boards on test results
10Core questions

What test designers ask.

  • Is the scenario severe enough to stretch the firm, yet plausible enough to be credible?
  • Does it include combined failures, such as a cyber attack during a provider outage?
  • Does it test decisions and communication as well as technology?
  • What happens to findings: are weaknesses fixed and retested?
11Mechanisms

What testing reveals.

Tests often reveal hidden dependencies, such as a recovery process that relies on a system that would itself be down, or a team that cannot be reached without the communication tool that failed. They reveal decision bottlenecks and gaps between documented plans and what people actually do.

Threat-led testing, carried out under strict controls by authorized teams, shows how real attackers could move through systems. Sector-wide exercises show how firms, providers and authorities would coordinate. Each kind of test answers different questions, and none proves that a firm is resilient against everything.

12Methods and limits

Kinds of testing.

  1. 01

    Scenario-based exercises

    Tabletop and simulation exercises using resilience engineering methods. Limits: participants know it is an exercise.

  2. 02

    Technical recovery tests

    Testing failover and restoration of systems. Limits: full production tests carry risk.

  3. 03

    Threat-led penetration testing

    Controlled emulation of real attackers, grounded in cybersecurity. Limits: time-boxed and scoped.

  4. 04

    Sector-wide exercises

    Coordinated exercises across firms and authorities. Limits: complex to organize.

13Methods

How it is studied, and what the methods cannot say.

  1. Reliability and resilience engineeringService and dependency mapping · Recovery strategy comparison · Learning reviewsApplied here
  2. Cybersecurity and cryptographyIdentity and privileged access · Detection and response capability · Threat-led testingApplied here
  3. Software and safety-critical systems engineeringChange control for core systems · Integrity by design · Fault toleranceApplied here
15Questions

Questions and answers.

What is a severe but plausible scenario?
A disruption that is extreme enough to challenge a firm's resilience yet could realistically happen, such as loss of a key provider or a destructive cyber attack.
How does red-teaming differ from penetration testing?
Penetration testing looks for vulnerabilities in defined systems; red-teaming simulates a real attacker's campaign against people, processes and technology to test detection and response.
Why involve suppliers in exercises?
Because many disruptions start at or depend on suppliers, and coordination with them is part of recovery.
Can the platform run a test for my firm?
No. GRA does not carry out testing or assess results. Published scenario summaries are educational.
What does severe but plausible mean?
A scenario that is unlikely but realistic, often informed by past incidents elsewhere, that would stretch the firm's ability to stay within tolerance.
Does passing a test prove resilience?
No. It shows performance under one scenario. Resilience is demonstrated over time through repeated, varied testing and remediation.
Why test combined failures?
Because real incidents often combine causes, such as an attack during a provider outage, and plans built for single failures may not hold.
Financial Cyber and Operational Resilience

Bring your expertise to this field.

The current service level is R0: information and enquiries. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

Skip to toolbar