Skip to content

GRA · AI and Financial Model Risk

Spatial financeWhere capital meets hazard, exposure and transition

Model risk governance

Model risk is the potential for loss or harm from decisions based on models that are wrong or misused. Banks, insurers and asset managers manage it through model inventories, risk tiering, independent validation, approval and ongoing monitoring, overseen by boards and senior management. Machine learning and generative AI widen what counts as a model. This page sets out how model risk governance works and fails, the records involved, and who decides.

01Register

Model risk governance on the record.

02The question

Model risk governance: how the risk develops.

Inventory, ownership and validation. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanism

Inventories miss models

Spreadsheets, vendor tools and AI components often sit outside the model inventory. Unlisted models escape validation and monitoring, and their errors surface only when losses or complaints arrive.

Mechanism

Challenge weakens

Validation that lacks independence, skill or authority to stop a model becomes a formality. Effective challenge needs validators who understand the method and can block use.

Mechanism

Tiering sets attention

Models are tiered by materiality and complexity, which decides validation depth. Underestimating a model’s materiality, or the reach of an AI tool, leaves high-impact models lightly reviewed.

Mechanism

Models interact

Outputs of one model feed others: a score feeds pricing, which feeds capital. An error upstream propagates, and aggregate model risk across the chain is rarely measured.

03Monitor

Model risk lifecycle.

The screen a team would use to follow this subject: its measures, states and decisions. Names are examples and values are illustrative.

Model risk lifecycle

Model risk governance · Model inventory · Committee 9

9 validations overdueGRA · AI and Financial Model Risk

Lifecycle

  1. Inventoryregistered
  2. Developdocumented
  3. Validateindependent
  4. Approvecommittee
  5. Implementcontrols
  6. Monitorthresholds
  7. Reviewannual
  8. Retiredecommission

Models

MD-204 PD retailTier 114 months3Overdue
MD-511 LLM complaints triageTier 1never0Not validated
MD-164 IFRS 9 stagingTier 18 months1Approved
MD-534 marketing propensityTier 317 months0Approved

Validation scope

Conceptual soundness
In progress
Outcomes analysis
Pending
Benchmarking
Pending
Use limits
human review required
Model risk lifecycle: the screen’s structure, terms and states for Model risk governance.Example names and illustrative values; a design, not a record or a live system.
04Viashiria

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Models in inventorycount by tierquarterlyModel inventoryDECLARED
Models validated within policy cycleshare by tierquarterlyValidation recordsDECLARED
Open validation findingscount by severityquarterlyValidation recordsDECLARED
Models used with exceptions or restrictionscountquarterlyModel governance recordsDECLARED
AI and machine learning models in inventorycount and shareannualInventory and surveysDECLARED
Supervisory findings on model risk managementcountannualSupervisory reportsPublished statistics
05Scenario model

Policy paths and what they do to the risk.

How three families of instruments change a risk outcome over time with adoption lags, coverage and compliance, the policy scenarios behind transition and physical risk assessments. Scenario: named assumptions about the future, not a forecast.

Controls

Baseline trend of the outcome
2.0% a year
Coverage of the instrument
70%
Uzingatiaji wa kanuni
75%
Effect size, against the teaching value
100%
Years ahead
20 years

Readouts

Largest reduction at the horizon
Regulation
Its reduction against the baseline
21%
Numbers, methods and sources
YearHali ya msingiRegulationEconomic incentiveInformation and capacity
0100.099.598.899.1
1102.0101.2100.199.8
2104.0102.5101.199.9
3106.1103.5101.6100.0
4108.2103.7101.8100.7
5110.4103.2101.7102.1
6112.6102.0101.6103.9
7114.9100.4101.6105.9
8117.299.2102.1108.0
9119.598.6102.9110.1
10121.998.9104.2112.3
11124.399.7105.7114.5
12126.8101.1107.4116.8
13129.4102.7109.4119.2
14131.9104.5111.4121.6
15134.6106.5113.5124.0
16137.3108.5115.7126.5
17140.0110.7118.0129.0
18142.8112.9120.4131.6
19145.7115.1122.8134.2
20148.6117.4125.2136.9

Mbinu

  1. Tools of government Hood (1983), The Tools of Government, Macmillan
  2. Carrots, sticks and sermons Bemelmans-Videc, Rist and Vedung (1998), Transaction
  3. Diffusion of innovations Rogers (2003), Diffusion of Innovations, Free Press
  4. Uncertainty fan (parameter Monte Carlo) Spiegelhalter, Pearson and Short (2011), Visualising uncertainty about the future, Science 333
  5. One-at-a-time sensitivity (tornado) Saltelli and others (2008), Global Sensitivity Analysis: The Primer, Wiley

Data

The model runs on the teaching values set by the controls. To calibrate it for a place, read it against these admitted layers and series, which this page’s map can draw:

  • Borders Natural Earth
  • Cities Natural Earth
Policy paths and what they do to the risk. Illustrative teaching model: it runs on the values set by the controls, not on measured data. Methods: Tools of government (Hood (1983), The Tools of Government, Macmillan); Carrots, sticks and sermons (Bemelmans-Videc, Rist and Vedung (1998), Transaction); Diffusion of innovations (Rogers (2003), Diffusion of Innovations, Free Press).
06Vyanzo

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

ChanzoWhat it givesLicence class
Federal Reserve and OCC SR 11-7 guidanceModel risk management expectationsKikoa cha umma
PRA SS1/23 model risk management principlesUK principles for banksFree, Bank of England terms
ECB guide to internal modelsExpectations for internal models used for capitalFree, ECB terms
Bank of England and FCA surveys of AI and machine learning in UK financial servicesUse and governance of AI across firmsFree, Bank of England and FCA terms
EBA follow-up reports on machine learning for internal ratings-based modelsSupervisory views on ML in capital modelsFree, EU reuse terms
07Exposure, loss and capital

What model risk governance means for exposure, loss and capital.

The exposure, loss, scenario and capital views a risk officer, supervisor or ministry of finance would ask for, with the frameworks they report against. Structures follow supervisory and actuarial practice. Values are illustrative: never prices, ratings or advice.

Transmission channels

How a shock in model risk governance reaches credit, market, underwriting, liquidity and operational risk, and feeds back.

Channel structure after the Basel Committee’s work on climate-related risk drivers and transmission channels; links shown are typical paths, not estimated exposures.
NGFS climate scenarios · Network for Greening the Financial SystemIFRS S2 Climate-related Disclosures · ISSBTCFD recommendations · Financial Stability Board TCFDPrinciples for the effective management of climate-related financial risks · Basel Committee on Banking Supervision
08Decisions

Who decides, and what the evidence serves.

AI and Financial Model Risk prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Nani anaamuaThe questionEvidence this page serves
Boards and senior managementWhat model risk appetite to set and how to oversee itInventory, tiering, findings and incident evidence
Model risk management functionsWhich models to validate, approve, restrict or retireValidation results and monitoring
Prudential supervisorsWhether model risk management meets expectationsSupervisory reviews and firm reporting
Internal auditWhether the model risk framework operates as designedGovernance and validation records

Outputs this topic produces

  • Guide to model inventories, tiering and validation
  • Brief on extending model risk management to AI and generative AI
  • Method note on effective challenge
  • Questions for boards on aggregate model risk
09Core questions

What experts ask.

Governance questions begin with knowing what models exist.

  • What counts as a model, and does the definition capture machine learning, vendor tools and generative AI?
  • Is every model in the inventory, with an accountable owner and a risk tier?
  • Is validation genuinely independent and effective at challenging developers?
  • How are model limitations documented and communicated to users?
  • Does the board understand the institution’s aggregate model risk?
10Mechanisms

Mechanisms and drivers.

Models fail through flawed design, poor data, implementation errors, or use beyond their intended scope. Governance frameworks address these through development standards, independent validation and ongoing monitoring, scaled to each model’s materiality. Supervisory guidance on model risk management in several jurisdictions sets expectations along these lines.

AI strains traditional frameworks. Machine learning models can be numerous, frequently retrained and embedded in processes; generative AI tools may be adopted informally by staff; vendor models may be opaque. Inventories that miss these uses leave risk unmanaged.

11Methods and data

How it is studied, and where the methods stop.

Method or dataWhat it showsLimits
Model inventories and tieringWhich models exist and how material they areInformal and embedded AI uses are easily missed
Independent validationSoundness of design, data and implementationValidation is constrained by time, skills and access to vendor details
Governance benchmarkingHow institutions organise model riskSelf-reported and hard to compare
Issue and finding analysisRecurring weaknessesFindings are confidential within firms
12Mbinu

How it is studied, and what the methods cannot say.

  1. AI evaluation and assurance engineeringValidation of machine learning models · Red-teaming generative AI · Fairness assessmentApplied here
  2. Probability and statisticsCalibration testing · Drift statistics · Group outcome comparisonApplied here
  3. Uncertainty quantification and model validationPrediction intervals for loss models · Model ensembles · Model risk capital or buffersApplied here
  4. Artificial intelligence and machine learningGradient-boosted credit models · Language models in operations · Anomaly detectionApplied here
13Maswali

Questions and answers.

What is model risk?
The potential for adverse consequences from decisions based on incorrect or misused model outputs, as SR 11-7 describes it, including financial loss, poor decisions and reputational harm.
What is effective challenge?
Critical, independent analysis of a model by people with the competence, influence and incentives to identify limitations and require changes.
Are AI models covered by model risk rules?
Supervisors such as the PRA state that model risk principles apply to AI and machine learning models, with attention to their specific risks.
Do spreadsheets and generative AI tools count as models?
Many frameworks define models by function rather than technology, so tools that produce quantitative estimates or influence decisions can fall within scope. Each institution applies its own definition under its supervisors’ expectations.
Does the platform review firms’ frameworks?
No. GRA does not review, validate or approve firms’ frameworks or models.
RipotiChangia

Changia ushahidi kutoka ukurasa huu.

Reports ni chapisho la kila robo mwaka la Muungano. Unachojua kuhusu somo hili kinaweza kuwa ushahidi, kisa au sahihisho katika toleo lijalo, kikitajwa kwa jina lako na kuchapishwa chini ya CC BY 4.0 pale ambapo ni kazi yako mwenyewe.

Global Risks AllianceAI and Financial Model RiskMethods and TechnicalExponential Technology
Akili Bandia na Hatari za Kielelezo cha Fedha

Bring an exposure or capital question to the Alliance.

Information and enquiries are open today. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.