A-P07 · TOPIC · explainability-and-fairnessGRA dossier · service level R0
GRAAI and Financial Model RiskIn development
Topic dossier · AI and Financial Model Risk

Explainability and fairness

Customers, staff and supervisors need to understand why a model made a decision, and decisions must not discriminate unlawfully. Explainability methods give reasons for individual outputs and overall behaviour; fairness testing compares outcomes across groups. Both have limits, and law sets duties such as giving reasons for credit denial. This page sets out how explainability and fairness are assessed, the evidence used and who decides.

01In brief

The short answer.

Explainability and fairness in financial AI concern whether firms can give reasons for model decisions and whether outcomes treat groups lawfully and fairly. Explanation methods are approximate and fairness criteria conflict, so choices must be justified. Boards, developers, regulators and compliance functions hold the decisions.

02Spatial finance

From a satellite tile to an exposure update.

How satellite radar turns a flood into an exposure update. Synthetic scene; no real event or place.

How satellite radar maps a flood and updates the count of affected buildings.Synthetic scene and schematic model; no real event or place.
03Console

Model risk lifecycle, in outline.

The working screen behind this subject: its structure, terms and states. Names are placeholders and values illustrative.

Model risk lifecycle

Explainability and fairness · Model inventory · Committee 3

9 validations overdueGRA · AI and Financial Model Risk

Lifecycle

  1. Inventoryregistered
  2. Developdocumented
  3. Validateindependent
  4. Approvecommittee
  5. Implementcontrols
  6. Monitorthresholds
  7. Reviewannual
  8. Retiredecommission

Models

MD-169 PD retailTier 119 months4Overdue
MD-140 LLM complaints triageTier 1never0Not validated
MD-400 IFRS 9 stagingTier 19 months1Approved
MD-386 marketing propensityTier 317 months1Approved

Validation scope

Conceptual soundness
In progress
Outcomes analysis
Pending
Benchmarking
Pending
Use limits
human review required
Model risk lifecycle: the screen's structure, terms and states for Explainability and fairness.Placeholder names and illustrative values; a design, not a record or a live system.
04The question

Explainability and fairness: how the risk develops.

Interpretation, bias and accountability. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

Mechanism

Post-hoc explanations approximate

Methods such as feature attributions explain a complex model approximately. Different methods can give different reasons for the same decision, and none guarantees the true cause.

Mechanism

Fairness has several definitions

Equal approval rates, equal error rates and calibration across groups cannot all hold at once when base rates differ. Choosing a criterion is a policy and legal decision, not a technical default.

Mechanism

Reasons must be specific

Credit laws require specific reasons for adverse decisions. Generic reasons or ones unrelated to the actual driver do not meet the duty, whatever the model's complexity.

Mechanism

Opacity hides harm

Without explanation and outcome testing, unfair patterns surface only through complaints, litigation or enforcement, after many customers are affected.

05Key terms

Terms used on this page.

Each term as this page uses it. Where a standard-setting body defines the term, the wording follows that body.

TermDefinition
Feature attributionA method that estimates how much each input contributed to a model's output.
Adverse impact ratioThe ratio of favourable outcome rates between a group and a reference group.
Adverse action noticeA notice telling an applicant the specific reasons credit was denied or terms worsened.
06Indicators

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

IndicatorUnitCadenceSource typeLabel
Adverse impact ratioratio of favourable outcome rates between groupsperiodicFairness testingESTIMATED
Error rate differences across groupsdifference in false positive or negative ratesperiodicFairness testingESTIMATED
Explanation stabilityagreement between explanation methodsper validationValidation testingESTIMATED
Adverse action notices citing model reasonsshare of declines with specific reasonsperiodicCompliance reviewDECLARED
Complaints alleging unfair automated decisionscountquarterlyComplaints dataREPORTED
Enforcement actions on algorithmic discriminationcountannualRegulator recordsOFFICIAL
07Canvas

From sources to decisions.

The topic as a computational graph: named sources feed the methods, an evidence review gates the outputs, and the decisions stay with the authorities that hold them.

Pipeline canvas · Explainability and fairness as a run graphDesign, not a record
Explainability and fairness: AI risk management, govern to manageGovernance sets roles and policies; the context and intended use are mapped; capability, safety, robustness and fairness are measured; risks are managed with mitigations and a deployment gate; incidents feed monitoring and the registry. Design of the process, not a record of a run.

Fig. 02Nodes carry their type, two metric rows and a state; connectors show what feeds what; dashed frames name the owners; the timeline is the cadence. Design of the pipeline, not a record of a run.

08Sources

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

SourceWhat it givesLicence class
CFPB guidance on adverse action notices and AIUnited States duty to give specific reasonsPublic domain
MAS FEAT principles and Veritas methodology documentsFairness assessment methods for financial servicesFree, MAS terms
IAIS Application Paper on the supervision of AIFairness, transparency and redress expectations for insurersFree, IAIS terms
EIOPA report on governance principles for ethical and trustworthy AIInsurance sector AI fairness and governanceFree, EU reuse terms
Academic literature on fairness definitions and impossibility resultsFormal analysis of fairness criteriaFree to read, terms per publisher
09Decisions

Who decides, and what the evidence serves.

AI and Financial Model Risk prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

Who decidesThe questionEvidence this page serves
Boards and conduct committeesWhich fairness criteria apply to each useLegal requirements and outcome testing
Model developers and validatorsWhich explanation methods are reliable for a modelStability and fidelity testing
Conduct and equality regulatorsWhether outcomes are lawfulOutcome data, complaints and testing evidence
Compliance functionsWhether customer explanations meet legal dutiesNotice reviews and model reason codes

Outputs this topic produces

  • Guide to fairness criteria and their trade-offs
  • Method note on testing explanation methods for stability
  • Brief on adverse action reasons for complex models
  • Questions for boards on fairness criterion choice
10Core questions

What experts ask.

The questions concern understanding, justice and responsibility.

  • Can developers, validators, users and customers understand why a model made a decision?
  • Which fairness definition is appropriate for the decision, and who chose it?
  • Where does bias enter: data, design, deployment or feedback?
  • Can a customer challenge an automated decision and obtain redress?
  • Who is accountable when an unexplainable model causes harm?
11Mechanisms

Mechanisms and drivers.

Simple models such as scorecards are directly interpretable. Complex models, such as gradient-boosted trees and neural networks, require post-hoc explanation methods that approximate their behaviour; these approximations can be unstable or misleading. Explainability needs differ by audience: a validator needs technical depth, a customer needs a clear reason.

Bias arises from historical data, unrepresentative samples, proxy variables and feedback loops in which model decisions shape future data. Fairness has several mathematical definitions, such as equal outcomes, equal error rates or equal calibration, which generally cannot all be satisfied at once. Choosing among them is a value judgement that should be made explicitly and accountably.

12Methods and data

How it is studied, and where the methods stop.

Method or dataWhat it showsLimits
Interpretable model designInherent transparencyMay sacrifice some predictive performance
Post-hoc explanation methodsFeature contributions to outputsApproximate and sometimes unstable
Fairness testing across groupsDisparities in outcomes and errorsRequires group data that may be unavailable
Impact assessmentConsequences for affected peopleRelies on foresight and engagement
13Methods

How it is studied, and what the methods cannot say.

  1. AI evaluation and assurance engineeringValidation of machine learning models · Red-teaming generative AI · Fairness assessmentApplied here
  2. Artificial intelligence and machine learningGradient-boosted credit models · Language models in operations · Anomaly detectionApplied here
  3. Probability and statisticsCalibration testing · Drift statistics · Group outcome comparisonApplied here
14Questions

Questions and answers.

Can a model satisfy every fairness definition?
Generally not when groups have different underlying outcome rates; research shows common criteria conflict, so a choice has to be made and justified.
Are feature attributions true explanations?
They approximate how inputs influenced an output. They help but can disagree between methods, so their stability and fidelity should be tested.
Does using AI change the duty to explain credit decisions?
No. United States guidance states that creditors must give specific and accurate reasons for adverse action whatever the technology used.
Is a more accurate model always better?
Not necessarily. A slightly less accurate model that is interpretable and fairer may be more appropriate, depending on the decision and the law.
Can fairness be fully automated?
No. Choosing a fairness definition involves value judgements and legal considerations that require human accountability.
Who decides which fairness definition applies?
The institution, within the law of the jurisdictions where it operates and under the oversight of its regulators. The choice should be documented, justified and reviewed, because it determines whose errors the model tolerates.
Does the platform certify models as fair?
No. GRA does not certify, validate or rate models.
AI and Financial Model Risk

Bring your expertise to this field.

The current service level is R0: information and enquiries. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.

Skip to toolbar