GRA · AI and Financial Model Risk
Spatial financeWhere capital meets hazard, exposure and transition
Generative AI in finance
Financial firms use large language models to draft documents, answer customers, summarise research, write code and support analysts. Generative AI produces fluent output that can be wrong, can leak data and can be manipulated through its inputs. This page sets out how generative AI risks arise in financial services, how they are measured and controlled, and who decides where it may be used.
काम कसे चालते.
Model risk lifecycle
Generative AI in finance · Model inventory · Committee 7
Lifecycle
- Inventoryregistered
- Developdocumented
- Validateindependent
- Approvecommittee
- Implementcontrols
- Monitorthresholds
- Reviewannual
- Retiredecommission
Models
| MD-264 PD retail | Tier 1 | 12 months | 2 | Overdue |
| MD-251 LLM complaints triage | Tier 1 | never | 0 | Not validated |
| MD-297 IFRS 9 staging | Tier 1 | 5 months | 2 | मंजूर |
| MD-784 marketing propensity | Tier 3 | 6 months | 1 | मंजूर |
Validation scope
- संकल्पनात्मक भक्कमपणा
- In progress
- परिणाम विश्लेषण
- Pending
- Benchmarking
- Pending
- Use limits
- human review required
Fig.Model risk lifecycle: example names and illustrative values, not a record or a live system.
Generative AI in finance: how the risk develops.
Use cases and failure controls. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Fluent but wrong
Models can generate plausible statements that are false, citations that do not exist or calculations that are wrong. In finance, an error in a disclosure, advice or code change can harm customers or the firm.
Inputs can be weaponised
Prompt injection through documents, emails or web pages can make a model ignore instructions, reveal data or take unintended actions, especially when it is connected to tools.
Data leaks across boundaries
Confidential information entered into external services or retrieved into answers can reach people not entitled to it. Data handling terms and access controls decide the exposure.
Behaviour changes with versions
Provider updates change model behaviour without the firm’s code changing. Validation done on one version may not hold for the next.
What Generative AI in finance means for exposure, loss and capital.
The exposure, loss, scenario and capital views a risk officer, supervisor or ministry of finance would ask for, with the frameworks they report against. Structures follow supervisory and actuarial practice. Values are illustrative: never prices, ratings or advice.
Transmission channels
How a shock in Generative AI in finance reaches credit, market, underwriting, liquidity and operational risk, and feeds back.
What is measured, and how well.
Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.
| Indicator | Unit | Cadence | Source type | लेबल |
|---|---|---|---|---|
| Generative AI use cases in production | count by risk tier | quarterly | Use case register | DECLARED |
| Factual error rate on evaluation sets | share of responses | per evaluation | Internal evaluation | अंदाजित |
| Prompt injection test failures | count per test cycle | per test | Red-team results | निरीक्षित |
| Data loss prevention events involving AI tools | count | monthly | Security monitoring | निरीक्षित |
| Customer complaints linked to AI-generated content | count | quarterly | Complaints data | नोंदवलेले |
| Model version changes by providers | count | प्रति वर्ष | Vendor notices | नोंदवलेले |
Where the evidence comes from.
Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.
| स्रोत | What it gives | Licence class |
|---|---|---|
| FSB report on the financial stability implications of AI | Vulnerabilities from AI adoption in finance | Free, FSB terms |
| IOSCO report on AI use cases, risks and challenges | AI use in capital markets | Free, IOSCO terms |
| NIST AI RMF generative AI profile | Risks and actions specific to generative AI | सार्वजनिक क्षेत्र |
| OWASP Top 10 for large language model applications | Common security risks in LLM applications | Free, CC BY-SA |
| Bank of England and FCA AI surveys | Adoption and governance of AI in UK finance | Free, Bank of England and FCA terms |
Who decides, and what the evidence serves.
AI and Financial Model Risk prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| Who decides | The question | Evidence this page serves |
|---|---|---|
| Boards and executive committees | Where generative AI may be used and with what controls | Use case risk tiers and evaluation results |
| Model risk and security functions | How generative AI is validated and secured | Evaluation, red-team and monitoring evidence |
| Conduct supervisors | Whether customer-facing AI meets conduct and disclosure duties | Complaints and outcome evidence |
| Procurement and legal teams | Which providers and data terms are acceptable | Contract terms and data handling evidence |
Outputs this topic produces
- Guide to generative AI failure modes in financial services
- Method note on evaluating factual accuracy and grounding
- Brief on prompt injection and tool-connected assistants
- Questions for boards on generative AI use cases
What experts ask.
Generative AI questions start with the use case and its consequences.
- What is the tool being used for, and what happens if its output is wrong?
- How is the accuracy of output verified before it affects customers or decisions?
- What data is sent to the model, and could confidential information leak?
- How are prompts, versions and outputs logged for accountability?
- How dependent is the institution on a single provider, and what happens if the service changes or fails?
Mechanisms and drivers.
Large language models generate text by predicting likely continuations. They can produce fluent, plausible output that is false, which matters greatly where accuracy is required. Their behaviour can change when providers update models, and they can be manipulated by crafted inputs. Their outputs are hard to test exhaustively because the space of possible inputs is vast.
Risk depends strongly on the use. Drafting an internal summary that a professional reviews carries different risk from answering customers directly or informing credit decisions. Controls therefore scale with consequence: human review, restricted data, retrieval from approved sources, testing against known cases and monitoring of outputs.
How it is studied, and where the methods stop.
| Method or data | What it shows | मर्यादा |
|---|---|---|
| Use-case risk assessment | Consequences of failure by application | Informal uses may not be captured |
| Evaluation against test sets | Accuracy and failure rates on known cases | Cannot cover all real inputs |
| Red-teaming and adversarial testing | Vulnerability to manipulation | Finds some weaknesses, not all |
| Output monitoring and logging | Errors and incidents in use | Detecting subtle errors is hard |
How it is studied, and what the methods cannot say.
- 01Artificial intelligence and machine learningGradient-boosted credit models · Language models in operations · Anomaly detectionApplied here
- 02AI evaluation and assurance engineeringValidation of machine learning models · Red-teaming generative AI · Fairness assessmentApplied here
- 03Uncertainty quantification and model validationPrediction intervals for loss models · Model ensembles · Model risk capital or buffersApplied here
- 04Probability and statisticsCalibration testing · Drift statistics · Group outcome comparisonApplied here
प्रश्न आणि उत्तरे.
Is a large language model a model under model risk rules?
What is prompt injection?
What is grounding?
Why do language models produce false information?
Should generative AI make credit or claims decisions?
Does the platform evaluate specific AI products?
या पानावरून पुरावा योगदान द्या.
Reports is the Consortium’s quarterly publication. What you know about this subject can become evidence, a case or a correction in the next edition, credited to you and published under CC BY 4.0 where it is your own work.
- EmailGateway GW-GRASend it from this pageEvidence, a correction, a case, a method, a review, a translation or profile input. It arrives tagged with this page, so the editor who owns it receives it.
- ZenodoOpen depositDeposit it and submit to the communityPublish your own record on Zenodo with your ORCID iD, then submit it to the Reports community there. Curators review it; the DOI stays yours.
- ReportsGlobal Risks AllianceSee every way to contributeThe contribution types, how each is reviewed, what credit you receive, the licence and what is never accepted.
वैयक्तिक डेटा, संवेदनशील पायाभूत सुविधांचा तपशील किंवा सामायिक करण्याचा तुम्हाला अधिकार नसलेले काहीही कधीही पाठवू नका. योगदानाचे वापरापूर्वी पुनरावलोकन केले जाते; ते पाठवल्याने कोणतेही लेखकत्व किंवा संपादकीय अधिकार मिळत नाहीत, आणि प्रायोजकत्वाने कधीही निष्कर्ष विकत घेता येत नाही.
Bring an exposure or capital question to the Alliance.
Information and enquiries are open today. An enquiry receives a reference and names the next step; applications, payments, compute allocations and registrations open only when their team, terms and review capacity exist.
कायदेशीर दस्तऐवज.
या साइटवरील नकाशे, डेटा आणि आकृत्या संदर्भ आणि सर्वसाधारण माहितीसाठी दाखवल्या आहेत. त्या सल्ला, अंदाज किंवा इशारे नाहीत; माहितीच्या मर्यादा अस्वीकरणे आणि डेटा सूचनांमध्ये नमूद केल्या आहेत.