GRA · AI and Financial Model Risk
Spatial financeWhere capital meets hazard, exposure and transition
Third party models
Firms use vendor credit scores, fraud models, catastrophe models, market data analytics and foundation models they did not build and cannot fully inspect. Responsibility for model risk stays with the firm. This page sets out how third-party model risk arises, how firms validate what they cannot see, the evidence available, and who decides.
Third party models on the record.
Third party models: how the risk develops.
Vendor dependencies and due diligence. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.
Limited transparency
Vendors protect their methods as trade secrets. Firms may get documentation and performance reports but not code, data or training details, which limits validation.
Shared models, shared errors
When many firms use the same vendor model, its errors affect them all at once and can move markets or credit supply together.
Updates change behaviour
Vendors update models and data on their own schedules. Without notice and change analysis, a firm’s validated model can change silently.
Validation by outcomes
Where internals are hidden, firms validate through benchmarking, outcome analysis and testing on their own data, which needs time and data.
Model risk lifecycle.
وہ اسکرین جو ایک ٹیم اس موضوع کی پیروی کے لیے استعمال کرے گی: اس کے پیمانے، حالتیں اور فیصلے۔ نام مثالیں ہیں اور اقدار توضیحی ہیں۔
Model risk lifecycle
Third party models · Model inventory · Committee 8
Lifecycle
- Inventoryregistered
- Developdocumented
- Validateindependent
- Approvecommittee
- Implementcontrols
- Monitorthresholds
- Reviewannual
- Retiredecommission
Models
| MD-709 PD retail | Tier 1 | 9 months | 1 | Overdue |
| MD-561 LLM complaints triage | Tier 1 | never | 0 | Not validated |
| MD-601 IFRS 9 staging | Tier 1 | 3 months | 0 | منظور شدہ |
| MD-088 marketing propensity | Tier 3 | 14 months | 1 | منظور شدہ |
Validation scope
- تصوراتی درستی
- In progress
- نتائج کا تجزیہ
- Pending
- Benchmarking
- Pending
- Use limits
- human review required
What is measured, and how well.
Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.
| Indicator | Unit | Cadence | Source type | لیبل |
|---|---|---|---|---|
| Third-party models in inventory | count by tier | annual | Model inventory | DECLARED |
| Vendor models with full documentation | share | annual | Vendor management records | DECLARED |
| Vendor model changes notified | count | سالانہ | Vendor notices | رپورٹ شدہ |
| Third-party models validated on own data | share | annual | Validation records | DECLARED |
| Concentration of vendor model use across firms | share of firms using top vendors | periodic | Supervisory surveys | رپورٹ شدہ |
| Contracts with model change notice clauses | share | periodic | Contract reviews | DECLARED |
What third party models means for exposure, loss and capital.
The exposure, loss, scenario and capital views a risk officer, supervisor or ministry of finance would ask for, with the frameworks they report against. Structures follow supervisory and actuarial practice. Values are illustrative: never prices, ratings or advice.
Transmission channels
How a shock in third party models reaches credit, market, underwriting, liquidity and operational risk, and feeds back.
Where the evidence comes from.
Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.
| ماخذ | What it gives | Licence class |
|---|---|---|
| SR 11-7 guidance on vendor and third-party models | Expectations for using external models | عوامی ملکیت |
| Interagency guidance on third-party relationships (United States banking agencies) | Third-party risk management expectations | عوامی ملکیت |
| FSB report on AI financial stability implications | Third-party and concentration risks from AI | Free, FSB terms |
| EU AI Act obligations for providers and deployers | Division of duties between AI providers and users | Free, EU reuse terms |
| Vendor model documentation and performance reports | Information vendors provide to users | Proprietary, terms per vendor |
Who decides, and what the evidence serves.
AI and Financial Model Risk prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.
| کون فیصلہ کرتا ہے | The question | Evidence this page serves |
|---|---|---|
| Model risk functions | How to validate and approve third-party models | Documentation, benchmarks and outcome testing |
| Procurement and legal | Which transparency and change terms to require | Contract practice and regulatory expectations |
| Supervisors | Whether vendor model use is governed adequately and whether concentration matters | Surveys and review findings |
| Vendors | What documentation and notice to provide | Customer and regulatory requirements |
Outputs this topic produces
- Guide to validating models firms cannot inspect
- Brief on concentration in vendor and foundation models
- Method note on change analysis for vendor updates
- Questions for procurement on model transparency terms
What experts ask.
The questions concern responsibility for models one did not build.
- Does the institution understand how a vendor model works well enough to validate its use?
- What documentation, testing evidence and access does the vendor provide?
- How are vendor model updates communicated, tested and approved?
- How many institutions rely on the same vendor, and what happens if it fails or changes?
- Can the institution exit or replace the model if needed?
Mechanisms and drivers.
Vendors often protect their models as intellectual property, limiting the transparency available to users. Institutions must still validate the model’s use for their own purposes, typically through outcome testing, benchmarking and contractual rights to documentation. Updates by the vendor can change model behaviour without the institution’s knowledge.
Concentration is a sector-wide concern. When many institutions use the same vendor model or AI provider, a flaw, outage or change affects them together, creating correlated errors and operational dependencies that no single institution can manage alone.
How it is studied, and where the methods stop.
| Method or data | What it shows | حدود |
|---|---|---|
| Vendor due diligence | Vendor capability, controls and transparency | Limited by vendor disclosure |
| Outcome and benchmark testing | Performance on the institution’s own data | Does not reveal internal logic |
| Contract and exit analysis | Rights to information, notification and exit | Rights may be hard to exercise |
| Concentration mapping | Shared dependencies across the sector | Requires aggregated information |
How it is studied, and what the methods cannot say.
- 01AI evaluation and assurance engineeringValidation of machine learning models · Red-teaming generative AI · Fairness assessmentApplied here
- 02Probability and statisticsCalibration testing · Drift statistics · Group outcome comparisonApplied here
- 03Uncertainty quantification and model validationPrediction intervals for loss models · Model ensembles · Model risk capital or buffersApplied here
- 04Artificial intelligence and machine learningGradient-boosted credit models · Language models in operations · Anomaly detectionApplied here
سوالات و جوابات۔
Who is responsible for a vendor model’s risk?
How can a firm validate a model it cannot see?
Why does vendor concentration matter?
Does buying a model transfer its risk to the vendor?
Why is vendor concentration a stability concern?
What should an institution be able to obtain from a model vendor?
Does the platform rate vendors?
اس صفحے سے شواہد فراہم کریں۔
Reports کنسورشیم کی سہ ماہی اشاعت ہے۔ اس موضوع کے بارے میں آپ کا علم اگلے شمارے میں شواہد، کیس یا تصحیح بن سکتا ہے، جو آپ کے نام سے منسوب ہوگا اور اگر یہ آپ کا اپنا کام ہو تو CC BY 4.0 کے تحت شائع ہوگا۔
- EmailGateway GW-GRASend it from this pageEvidence, a correction, a case, a method, a review, a translation or profile input. It arrives tagged with this page, so the editor who owns it receives it.
- ZenodoOpen depositDeposit it and submit to the communityPublish your own record on Zenodo with your ORCID iD, then submit it to the Reports community there. Curators review it; the DOI stays yours.
- ReportsGlobal Risks AllianceSee every way to contributeThe contribution types, how each is reviewed, what credit you receive, the licence and what is never accepted.
کبھی بھی ذاتی ڈیٹا، حساس بنیادی ڈھانچے کی تفصیل یا کوئی ایسی چیز نہ بھیجیں جسے شیئر کرنے کا آپ کو حق نہ ہو۔ ہر شراکت استعمال سے پہلے جانچی جاتی ہے؛ اسے بھیجنے سے کوئی تصنیفی یا ادارتی حق حاصل نہیں ہوتا، اور سرپرستی کبھی کوئی نتیجہ نہیں خریدتی۔
Bring an exposure or capital question to the Alliance.
معلومات اور استفسارات آج کھلے ہیں۔ استفسار کو ایک حوالہ نمبر ملتا ہے اور اگلے مرحلے کی نشاندہی ہوتی ہے؛ درخواستیں، ادائیگیاں، کمپیوٹنگ کی تخصیص اور رجسٹریشن صرف اس وقت کھلتی ہیں جب ان کی ٹیم، شرائط اور جائزے کی استعداد موجود ہو۔
قانونی دستاویزات۔
اس سائٹ کے نقشے، ڈیٹا اور اشکال سیاق اور عمومی معلومات کے لیے دکھائے جاتے ہیں۔ یہ مشورہ، پیش گوئیاں یا انتباہات نہیں؛ معلومات کی حدود دستبرداریوں اور ڈیٹا سے متعلق اطلاعات میں بیان کی گئی ہیں۔