Skip to content

GRA · Reinsurance and Catastrophe

Spatial financeWhere capital meets hazard, exposure and transition

Model validation

Catastrophe models inform capital, price and rating decisions, so they must be shown fit for purpose. Validation tests each module against observations, compares models, challenges assumptions and documents limits. Supervisors, rating agencies and professional standards set expectations. This page sets out how catastrophe model validation works and where it falls short, the evidence it uses, and who decides.

01تۆمارکردن

Model validation on the record.

02پرسیارەکە

Model validation: how the risk develops.

Uncertainty, sensitivity and benchmarks. The dossier below sets out how the risk develops, what is measured, where the data come from, how it is modelled and who decides.

میکانیزم

Module-by-module testing

Hazard is compared with observed event statistics, vulnerability with claims, and the full model with historical losses. Each test covers part of the model, not all of it.

میکانیزم

Short records limit tests

Rare events cannot be validated against long loss histories. Validation relies on scientific plausibility and expert judgement for the tail.

میکانیزم

Independence matters

Validation by the team that adopted the model is weaker than independent challenge. Governance separates development, adoption and validation.

میکانیزم

Model change shocks results

Vendor updates can shift results sharply. Change management assesses why results moved and whether the new view is adopted.

03Spatial finance

Exposure, hazard and the exceedance curve.

Which places drive loss in a severe year, and how far it reaches into reinsurance. Illustrative design values.

Coastal exposure under cyclone and earthquake zones, beside the loss curve it produces.Illustrative design values, not a model output or a price.
04نیشاندەرەکان

What is measured, and how well.

Each indicator carries its unit, its cadence, the kind of source behind it and the evidence label a value would carry. No values are shown: a programme supplies them under its own authority.

نیشاندەریەکەڕیتمSource typeناونیشان
Modelled versus historical loss for past eventsratioper validationValidation reportsمۆدێلکراو
Change in results from model version updatespercent change in key metricsper updateChange analysisمۆدێلکراو
Independent validation completedyes or no, by modelساڵانەGovernance recordsDECLARED
Internal models approved by supervisorscountساڵانەSupervisor recordsئامارە بڵاوکراوەکان
Validation findings outstandingcount by severityperiodicValidation recordsDECLARED
Public model reviews completedcountساڵانەPublic commissionsئامارە بڵاوکراوەکان
05شبیهسازی دووانە و زنجیرەیی

Trace a shock in model validation to the balance sheet.

Assembled from the Nexus Standards area profile Insurance and reinsurance: the shocks it names, the systems and sectors that carry the loss, the controls that dampen it and the data that observe it. Pick an initiating shock and step through the cascade to see which exposures it reaches and where losses could concentrate. The Map view places the run on an example geography with open data. Every weight is a stated assumption. An exercise, not a forecast, a valuation, a rating or investment advice. To model a place of your own choosing, open the full System Builder.

مەترسیدەرەکان

  • Tropical cyclone
  • بوومەلەرزە
  • Ice-jam flood
  • ئاگری دارستان
  • Storm surge (set off downstream)
  • Intense rainfall (set off downstream)
  • River flood (set off downstream)
  • Flash flood (set off downstream)
  • Dangerous surf (set off downstream)
  • پچڕانی کارەبای فراوان (لە خوارەوە دەستپێدەکات)
  • ئاوارەبوونی بەکۆمەڵ (لە خوارەوە دەستپێدەکات)
  • Coastal flood (set off downstream)
  • Aftershock sequence (set off downstream)
  • Fault surface rupture (set off downstream)
  • Soil liquefaction (set off downstream)
  • Slope slide (set off downstream)
  • Rockfall (set off downstream)
  • Tsunami (set off downstream)

کۆنترۆڵەکان

  • NS-0 دەستوور و بنەماکان
  • NS-3 UNIەکانی تۆماری مەترسی (ڕێزمان، خشتەی گواستنەوەی کۆن، دەسەڵاتی تەرخانکردن)
  • NS-9 UNIی ناوەڕۆکی (دامەزراندنەکان، نموونەکان، نموونەکانی پڕۆگرام)
  • NS-10 سیاسەت و بڕگەکان (پابەندبوونە ئامێر-خوێندراوەکان: پێناسە، پابەندکردن، هەڵسەنگاندن و جێبەجێکردن)
  • NS-11 سەلماندن و چاودێری (بەڵگە، گواهییەکان، چاودێریی گونجان لەگەڵ zero-trust)
  • NS-14 پابەندبوون و هاوتاکردن لەگەڵ ستانداردی دەرەکی
  • NRS-F3 بیمە، مەترسیی کارەسات و کەلێنەکانی پاراستن
  • NRS-H113 خێزانی مەترسیدەر: ناسکیی سیستەمی دارایی (NHS-1 soc.financial-system)
  • NRS-U17 Universe platform profile: Insurance Nexus
  • NRS-H71 خێزانی مەترسیدەر: کارەساتە کەونی و کاتی قووڵەکان (NHS-1 planet.deep-time)
  • NRS-H65 خێزانی مەترسیدەر: پێشێلکردنی سنوورەکانی گۆی زەوی (NHS-1 planet.boundary)
  • NRS-F8 گواستنەوەی مەترسیی پارامێتری و لەسەر بنەمای نیشاندەر

چاودێری

  • OECD Data Explorer (incl. Creditor Reporting System, insurance and pension statistics) (listed for reference)
  • Insurance statistics (listed for reference)
  • USGS earthquake GeoJSON summary feeds (listed for reference)
  • Direct economic loss attributed to disasters in relation to global gross domestic product (GDP)
  • Direct economic loss attributed to disasters in relation to global gross domestic product
  • (a) Number of commercial bank branches per 100,000 adults and (b) number of automated teller machines (ATMs) per 100,000 adults

جوگرافیای نموونە

  • ئەوروپای ڕۆژئاوا: 152 خانەی شەشپاڵوو
  • ڕێژەی بارین، نیو کاتژمێری ڕابردوو (IMERG)، NASA GIBS
  • ڕووناکییەکانی شەو ئەمشەو، پچڕانی کارەبا (VIIRS Day/Night Band)، NASA GIBS
  • ئاوی ڕووی زەوی لە ڕێگەی هەورەوە، 30 م (ڕادارەی OPERA DSWx-S1)، NASA GIBS
  • Carbon monoxide, smoke transport (AIRS), NASA GIBS
06سەرچاوەکان

Where the evidence comes from.

Named public datasets and institutional records, each with its licence class. Sources by agreement are used only under their terms and never republished.

سەرچاوەWhat it givesLicence class
Florida Commission on Hurricane Loss Projection Methodology standards and reportsPublic standards and acceptance reviews for hurricane and flood modelsPublic records
EIOPA and PRA guidance on internal model use and validationSupervisory expectations for model validationFree, EU and Bank of England terms
Lloyd’s catastrophe modelling guidance and minimum standardsValidation and governance expectations for managing agentsFree to read, Lloyd’s terms
Actuarial Standards Board ASOP on catastrophe modellingProfessional standards for using modelsFree, ASB terms
Oasis LMF model documentationOpen model documentation enabling comparisonOpen source, terms per model
07Exposure, loss and capital

What model validation means for exposure, loss and capital.

The exposure, loss, scenario and capital views a risk officer, supervisor or ministry of finance would ask for, with the frameworks they report against. Structures follow supervisory and actuarial practice. Values are illustrative: never prices, ratings or advice.

Exposure and loss at return periods

How losses from model validation grow with severity, gross and net of reinsurance, against capital.

1 لە 101 لە 501 لە 1001 لە 250ناپوختnet of reinsurance800
ماوەی گەڕانەوەAnnual probabilityزیانی ناپوختزیانی پوختNet, capital = 100
1 لە 100.10141010
1 لە 500.02332121
1 لە 1000.01462727
1 لە 2500.004683939
تێکڕای زیانی ساڵانە3.12.22.2
Illustrative loss index for a example portfolio (capital = 100): the exceedance-probability form insurers and supervisors read. Not data on any institution, not a price or a rating.
NGFS climate scenarios · Network for Greening the Financial SystemIFRS S2 Climate-related Disclosures · ISSBTCFD recommendations · Financial Stability Board TCFDPrinciples for the effective management of climate-related financial risks · Basel Committee on Banking Supervision
08بڕیارەکان

Who decides, and what the evidence serves.

Reinsurance and Catastrophe prepares evidence. The decisions below are taken by the authorities named, under their own rules, and never by the platform.

کێ بڕیار دەداتپرسیارەکەEvidence this page serves
Model validation functionsWhether a model is fit for each intended useTest results, comparisons and documented limits
Boards and risk committeesWhether to adopt a model or version as the company viewValidation findings and change analysis
چاودێرانWhether to approve internal models for capitalValidation and governance evidence
Public model commissionsWhether models meet standards for rate filingsModel submissions and review findings

Outputs this topic produces

  • Guide to validating each catastrophe model module
  • Method note on model change analysis
  • Brief on independent challenge and governance
  • Questions for boards approving a model view
09Core questions

What experts ask about validation.

  • Do the hazard, vulnerability and financial modules reflect current scientific understanding?
  • How do modelled losses compare with observed losses from past events?
  • Which assumptions drive the results most strongly?
  • How do results compare across different models for the same portfolio?
  • How should model uncertainty be communicated to decision-makers?
10Mechanisms and drivers

Why validation is difficult.

The events that matter most are the rarest, so there are few observations against which to test tail estimates. A model may match recent losses well but misestimate the tail. Validation must therefore test components separately, against hazard records, engineering studies and claims, as well as the model as a whole.

Sensitivity analysis shows which assumptions matter. Small changes in vulnerability functions, event frequencies or exposure data can change loss estimates significantly. Understanding these sensitivities is essential for using models responsibly.

Comparing models helps reveal structural uncertainty: if independently built models disagree, the disagreement indicates how uncertain the estimate is.

11Methods and data

Methods and their limits.

  1. 01

    Component validation

    Testing modules against independent evidence, using uncertainty quantification and model validation.

  2. 02

    Historical loss comparison

    Comparing modelled and observed losses for past events. Exposure changes complicate comparison.

  3. 03

    شیکاری هەستیاری

    Varying key assumptions systematically. Interactions between assumptions can be complex.

  4. 04

    بەراوردکاریی مۆدێلەکان

    Comparing outputs of different models on common portfolios. Requires shared, consistent inputs.

Validation reduces but cannot remove model uncertainty. It is an ongoing process, repeated as models and science change.

12ڕێگاکان

How it is studied, and what the methods cannot say.

13پرسیارەکان

پرسیار و وەڵام.

Can a catastrophe model be validated against history?
Partly. Hazard and vulnerability can be tested against observed events and claims, but rare tail losses have too few observations, so plausibility and expert challenge fill the gap.
Why do model updates move results?
New science, data and methods change hazard or vulnerability. Change analysis explains which component moved results and why.
Who reviews catastrophe models publicly?
Some bodies, such as the Florida Commission on Hurricane Loss Projection Methodology, review models against published standards before they may support rate filings.
Does the platform validate models?
No. It studies validation methods. Validation of specific models is carried out by their users and reviewed by supervisors.
Why compare models?
Because disagreement between independent models reveals structural uncertainty that a single model cannot show.
Can a model be fully validated?
No. Validation builds confidence for a purpose, but rare-event estimates always carry uncertainty.
Does the Universe exercise compare models?
A model comparison exercise for a hazard season is designed, described on the platform’s Universe page.
ڕاپۆرتەکانبەشداربە

لەم لاپەڕەیەوە بەڵگە پێشکەش بکە.

Reports بڵاوکراوەی وەرزیی کۆنسۆرتیۆم ـە. ئەوەی تۆ لەسەر ئەم بابەتە دەیزانیت دەتوانێت لە وەشانی داهاتوودا ببێتە بەڵگە، کەیس یان ڕاستکردنەوە، بە ناوی خۆتەوە و لەژێر CC BY 4.0 بڵاو دەکرێتەوە کاتێک کاری خۆتە.

Global Risks AllianceReinsurance and CatastropheFinance and Insurance ReadinessMethods and Technical

هەرگیز داتای کەسی، وردەکاریی هەستیاری ژێرخان یان هیچ شتێک مەنێرە کە مافی بڵاوکردنەوەت نییە. بەشدارییەک پێش بەکارهێنان پێداچوونەوەی بۆ دەکرێت؛ ناردنی ماف نابەخشێت بە نووسەرایەتی یان بەڕێوەبردنی ڕاگەیاندن، و پاڵپشتی دارایی هەرگیز دۆزینەوەیەک ناکڕێت.

بیمەی ئەتکایی و کارەسات

Bring an exposure or capital question to the Alliance.

زانیاری و پرسیار ئەمڕۆ کراوەن. پرسیارێک ژمارەی ئاماژەی پێدەدرێت و هەنگاوی دواتر دیاری دەکات؛ داواکاری، پارەدان، تەرخانکردنی کۆمپیوتەر و تۆمارکردن تەنیا کاتێک دەکرێنەوە کە تیم، مەرج و توانای پێداچوونەوەیان هەبێت.