When models do not accurately predict dist of outcomes for test data, 3 explanations
3 tests to validate models
histogram
p-p plot
ie model is appropriate if p-p plot lies along 45 degree line
expected value e = {1/(n+1),…,n/(n+1)}
K-S statistic
D=max|pi-fi|
fi = 100*{1/n,…,n/n}
Validating Mack: results
Validating ODPB: results
Possible reasons for observations for paid and incd data ie Mack and ODPB results
Bayesian models for Incurred loss data
-Mack model underestimates variability of predictive distribution which leads to light tails
Leveled Chain Ladder (LCL)
Correlated Chain Ladder (CCL)
Leveled Chain Ladder (LCL)
Correlated Chain Ladder (CCL)
LCL results
CCL results
Bayesian models for Paid loss data
-CCL model produced estimates that were biased high
Correlated Incremental Trend (CIT)
Leveled Incremental Trend (LIT)
Correlated Incremental Trend (CIT)
Leveled Incremental Trend (LIT)
-similar to CIT but does not have AY correlation
results for CIT and LIT
Changing Settlement Rate (CSR)
CSR results
total risk
total risk = process risk + parameter risk
process risk vs parameter risk
Meyers found what risk is close to total risk for several insurers
parameter risk
model risk
if p-p plot shows S curve
demonstrates more high and low percentiles than expected
45 degree = uniformly distributed