← CreditVintage

SYNTHETIC RESEARCH

Same review budget.
Different risk policies.

Five frozen methods score the same 480 mature applications. Training, calibration and test periods are separated by outcome-maturation gaps. Each policy receives exactly the same global review capacity; ties use application ID.

Capacity comparison

MethodBudget fractionReviewedEvents captured False positivesEvent capture
business_rule0.05249158.4%
business_rule0.148173115.9%
business_rule0.296375934.6%
raw_logistic0.0524121211.2%
raw_logistic0.148252323.4%
raw_logistic0.296415538.3%
calibrated_logistic0.0524121211.2%
calibrated_logistic0.148252323.4%
calibrated_logistic0.296405637.4%
woe_logistic0.052410149.3%
woe_logistic0.148222620.6%
woe_logistic0.296395736.4%
hist_gradient_boosting0.052410149.3%
hist_gradient_boosting0.148183016.8%
hist_gradient_boosting0.296395736.4%

Follow the evidence

Scores and ranks · Portfolio, month and segment metrics · Label-free raw-logistic explanations · Protocol, WOE scorecard and paired intervals · Artifact hashes

The fixed business rule is a ranking score, not a default probability. WOE boundaries and event rates are learned only from training applications. Raw-logistic contributions add to its log odds relative to training means; they do not explain calibrated probabilities or establish causality. Higher scorecard points imply lower fitted risk; a 20-point increase doubles fitted good/bad odds.

Paired intervals resample complete origination months using the same draw for all methods. Only six held-out months are available; inspect the intervals and group results before interpreting a small difference. Run creditvintage verify-benchmark DIRECTORY to independently recompute capacities, group outcomes and log-odds explanations.