Work

The Population Accuracy Index: A New Measure of Population Stability for Model Monitoring

Year: 2019
Type: article
Abstract: Risk models developed on one dataset are often applied to new data and, in such cases, it is prudent to check that the model is suitable for the new data. An important application is in the banking industry, where statistical models are applied to loans to determine provisions and capital requirements. These models are developed on historical data, and regulations require their monitoring to ensure they remain valid on current portfolios—often years since the models were developed. The Population Stability Index (PSI) is an industry standard to measure whether the distribution of the current data has shifted significantly from the distribution of data used to develop the model. This paper explores several disadvantages of the PSI and proposes the Prediction Accuracy Index (PAI) as an alternative. The superior properties and interpretation of the PAI are discussed and it is concluded that the PAI can more accurately summarise the level of population stability, helping risk analysts and managers determine whether the model remains fit-for-purpose.
Source: Risks
Institution: Curtin University
Language: English
Subfield: Accounting
Open Access status: gold
Estimated APC paid: $1,013
OpenAlex ID: W2942648925
FWCI: 2.551
Cites: 4
Cited by: 27
Related to: 10