Loan Participations, CECL, Stress Testing, Loan Modeling for Banks and Credit Unions

Santa Fe, NM  |   (505) 490-6094  |  info@deepfutureanalytics.com

In Regards to Proposed Rule 10-17-19 Interagency Policy Statement on Allowances for Credit Losses

The proposed rule provides helpful comments on how the new Current Expected Credit Loss (CECL) standard should be managed, validated, and monitored. One seemingly simple statement, however, has significant implications.

In the sections “Analyzing and Validating the Overall Measurement of ACLs”, “Responsibilities of Management “, and “Examiner Review of ACLs”, versions of the following statement are used:

“…comparing estimates of expected credit losses to actual write-offs in aggregate, and by portfolio, may enable management to assess whether the institution’s loss estimation process is sufficiently designed…”

Comparing expected credit losses to actual write-offs seems sensible as a general principle, but unfortunately does not work for CECL. CECL is not a loss forecast. First, CECL is a “lifetime” loss forecast where lifetime is not contractually assured. Since a comparison of CECL estimates to actual losses will generally be for a period that is less than the full life of the loan, the timing of the loss expectation will be critical for such a comparison, and yet many CECL-compliant methods make no attempt to correctly time future losses. Therefore, comparing over any time frame less that the full lifetime can be problematic.

Several points in the CECL guidelines will also cause it to deviate dramatically from future loss experience over any chosen fixed horizon, even when considering only existing loans. Some known examples where CECL will not align with actual loss experience are:

• Defaults after a loan renewal or extension where CECL estimates stop at the extension.
• Reduced losses because of term extensions or loan rewrites.
• Increased utilization of lines of credit or credit card, either normal balance growth by the consumer or in response to a credit line increase, leading to increased losses.
• Consumer activation of inactive accounts leading to increased losses.

The greatest difficulty is in measuring a CECL-compliant historic loss experience given the chosen payment allocation rule for lines of credit. This is an accounting election that dramatically affects model performance and can even lead to changing how the models are created, even though actual losses are not being changed.

To tell developers, managers, examiners, and the board that CECL estimates should be compared to actual write-offs is certain to create a false expectation of what CECL is and how it can be monitored. In each section where this is mentioned, it is the first such item suggested, which will further increase the emphasis among those subject to the rule. Particularly alarming is the idea that examiners will judge a CECL model based upon how closely the CECL estimates align with actuals given all of the above reasons that the CECL estimate will, in fact, never align with actual write-offs regardless of the accuracy of the underlying model, i.e. even a perfect CECL model would fail this test.

The rule should be modified to make clear that CECL will NOT agree with actual write-off experience and can only be compared to a retrospective CECL loss in which actual write-offs have been adjusted for all of the accounting rules present within CECL. This means that the institutions must estimate a historic CECL loss against which to compare the CECL estimates, both of which are different from the actual historic write-offs.

Comparable to this is a historic contribution analysis where past losses are split into components of CECL loss and non-CECL loss, perhaps even splitting the non-CECL loss by some of the causes listed above.

Obviously, both of these approaches are additional work, but they are the only way to perform the recommended comparison. If this is viewed as too difficult for some lenders, then the statements about comparing CECL loss estimates to actual write-offs need to be deleted and left to the kind of detailed model performance review conducted during model validation, not as part of high-level oversight.

As CEO of Prescient Models LLC and Deep Future Analytics LLC, I have already seen this confusion in action. We are a CECL provider to nearly 200 regional banks, community banks, credit unions, and finance companies. We also provide validation services for many in-house CECL models. Prior to CECL, I have worked in credit risk modeling for 27 years and written many articles and books on the subject, including the Living with CECL series. During my CECL experiences, clients, validators, and auditors have already demonstrated confusion over the simple point that CECL is an accounting calculation, not a loss forecast.

As a long-time model developer, I sympathize with this confusion, because CECL is the first time in my career where I have needed to create a model to predict a quantity that itself is subject to how I as a developer interpret the CECL guidelines. I hope that in writing rules on model validation and monitoring, the language can be written more carefully to avoid reinforcing this confusion.

Joseph L. Breeden, PhD CEO, Prescient Models LLC and Deep Future Analytics LLC breeden@prescientmodels.com

Webinar Summary: Comparing CECL to FAS5 Results

Webinar Summary: Comparing CECL to FAS5 Results

Credit Unions can expect at least a 22% increase and Community Banks a 59% decrease in reserves as a result of CECL?

Deep Future Analytics (DFA) and Prescient Models (PM) recently conducted a joint study across 103 CECL clients to determine how much their loss reserves could change if CECL were adopted today. The results were presented in a 10/17 webinar which we summarize in this article.

Modeling Accuracy Since loan modeling is such a complex animal, the first question you should always ask is: “Can I trust the numbers?” For this, Dr. Joe Breeden, world renowned credit analyst and author of the “Living with CECL” book series, takes you through how advanced loan modeling works and the data and equations behind it. I provided a “stripped down” version of this below for those less familiar with loan modeling.

For the study we used a MultiHorizon Survival Model. This highly advanced method of computing credit risk is actually a two-step approach which adds to overall accuracy and application of the data. When you take multiple factors like Lifecycle, Environmental, and Credit Quality the information must be handled correctly or the results will be erratic. Therefore, this approach accounts for the changes in variable significance across multiple horizons. For example, delinquency is a very strong indicator of PD in the early months but then becomes less important. All in all, as we look at lifetime losses it is important to have a model that will stand the test as we look multiple years into the future.

Among community banks, the most common result (median) was a significant reduction of -59% in reserves. For credit unions the model reveals an increase in reserves of 22%. These estimates are before any Q-Factor adjustments. While the banks may be able to add Q-Factors to bring the new requirements more in line with existing practices, the credit unions will have a much more difficult time “selling” a negative Q-Factor to their auditors.

Next, we took the client data and further stress tested using the FRB Severe scenario for a near-term recession. As a result the CECL loss reserves see a significant increase with the banks going from a -59% up to +69%, and credit unions from +22% up to +107%.

Product Results To understand the differences by product, we are taking our model’s 12 month horizon and comparing to a lifetime horizon. This will measure the number of years of coverage you need under CECL, compared to what you would’ve had before.

The median ratio of CECL / 12Mo. loss rate for the individual products is essentially the average life of the loan. For example, we computed the average life of Consumer Loans to be 1.59, thus resulting in a 59% increase in reserves of the current 12 month horizon. For Auto loans the result was an increase of 135%, 55% for Consumer Line, 78% for Credit card, 140% for Residential RE, and 342% for HELOC. The HELOC is sort of an interesting case because it cannot be canceled. This poses many issues in how we manage loss estimates and this actual estimate could actually be understated.

On the commercial side, we show increases for all products as well: Ag Loans (197%), Ag Lines (2%), C&I Loans (93%), C&I Lines (140%), CRE Loans(251%), and CRE Lines(310%)

There are still plenty of institutions today that have yet to prepare for the new CECL standards. Based on these results we feel the time is now to find out your institution’s new reserve requirements so you can make the appropriate course corrections today to ensure a smooth transition tomorrow.

Click Here to view the Webinar