Last month, I wrote about seeking ways to ensure growth without increasing risk. This month, I’ll present a few approaches that use multiple scores to give a more complete view into a consumer’s true profile. Let’s start with bankruptcy scores. You use a risk score to capture traditional risk, but bankruptcy behavior is significantly different from a consumer profile perspective. We’ve seen a tremendous amount of bankruptcy activity in the market. Despite the fact that filings were slightly lower than 2010 volume, bankruptcies remain a serious threat with over 1.3 million consumer filings in 2011; a number that is projected for 2012. Factoring in a bankruptcy score over a traditional risk score, allows better visibility into consumers who may be “balance loading”, but not necessarily going delinquent, on their accounts. By looking at both aspects of risk, layering scores can identify consumers who may look good from a traditional credit score, but are poised to file bankruptcy. This way, a lender can keep their approval rates up and lower risk of overall dollar losses. Layering scores can be used in other areas of the customer life cycle as well. For example, as new lending starts to heat up in markets like Auto and Bankcard, adding a next generation response score to a risk score in your prospecting campaigns, can translate into a very clear definition of the population you want to target. By combining a prospecting score with a risk score to find credit worthy consumers who are most likely to open, you help mitigate the traditional inverse relationship between open rates and credit worthiness. Target the population that is worth your precious prospecting resources. Next time, we’ll look at other analytics that help complete our view of consumer risk. In the meantime, let me know what scoring topics are on your mind.
By: Mike Horrocks Henry Ford is credited to have said “Coming together is a beginning. Keeping together is progress. Working together is success.” This is so true with risk management, as you may consider bringing in different business units, policies, etc., into a culture of enterprise risk management. Institutions that understand the concept of strength from unity are able to minimize risks at all levels, and not be exposed in unfamiliar areas. So how can this apply in your organization? Is your risk management process united across all different business lines or are there potential chinks in your armor? Are you using different guidelines to manage risk as it comes in the door, versus how you are looking at it once it is part of the portfolio, or are they closely unified in purpose? Now don’t get me wrong, I am not saying that blind cohesion is right for every risk management issue, but getting efficiencies and consistencies can do wonders for your overall risk management process. Here are some great questions to help you evaluate where you are: Is there a well-understood risk management approach in place across the institution? How confident are you that risk management is a core competence of your institution? Does risk management run through the veins of the institution, or is it regarded as the domain of auditors and compliance? A review of these questions may bring you closer to being one in purpose when it comes to your risk management processes. And while that oneness may not bring you Zen-like inner peace, it will bring your portfolio managers at least a little less stress.
By: Joel Pruis Some of you may be thinking finally we get to the meat of the matter. Yes the decision strategies are extremely important when we talk about small business/business banking. Just remember how we got to here though, we had to first define: Who are we going to pursue in this market segment? How are we going to pursue this market segment - part 1 & part 2? What are we going to require of the applicants to request the funds? Without the above, we can create all the decision strategies we want but their ultimate effectiveness will be severely limited as they will not have a foundation based upon a successful execution. First we are going to lay the foundation for how we are going to create the decision strategy. The next blog post (yes, there is one more!) will get into some more specifics. With that said, it is still important that we go through the basics of establishing the decision strategy. These are not the same as investments. Decision strategies based upon scorecards We will not post the same disclosure as do the financial reporting of public corporations or investment solicitations. This is the standard disclosure of “past performance is not an indication of future results”. On the contrary, for scorecards, past performance is an indication of future results. Scorecards are saying that if all conditions remain the same, future results should follow past performance. This is the key. We need to fully understand what the expected results are to be for the portfolio originated using the scorecard. Therefore we need to understand the population of applications used to develop the scorecards, basically the information that we had available to generate the scorecard. This will tie directly with the information that we required of the applications to be submitted. As we understand the type of applications that we are taking from our client base we can start to understand some expected results. By analyzing what we have processed in the past we can start to build about model for the expected results going forward. Learn from the past and try not to repeat the mistakes we made. First we take a look at what we did approve and analyze the resulting performance of the portfolio. It is important to remember that we are not to be looking for the ultimate crystal ball rather a model that can work well to predict performance over the next 12 to 18 months. Those delinquencies and losses that take place 24, 36, 48 months later should not and cannot be tied back to the information that was available at the time we originated the credit. We will talk about how to refresh the score and risk assessment in a later blog on portfolio management. As we see what was approved and demonstrated acceptable performance we can now look back at those applications we processed and see if any applications that fit the acceptable profile were actually declined. If so, what were the reasons for the declinations? Do these reasons conflict with our findings based upon portfolio performance? If so, we may have found some additional volume of acceptable loans. I say "may" because statistics by themselves do not tell the whole story, so be cautious of blindly following the statistical data. My statistics professor in college drilled into us the principle of "correlation does not mean causation". Remember that the next time a study featured on the news. The correlation may be interesting but it does not necessarily mean that those factors "caused" the result. Just as important, challenge the results but don't use outliers to disprove here results or the effectiveness of the models. Once we have created the model and applied it to our typical application population we can now come up with some key metrics that we need to manage our decision strategies: Expected score distributions of the applications Expected approval percentage Expected override percentage Expected performance over the next 12-18 months Expected score distributions We build the models based upon what we expect to be the population of applications we process going forward. While we may target market certain segments we cannot control the walk-in traffic, the referral volume or the businesses that will ultimately respond to our marketing efforts. Therefore we consider the normal application distribution and its characteristics such as 1) score; 2) industry; 3) length of time in business; 4) sales size; etc. The importance of understanding and measuring the application/score distributions is demonstrated in the next few items. Expected approval percentages First we need to consider the approval percentages as an indication of what percent of the business market to which we are extending credit. Assuming we have a good representative sample of the business population in the applications we are processing we need to determine what percentile of businesses will be our targeted market. Did our analysis show that we can accept the top 40%? 50%? Whatever the percentage, it is important that we continue to monitor our approval percentage to determine if we are starting to get too conservative or too liberal in our decisioning. I typically counsel my client that “just because your approval percentage is going up is not necessarily an improvement!” By itself an increase in approval percentage is not good. I'm not saying that it is bad just that when it goes up (or down!) you need to explain why. Was there a targeted marketing effort? Did you run into a short term lucky streak? OR is it time to reassess the decision model and tighten up a bit? Think about what happens in an economic expansion. More businesses are surviving (note I said surviving not succeeding). Are more businesses meeting your minimum criteria? Has the overall population shifted up? If more businesses are qualifying but there has been no change in the industries targeted, we may need to increase our thresholds to maintain our targeted 50% of the market. Just because they met the standard criteria in the expansion does not mean they will survive in a recession. "But Joel, the recession might be more than 18 months away so we have a good client for at least 18 months, don't we?". I agree but we have to remember that we built the model assuming all things remain constant. Therefore if we are confident that the expansion will continue at the same pace infinitum, then go ahead and live with the increased approval percentage. I will challenge you that it is those applicants that "squeaked by" during the expansion that will be the largest portion of the losses when the recession comes. I will also look to investigate the approval percentages when they go down. Yes you can make the same claim that the scorecard is saying that the risk is too great over the next 12-18 months but again I will challenge that if we continue to provide credit to the top 40-50% of all businesses we are likely doing business with those clients that will survive and succeed when the expansion returns. Again, do the analysis of “why” the approval percentage declined/dropped. Expected override percentage While the approval percentage may fluctuate or stay the same, another area to be reviewed is that of the override. Overrides can be score overrides or a decision override. Score override would be contradicting the decision that was recommended based upon the score and/or overall decision strategy. Decision override would be when the market/field has approval authority and overturns the decision made by the central underwriting group. Consequently you can have a score override, a decision override or both. Overrides can be an explanation for the change in approval percentages. While we anticipate a certain degree of overrides (say around 5%), should the overrides become too significant we start to lose control of the expected outcomes of the portfolio performance. As such we need to determine why the overrides have increase (or potentially decrease) and the overrides impact on the approval percentage. We will address some specifics around override management in a later blog. Suffice to say, overrides will always be present but we need to keep the amount of overrides within tolerances to be sure we can accurate assess future performance. Expected performance over next 12-18 months The measure of expected performance is at minimum the expected probability/propensity of repayment. This may be labeled as the bad rate or the probability of default (PD). In a nutshell it is the probability that the credit facility will be a certain level of delinquency over the next 12-18 months. What the base level expected performance based upon score is not the expected “loss” on the account. That is a combination of the probability of default combined with the expected loss given event of default. For the purpose of this post we are talking about the probability of default and not the loss given event of default. For reinforcement we are simply talking about the percentage of accounts that go 30 or 60 or 90 days past due during the 12 – 18 months after origination. So bottom line, if we maintain a score distribution of the applications processed by the financial institution, maintain the approval percentage as well as the override percentages we should be able to accurately assess the future performance of the newly originated portfolio. Coming up next… A more tactical discussion of the decision strategy
In my last two posts on bankcard and auto originations, I provided evidence as to why lenders have reason to feel optimistic about their growth prospects in 2012. With real estate lending however, the recovery, or lack thereof looks like it may continue to struggle throughout the year. At first glance, it would appear that the stars have aligned for a real estate turnaround. Interest rates are at or near all-time lows, housing prices are at post-bubble lows and people are going back to work with the unemployment rate at a 3-year low just above 8%. However, mortgage originations and HELOC limits were at $327B and $20B for Q3 2011, respectively. Admittedly not all-time quarterly lows, but well off levels of just a couple years ago. And according to the Mortgage Bankers Association, 65% of the mortgage volume was from refinance activity. So why the lull in real estate originations? Ironically, the same reasons I just mentioned that should drive a recovery. Low interest rates – That is, for those that qualify. The most creditworthy, VantageScore® credit score A and B consumers made up nearly 77% of the $327B mortgage volume and 87% of the $20B HELOC volume in Q3 2011. While continuing to clean up their portfolios, lenders are adjusting their risk exposure accordingly. Housing prices at multi-year lows - According to the S&P Case Shiller index, housing prices were 4% lower at the end of 2011 when compared to the end of 2010 and at the lowest level since the real estate bubble. Previous to this report, many thought housing prices had stabilized, but the excess inventory of distressed properties continues to drive down prices, keeping potential buyers on the sidelines. Unemployment rate at 3-year low – Sure, 8.3% sounds good now when you consider we were near 10% throughout 2010. But this is a far cry from the 4-5% rate we experienced just five years ago. Many consumers continue to struggle, affecting their ability to make good on their debt obligations, including their mortgage (see “Housing prices at multi-year lows” above), in turn affecting their credit status (see “Low interest rates” above)… you get the picture. Ironic or not, the good news is that these forces will be the same ones to drive the turnaround in real estate originations. Interest rates are projected to remain low for the foreseeable future, foreclosures and distressed inventory will eventually clear out and the unemployment rate is headed in the right direction. The only missing ingredient to make these variables transform from the hurdle to the growth factor is time.
Organizations approach agency management from three perspectives: (1) the need to audit vendors to ensure that they are meeting contractual, financial and legal compliance requirements; (2) ensure that the organization’s clients are being treated fairly and ethically in order to limit brand reputation risk and maintain a customer-centric commitment; (3) maximize revenue opportunities through collection of write-offs through successful performance management of the vendor. Larger organizations manage this process often by embedding an agency manager into the vendor’s site, notably on early out / pre charge-off outsourcing projects. As many utilities leverage the services of outsourcers for managing pre-final bill collections, this becomes an important tool in managing quality and driving performance. The objective is to build a brand presence in the outsourcer’s site, and focusing its employees and management team on your customers and daily performance metrics and outcomes. This is particularly useful in vendor locations in which there are a number of high profile client projects with larger resource pools competing for attention and performance, as an embedded manager can ensure that the brand gets the right level of attention and focus. For post write off recovery collections in utility companies, embedding an agency manager becomes cost-prohibitive and less of an opportunity from an ROI perspective, due to the smaller inventories of receivables at any agency. We urge that clients not spread out their placements to many vendors where each project is potentially small, as the vendors will more likely focus on larger client projects and dilute the performance on your receivables. Still, creating a smaller pool of agency partners often does not provide a resource pool of >50-100 collectors at a vendor location to warrant an embedded agency management approach. Even without an embedded agency manager, organizations can use some of the techniques that are often used by onsite managers to ensure that the focus is on their projects, and maintain an ongoing quality review and performance management process. The tools are fairly common in today’s environment --- remote monitoring and quality reviews of customer contacts (i.e., digital logging), monthly publishing of competitive liquidation results to a competitive agency process with market share incentives, weekly updates of month-to-date competitive results to each vendor to promote competition, periodic “special” promotions / contests tied to performance where below target MTD, and monthly performance “kickers” for exceeding monthly liquidation targets at certain pre-determined levels. Agencies have selective memory, and so it’s vital to keep your projects on their radar. Remember, they have many more clients, all of whom want the same thing – performance. Some are less vocal and focused on results than others. Those that are always providing competitive feedback, quality reviews and feedback, contests, and market share opportunities are top of mind, and generally get the better selection of collectors, team /project managers, and overall vendor attention. The key is to maintain constant visibility and a competitive atmosphere. Over the next several weeks, we'll dive into more detail for each of these areas: Auditing and monitoring, onsite and remote Best practices for improving agency performance Scorecards and strategies Market share competition and scorecards
If you attended any of our past credit trends Webinars, you’ve heard me mention time and again how auto originations have been a standout during these times when overall consumer lending has been a challenge. In fact, total originated auto volumes topped $100B in the third quarter of 2011, a level not seen since mid-2008. But is this growth sustainable? Since bottoming at the start of 2009, originations have been on a tear for nearly three straight years. Given that, you might think that auto origination’s best days are behind it. But these three key factors indicate originations may still have room to run: 1. The economy Just as it was a factor in declining auto originations during the recession, the economy will drive continued increases in auto sales. If originations were growing during the challenges of the past couple of years, the expected improvements in the economy in 2012 will surely spur new auto originations. 2. Current cars are old A recent study by Experian Automotive showed that today’s automobiles on the road have hit an all-time high of 10.6 years of age. Obviously a result of the recent recession, consumers owning older cars will result in pent up demand for newer and more reliable ones. 3. Auto lending is more diversified than ever I’m talking diversification in a couple of ways: Auto lending has always catered to a broader credit risk range than other products. In recent years, lenders have experimented with moving even further into the subprime space. For example, VantageScore® credit score D consumers now represent 24.4% of all originations vs. 21.2% at the start of 2009. There is a greater selection of lenders that cater to the auto space. With additional players like Captives, Credit Unions and even smaller Finance companies competing for new business, consumers have several options to secure a competitively-priced auto loan. With all three variables in motion, auto originations definitely have a formula for continued growth going forward. Come find out if auto originations do in fact continue to grow in 2012 by signing up for our upcoming Experian-Oliver Wyman credit trends Webinar.
Part II: Where are Models Most Needed Now in Mortgages? (Click here if you missed Part I of this post.) By: John Straka A first important question should always be are all of your models, model uses, and model testing strategies, and your non-model processes, sound and optimal for your business? But in today’s environment, two areas in mortgage stand out where better models and decision systems are most needed now: mortgage servicing and loan-quality assurance. I will discuss loan-quality assurance in a future installment. Mortgage servicing and loss mitigation are clearly one area where better models and new decision analytics continue to have a seemingly great potential today to add significant new value. At the risk of oversimplifying, it is possible that a number of the difficulties and frustrations of mortgage servicers (and regulators) and borrowers in recent years may have been lessened through more efficient automated decision tools and optimization strategies. And because these problems will continue to persist for quite some time, it is certainly not too late to envision and move now towards an improved future state of mortgage servicing, or to continue to advance your existing new strategic direction by adding to enhancements already underway. Much has been written about the difficulties faced by many mortgage servicers who have been overwhelmed by the demands of many more delinquent and defaulted borrowers and very extensive, evolving government involvements in new programs, performance incentives and standards. A strategic question on the minds of many executives and others in the industry today seems to be, where is all of this going? Is there a generally viable strategic direction for mortgage servicers that can help them to emerge from their current issues—perhaps similar to the improved data, standards, modeling, and technologies that allowed the mortgage industry in the 1990s to emerge overall quite successfully from the problems of the late 1980s and early 90s? To review briefly, mortgage industry problems of the early 1990s were less severe, of course—but really not dissimilar to the current environment. There had been a major home-price correction in California, in New England, and in a number of large metro areas elsewhere. A “low doc” mortgage era (and other issues) had left Citicorp nearly insolvent, for example, and caused other significant losses on top of the losses generated by the home prices. A major source of most mortgage funding, the Savings & Loan industry, had largely collapsed, with losses having to be resolved by a special government agency. Statistical mortgage credit scoring and automated underwriting resulted from the improved data, standards, modeling, and technologies that allowed the mortgage industry to recover in the 1990s, allowing mortgages to catch up with the previously established use of this decision technology in cards, autos, etc., thus benefiting the mortgage industry with reduced costs and significant gains in efficiency and risk management. An important question today is, is there a similar “renaissance,” so to speak, now in the offing or at hand for mortgage servicers? Despite all of the still ongoing problems? Let me offer here a very simple analogy—with a disclaimer that this is only a basic starting viewpoint, an oversimplification, recognizing that mortgage servicing and loss mitigation is extraordinarily complex in its details, and often seems only to grow more complex by the day (with added constraints and uncertainties piling on). The simple analogy is this: consider your loan-level Net Present Value (NPV) or other key objective of loan-level decisions in servicing and loss mitigation to be analogous to the statistically based mortgage default “Score” of automated underwriting for originations in the 1990s. Viewed in this way, a simple question stemming from the figure below is: can you reduce costs and satisfy borrowers and performance standards better by automating and focusing your servicing representatives more, or primarily, on the “Refer” group of borrowers? A corollary question is can more automated model-based decision engines confidently reduce the costs and achieve added insights and efficiencies in servicing the lowest and highest NPV delinquent borrowers and the Refer range? Another corollary question is, are new government-driven performance standards helpful or hindering (or even preventing) particular moves toward this type of objective. Is this a generally viable strategic direction for the future (or even the present) of mortgage servicing? Is it your direction today? What is your vision for the future of your quality mortgage servicing?
By: Joel Pruis One might consider this topic redundant to the last submission around application requirements and that assessment would be partially true. As such we are not going to go over the data that has already been collected in the application such as the demographic information of the applicant and guarantors or the business financial information or personal financial information. That discussion like Elvis has “left the building”. Rather, we will discuss the use of additional data to support the underwriting/decisioning process - namely: Personal/Consumer credit data Business data Scorecards Fraud data Let’s get a given out in the open. Personal credit data has a high correlation to the payment performance of a small business. The smaller the business the higher the correlation. “Your honor, counsel requests the above be stipulated in the court records.” “So stipulated for the record.” “Thank you, your honor.” With that put to rest (remember you can always comment on the blog if you have any questions or want to comment on any of the content). The real debate in small business lending revolves around the use of business data. Depth and availability of business data There are some challenges with the gathering and dissemination of business data for use in decisioning - mainly around the history of the data for the individual entity. More specifically, while a consumer is a single entity and for the vast majority of consumers, one does not bankrupt one entity and then start a new person to refresh their credit history. No, that is actually bankruptcy and the bankruptcy stays with the individual. Businesses, however, can and in fact do close one entity and start up another. Restaurants and general contractors come to mind as two examples of individuals who will start up a business, go bankrupt and then start another business under a new entity repeating the cycle multiple times. While this scenario is a challenge, one cannot refute the need to know how both the individual consumer as well as the individual business is handling its obligations whether they are credit cards, auto loans or trade payables. I once worked for a bank president in a small community bank who challenged me with the following mantra, “It’s not what you know that you don’t know that can hurt you, it is what you think you know but really don’t that hurts you the most.” I will admit that it took me a while to digest that statement when I first heard it. Once fully digested the statement was quite insightful. How many times do we think we know something when we really don’t? How many times do we act on an assumed understanding but find that our understanding was flawed? How sound was our decision when we had the flawed understanding? The same holds true as it relates to the use (or lack thereof) of business information. We assume that we don’t need business information because it will not tell us much as it relates to our underwriting. How can the business data be relevant to our underwriting when we know that the business performance is highly correlated to the performance of the owner? Let’s look at a study done a couple of years ago by the Business Information group at Experian. The data comes from a whitepaper titled “Predicting Risk: the relationship between business and consumer scores” and was published in 2008. The purpose of the study was to determine which goes bad first, the business or the owner. At a high level the data shows the following: If you're interested, you can download the full study here. So while a majority of time and without any additional segmentation, the business will show signs of stress before the owner. If we look at the data using length of time in business we see some additional insights. Figure: Distribution of businesses by years in business Interesting distinction is that based upon the age of the business we will see the owner going bad before the business if the business age is 5 years or less. Once we get beyond the 5 year point the “first bad” moves to the business. In either case, there is no clear case to be made to exclude one data source in favor of the other to predict risk in a small business origination process. While we can look at see that there is an overall majority where the business goes bad first or that if we have a young small business the owner will more likely go bad first, in either case, there is still a significant population where the inverse is true. Bottom line, gathering both the business and the consumer data allows the financial institution to make a better and more informed decision. In other words, it prevents us from the damage caused by “thinking we know something when we really don’t”. Coming up next month – Decisioning Strategies.
Part I: Types and Complexity of Models, and Unobservable or Omitted Variables or Relationships By: John Straka Since the financial crisis, it’s not unusual to read articles here and there about the “failure of models.” For example, a recent piece in Scientific American critiqued financial model “calibration,” proclaiming in its title, Why Economic Models are Always Wrong. In the mortgage business, for example, it is important to understand where models have continued to work, as well as where they failed, and what this all means for the future of your servicing and origination business. I also see examples of loose understanding about best practices in relation to the shortcomings of models that do work, and also about the comparative strengths and weaknesses of alternative judgmental decision processes. With their automation efficiencies, consistency, valuable added insights, and testability for reliability and robustness, statistical business models driven by extensive and growing data remain all around us today, and they are continuing to expand. So regardless of your views on the values and uses of models, it is important to have a clear view and sound strategies in model usage. A Categorization: Ten Types of Models Business models used by financial institutions can be placed in more than ten categories, of course, but here are ten prominent general types of models: Statistical credit scoring models (typically for default) Consumer- or borrower-response models Consumer- or borrower-characteristic prediction models Loss given default (LGD) and Exposure at default (EAD) models Optimization tools (these are not models, per se, but mathematical algorithms that often use inputs from models) Loss forecasting and simulation models and Value-at-risk (VAR) models Valuation, option pricing, and risk-based pricing models Profitability forecasting and enterprise-cash-flow projection models Macroeconomic forecasting models Financial-risk models that model complex financial instruments and interactions Types 8, 9 and 10, for example, are often built up from multiple component models, and for this reason and others, these model categories are not mutually exclusive. Types 1 through 3, for example, can also be built from individual-level data (typical) or group-level data. No categorical type listing of models is perfect, and this listing is also not intended to be completely exhaustive. The Strain of Complexity (or Model Ambition) The principle of Occam’s razor in model building, roughly translated, parallels the business dictum to “keep it simple, stupid.” Indeed, the general ordering of model types 1 through 10 above (you can quibble on the details) tends to correspond to growing complexity, or growing model ambition. Model types 1 and 2 typically forecast a rank-ordering, for example, rather than also forecasting a level. Credit scores and credit scoring typically seek to rank-order consumers in their default, loss, or other likelihoods, without attempting to project the actual level of default rates, for example, across the score distribution. Scoring models that add the dimension of level prediction increase this layer of complexity. In addition, model types 1 through 3 are generally unconditional predictors. They make no attempt to add the dimension of predicting the time path of the dependent variable. Predicting not just a consumer’s relative likelihood of an event over a future time period as a whole, for example, but also the event’s frequency level and time path of this level each year, quarter, or month, is a more complex and ambitious modeling endeavor. (This problem is generally approached through continuous or discrete hazard models.) While generalizations can be hazardous (exceptions can typically be found), it is generally true that, in the events leading up to and surrounding the financial crisis, greater model complexity and ambition was correlated with greater model failure. For example, at what is perhaps an extreme, Coval, Jurek, and Stafford (2009) have demonstrated how, for model type 10, even slight unexpected changes in default probabilities and correlations had a substantial impact on the expected payoffs and ratings of typical collateralized debt obligations (CDOs) with subprime residential mortgage-backed securities as their underlying assets. Nonlinear relationships in complex systems can generate extreme unreliability of system predictions. To a lesser but still significant degree, the mortgage- or housing-related models included or embedded in types 6 through 10 were heavily dependent on home-price projections and risk simulation, which caused significant “expected”-model failures after 2006. Home-price declines in 2007-2009 reached what had previously only been simulated as extreme and very unlikely stress paths. Despite this clear problem, given the inescapable large impact of home prices on any mortgage model or decision system (of any kind), it is generally acceptable to separate the failure of the home-price projection from any failure of the relative default and other model relationships built around the possible home-price paths. In other words, if a model of type 8, for example, predicted the actual profitability and enterprise cash flow quite well given the actual extreme path of home prices, then this model can be reasonably regarded as not having failed as a model per se, despite the clear, but inescapable reliance of the model’s level projections on the uncertain home-price outcomes. Models of type 1, statistical credit scoring models, generally continued to work well or reasonably well both in the years preceding and during the home-price meltdown and financial crisis. This is very largely due to these models’ relatively modest objective of simply rank-ordering risks, in general. To be sure, scoring models in mortgage, and more generally, were strongly impacted by the home price declines and unusual events of the bubble and subsequent recession, with deteriorated strength in risk separation. This can be seen, for example, in the recent VantageScore® credit score stress-test study, VantageScore® Stress Testing, which shows the lowest risk separation ability in the states with the worst home-price and unemployment outcomes (CA, AZ, FL, NV, MI). But these kinds of significant but comparatively modest magnitudes of deterioration were neither debilitating nor permanent for these models. In short, even in mortgage, scoring models generally held up pretty well, even through the crisis—not perfectly, but comparatively better than the more complex level-, system-, and path-prediction models. (see footnote 1) Scoring models have also relied more exclusively on microeconomic behavioral stabilities, rather than including macroeconomic risk modeling. Fortunately the microeconomic behavioral patterns have generally been much more stable. Weak-credit borrowers, for example, have long tended to default at significantly higher rates than strong credit borrowers—they did so preceding, and right through, the financial crisis, even as overall default levels changed dramatically; and they continue to do so today, in both strong and weak housing markets. (see footnote 2) As a general rule overall, the more complex and ambitious the model, the more complex are the many questions that have to be asked concerning what could go wrong in model risks. But relative complexity is certainly not the only type of model risk. Sometimes relative simplicity, otherwise typically desirable, can go in a wrong direction. Unobservable or Omitted Variables or Relationships No model can be perfect, for many reasons. Important determining variables may be unmeasured or unknown. Similarly, important parameters and relationships may differ significantly across different types of populations, and different time periods. How many models have been routinely “stress tested” on their robustness in handling different types of borrower populations (where unobserved variables tend to lurk) or different shifts in the mix of borrower sub-populations? This issue is more or less relevant depending on the business and statistical problem at hand, but overall, modeling practice has tended more often than not to neglect robustness testing (i.e., tests of validity and model power beyond validation samples). Several related examples from the last decade appeared in models that were used to help evaluate subprime loans. These models used generic credit scores together with LTV, and perhaps a few other variables (or not), to predict subprime mortgage default risks in the years preceding the market meltdown. This was a hazardous extension of relatively simple model structures that worked better for prime mortgages (but had also previously been extended there). Because, for example, the large majority of subprime borrowers had weak credit records, generic credit scores did not help nearly as much to separate risk. Detailed credit attributes, for example, were needed to help better predict the default risks in subprime. Many pre-crisis subprime models of this kind were thus simplified but overly so, as they began with important omitted variables. This was not the only omitted-variables problem in this case, and not the only problem. Other observable mortgage risk factors were oddly absent in some models. Unobserved credit risk factors also tend to be correlated with observed risk factors, creating greater volatility and unexplained levels of higher risk in observed higher-credit-risk populations. Traditional subprime mortgages also focused mainly on poor-credit borrowers who needed cashout refinancing for debt consolidation or some other purpose. Such borrowers, in shaky financial condition, were more vulnerable to economic shocks, but a debt consolidating cashout mortgage could put them in a better position, with lower total monthly debt payments that were tax deductible. So far, so good—but an omitted capacity-risk variable was the number of previous cashout refinancings done (which loan brokers were incented to “churn”). The housing bubble allowed weak-capacity borrowers to sustain themselves through more extracted home equity, until the music stopped. Rate and fee structures of many subprime loans further heightened capacity risks. A significant population shift also occurred when subprime mortgage lenders significantly raised their allowed LTVs and added many more shaky purchase-money borrowers last decade; previously targeted affordable-housing programs from the banks and conforming-loan space had instead generally required stronger credit histories and capacity. Significant shifts like this in any modeled population require very extensive model robustness testing and scrutiny. But instead, projected subprime-pool losses from the major purchasers of subprime loans, and the ratings agencies, went down in the years just prior to the home-price meltdown, not up (to levels well below those seen in widely available private-label subprime pool losses from 1990’s loans). Rules and Tradition in Lieu of Sound Modeling Interestingly, however, these errant subprime models were not models that came into use in lender underwriting and automated underwriting systems for subprime—the front-end suppliers of new loans for private-label subprime mortgage-backed securities. Unlike the conforming-loan space, where automated underwriting using statistical mortgage credit scoring models grew dramatically in the 1990s, underwriting in subprime, including automated underwriting, remained largely based on traditional rules. These rules were not bad at rank-ordering the default risks, as traditional classifications of subprime A-, B, C and D loans showed. However, the rules did not adapt well to changing borrower populations and growing home-price risks either. Generic credit scores improved for most subprime borrowers last decade as they were buoyed by the general housing boom and economic growth. As a result, subprime-lender-rated C and D loans largely disappeared and the A- risk classifications grew substantially. Moreover, in those few cases where statistical credit scoring models were estimated on subprime loans, they identified and separated the risks within subprime much better than the traditional underwriting rules. (I authored an invited article early last decade, which included a graph, p. 222, that demonstrated this, Journal of Housing Research.) But statistical credit scoring models were scarcely or never used in most subprime mortgage lending. In Part II, I’ll discuss where models are most needed now in mortgages. Footnotes: [1] While credit scoring models performed better than most others, modelers can certainly do more to improve and learn from the performance declines at the height of the home-price meltdown. Various approaches have been undertaken to seek such improvements. [2] Even strategic mortgage defaults, while comprising a relatively larger share of strong-credit borrower defaults, have not significantly changed the traditional rank-ordering, as strategic defaults occur across the credit spectrum (weaker credit histories include borrowers with high income and assets).
By: Staci Baker Just before the holidays, the Fed released proposed rules, which implement Sections 165 and 166 of the Dodd-Frank Act. According to The American Bankers Association, “The proposals cover such issues as risk-based capital requirements, leverage, resolution planning, concentration limits and the Fed’s plans to regulate large, interconnected financial institutions and nonbanks.” How will these rules affect you? One of the biggest concerns that I have been hearing from institutions is the affect that the proposed rules will have on profitability. Greater liquidity requirements, created by both the Dodd-Frank Act and Basel III Rules, put pressure on banks to re-evaluate which lending segments they will continue to participate in, as well as impact the funds available for lending to consumers. What are you doing to proactively combat this? Within the Dodd-Frank Act is the Durbin Amendment, which regulates the interchange fee an issuer can charge a consumer. As I noted in my prior blog detailing the fee cap associated with the Durbin Amendment, it’s clear that these new regulations in combination with previous rulings will continue to put downward pressures on bank profitability. With all of this to consider, how will banks modify their business models to maintain a healthy bottom line, while keeping customers happy? Over my next few blog posts, I will take a look at the Dodd-Frank Act’s affect on an institution’s profitability and highlight best practices to manage the impact to your organization.
For as long as there have been loans, there has been credit risk and risk management. In the early days of US banking, the difficulty in assessing risk meant that lending was severely limited, and many people were effectively locked out of the lending system. Individual review of loans gave way to numerical scoring systems used to make more consistent credit decisions, which later evolved into the statistically derived models we know today. Use of credit scores is an essential part of almost every credit decision made today. But what is the next evolution of credit risk assessment? Does that current look at a single number tell all we need to know before extending credit? As shown in a recent score stability study, VantageScoreSM remains very predictive even in highly volatile cycles. While generic risk scores remain the most cost-effective, expedient and compliant method of assessing risk, this last economic cycle clearly shows a need for the addition of other metrics (including other generic scores) to more fully illuminate the inherent risk of an individual from every angle. We’ve seen financial institutions tightening their lending policies in response to recent market conditions, sometimes to the point of hampering growth. But what if there was an opportunity to relook at this strategy with additional analytics to ensure continued growth without increasing risk? We'll plan to explore that further over the coming weeks, so stick with me. And if there is a specific question or idea on your mind, leave a comment and we'll cover that too.
By: Staci Baker Just before the holidays, the Fed released proposed rules, which implement Sections 165 and 166 of the Dodd-Frank Act. According to The American Bankers Association, “The proposals cover such issues as risk-based capital requirements, leverage, resolution planning, concentration limits and the Fed’s plans to regulate large, interconnected financial institutions and nonbanks.” How will these rules affect you? One of the biggest concerns that I have been hearing from institutions is the affect that the proposed rules will have on profitability. Greater liquidity requirements, created by both the Dodd-Frank Act and Basel III Rules, put pressure on banks to re-evaluate which lending segments they will continue to participate in, as well as impact the funds available for lending to consumers. What are you doing to proactively combat this? Within the Dodd-Frank Act is the Durbin Amendment, which regulates the interchange fee merchants are charged. As I noted in my prior blog detailing the fee cap associated with the Durbin Amendment, it’s clear that these new regulations in combination with previous rulings will continue to put downward pressures on bank profitability. With all of this to consider, how will banks modify their business models to maintain a healthy bottom line, while keeping customers happy? Over my next few blog posts, I will take a look at the Dodd-Frank Act’s affect on an institution’s profitability and highlight best practices to manage the impact to your organization.
As we kick off the new year, I thought I’d dedicate a few blog posts to cover what some of the consumer credit trends are pointing to for potential growth opportunities in 2012, specifically on new loan originations for bankcard, automotive and real estate lending. With the holiday season behind us (and if you’re anything like me, you have the credit card statements to prove it!), I thought I’d start off with bankcards for my first post of the year. Everyone’s an optimist at the start of a new year and bankcard issuers have a right to feel cautiously optimistic about 2012 based on the trends of last year. In the second quarter of 2011, origination volumes grew to nearly $47B, up 28% from the same quarter a year earlier. Actually, originations have been steadily growing since the middle of 2010 with increasing distribution across all VantageScore risk bands and an impressive 42% increase in A paper volume. So, is bankcard the new power portfolio for growth in 2012? The broad origination risk distribution may signal the return of balance-carrying consumers (aka: revolvers) from those that pay with credit cards, but pay off the balance every month (aka: transactors). The tighter lending criteria imposed in recent years has improved portfolio performance significantly, but at the expense of interest fee profitability from revolver use. This could change as more credit cards are put in the hands of a broader consumer risk base. And as consumer confidence continues to grow, (it reached 64.5 in December, 10 points higher than November according to the Conference Board) , consumers in all risk categories will no doubt begin to leverage credit cards more heavily for continued discretionary spend, as highlighted in the most recent Experian – Oliver Wyman quarterly webinar. Of course, portfolio growth with the increased risk exposure requires a watchful eye on the delinquency performance of outstanding balances. We continue to be at or near historic lows for delinquency, but did see a small uptick in early stage delinquencies in the third quarter of 2011. That being said, issuers appear to have a good pulse on the card-carrying consumer and are capitalizing on the improved payment behavior to maximize their risk/reward payoff. So all-in-all, strong 2011 results and portfolio positioning has set the table for a promising 2012. Add an improving economy to the mix and card issuers could shift from cautious to confident in their optimism for the new year.
By: Joel Pruis Small Business Application Requirements The debate on what constitutes a small business application is probably second only to the ongoing debate around centralized vs. decentralized loan authority (but we will get to that topic in a couple of blogs later). We have a couple of topics that need to be considered in this discussion, namely: 1. When is an application an application? 2. Do you process an incomplete application? When is an application an application? Any request by a small business with annual sales of $1,000,000 or less falls under Reg B. As we all know because of this regulation we have to maintain proper records of when we received an application and when a decision on the application was made as well as communicated to the client. To keep yourself out of trouble, I recommend that there be a small business application form (paper or electronic) and that you have clearly stated the information required for a completed application in your small business application procedures. The form removes ambiguities in the application process and helps with the compliance documentation. One thing is for certain – when you request a personal credit bureau on the small business owner(s)/guarantor(s) and you currently do not have any credit exposure to the individual(s) – you have received an application and to this there is no debate. Bottom line is that you need to define your application and do so using objective criteria. Subjective criteria leaves room for interpretation and individual interpretation leaves doubt in the compliance area. Information requirements Whether or not you use a generic or custom small business scorecard or no scorecard at all, there are some baseline data segments that are important to collect on the small business applicant: · Requested amount and purpose for the funds · Collateral (if necessary based upon the product terms and conditions) · General demographics on the business o Name and location o Business Entity type (corporation, llc, partnership, etc.) o Product and/or service provided o Length of time in business o Current banking relationship · General demographics on the owners/guarantors o Names and addresses o Current banking relationship o Length of time with the business · External data reports on the business and/or guarantors o Business Report o Personal Credit Bureau on the owners/guarantors · Financial Statements (?) – we’ll talk about that in part II of this post. The demographics and the existing banking relationship are likely not causing any issues with anyone and the requested amount and use of funds is elementary to the process. Probably the greatest debate is around the collection of financial information and we are going to save that debate for the next post. The non-financial information noted above provides sufficient data to pull personal credit bureaus on the owners/guarantors and the business bureau on the actual borrower. We have even noted some additional data informing us the length of time the business has been in existence and where the banking relationship is currently held for both the business and the owners. But what additional information should be requested or should I say required? We have to remember that the application is not only to support the ability to render a decision but also supports the ability to document the loan and maybe even serve as a portion of the loan documentation. We need to consider the following: · How standardized are the products we offer? · Do we allow for customization of collateral to be offered? · Do we have standard loan/fee pricing? · Is automatic debit for the loan payments required? Optional? Not available? · Are personal guarantees required? Optional? We again go back to the 80/20 rule. Product standardization is beneficial and optimal when we have high volumes and low dollars. The smaller the dollar size of the request/relationship the more standardized we need to have our products and as a result our application can be more streamlined. When we do not negotiate rate, we do not need to have a space to note requested rate. When we do not negotiate on personal guarantees we always require the personal financial information be collected on all owners of the business (some exceptions for very small ownership interests). Auto-debit for the loan payments means we always need to have some form of a DDA account with our institution. I think you get the point that for the highest volume of applications we standardize and thus streamline the process through the removal of ambiguity. Do you process an incomplete application? The most common argument for processing an incomplete application is that if we know we are going to decline the application based upon information on the personal credit bureau, why go through the effort of collecting and spreading the financial information. Two significant factors make this argument moot: customer satisfaction and fair lending regulation. Customer satisfaction This is based upon the ease of doing business with the financial institution. More specifically the number of contact points or information requests that are required during the process. Ideally the number of contact points that are required once the applicant has decided to make a financing request should be minimal the information requirements clearly communicated up front and fully collected prior to rendering a decision. The idea that a quick no is preferable to submitting a full application actually is working to make the declination process more efficient than the actual approval process. So in other words we are making the process more efficient and palatable for those clients we do NOT consider acceptable versus those clients that ARE acceptable. Secondly, if we accept and process incomplete applications, we are actually mis-prioritizing the application volume. Incomplete applications should never be processed ahead of completed packages yet under the quick no objective, the incomplete application is processed ahead of completed applications simply based upon date and time of submission. Consequently we are actually incenting and fostering the submission of incomplete applications by our lenders. Bluntly this is a backward approach that only serves to make the life of the relationship manager more efficient and not the client. Fair lending regulation This perspective poses a potential issue when it comes to consistency. In my 10 years working with hundreds of financial institutions, only a very small minority of times have I encountered a financial institution that is willing to state with absolute certainty that a particular characteristic will cause an application to e declined 100% of the time. As a result, I wish to present this scenario: · Applicant A provides an incomplete application (missing financial statements, for example). o Application is processed in an incomplete status with personal and business bureaus pulled. o Personal credit bureau has blemishes which causes the financial institution to decline the application o Process is complete · Applicant B provides a completed application package with financial statements o Application is processed with personal and business bureaus pulled, financial statements spread and analysis performed o Personal credit bureau has the same blemishes as Applicant A o Financial performance prompts the underwriter or lender to pursue an explanation of why the blemishes occurred and the response is acceptable to the lender/underwriter. Assuming Applicant A had similar financial performance, we have a case of inconsistency due to a portion of the information that we “state” is required for an application to be complete yet was not received prior to rendering the decision. Bottom line the approach causes doubt with respect to inconsistent treatment and we need to avoid any potential doubt in the minds of our regulators. Let’s go back to the question of financial statements. Check back Thursday for my follow-up post, or part II, where we’ll cover the topic in greater detail.
By: Joel Pruis The debate on what constitutes a small business application is probably second only to the ongoing debate around centralized vs. decentralized loan authority (but we will get to that topic in a couple of blogs later). We have a couple of topics that need to be considered in this discussion, namely: 1. When is an application an application? 2. Do you process an incomplete application? When is an application an application? Any request by a small business with annual sales of $1,000,000 or less falls under Reg B. As we all know because of this regulation we have to maintain proper records of when we received an application and when a decision on the application was made as well as communicated to the client. To keep yourself out of trouble, I recommend that there be a small business application form (paper or electronic) and that you have clearly stated the information required for a completed application in your small business application procedures. The form removes ambiguities in the application process and helps with the compliance documentation. One thing is for certain – when you request a personal credit bureau on the small business owner(s)/guarantor(s) and you currently do not have any credit exposure to the individual(s) – you have received an application and to this there is no debate. Bottom line is that you need to define your application and do so using objective criteria. Subjective criteria leaves room for interpretation and individual interpretation leaves doubt in the compliance area. Information requirements Whether or not you use a generic or custom small business scorecard or no scorecard at all, there are some baseline data segments that are important to collect on the small business applicant: Requested amount and purpose for the funds Collateral (if necessary based upon the product terms and conditions) General demographics on the business Name and location Business Entity type (corporation, llc, partnership, etc.) Product and/or service provided Length of time in business Current banking relationship General demographics on the owners/guarantors Names and addresses Current banking relationship Length of time with the business External data reports on the business and/or guarantors Business Report Personal Credit Bureau on the owners/guarantors Financial Statements (??) – we’ll talk about that in part II of this post. The demographics and the existing banking relationship are likely not causing any issues with anyone and the requested amount and use of funds is elementary to the process. Probably the greatest debate is around the collection of financial information and we are going to save that debate for the next post. The non-financial information noted above provides sufficient data to pull personal credit bureaus on the owners/guarantors and the business bureau on the actual borrower. We have even noted some additional data informing us the length of time the business has been in existence and where the banking relationship is currently held for both the business and the owners. But what additional information should be requested or should I say required? We have to remember that the application is not only to support the ability to render a decision but also supports the ability to document the loan and maybe even serve as a portion of the loan documentation. We need to consider the following: How standardized are the products we offer? Do we allow for customization of collateral to be offered? Do we have standard loan/fee pricing? Is automatic debit for the loan payments required? Optional? Not available? Are personal guarantees required? Optional? We again go back to the 80/20 rule. Product standardization is beneficial and optimal when we have high volumes and low dollars. The smaller the dollar size of the request/relationship the more standardized we need to have our products and as a result our application can be more streamlined. When we do not negotiate rate, we do not need to have a space to note requested rate. When we do not negotiate on personal guarantees we always require the personal financial information be collected on all owners of the business (some exceptions for very small ownership interests). Auto-debit for the loan payments means we always need to have some form of a DDA account with our institution. I think you get the point that for the highest volume of applications we standardize and thus streamline the process through the removal of ambiguity. Do you process an incomplete application? The most common argument for processing an incomplete application is that if we know we are going to decline the application based upon information on the personal credit bureau, why go through the effort of collecting and spreading the financial information. Two significant factors make this argument moot: customer satisfaction and fair lending regulation. Customer satisfaction This is based upon the ease of doing business with the financial institution. More specifically the number of contact points or information requests that are required during the process. Ideally the number of contact points that are required once the applicant has decided to make a financing request should be minimal the information requirements clearly communicated up front and fully collected prior to rendering a decision. The idea that a quick no is preferable to submitting a full application actually is working to make the declination process more efficient than the actual approval process. So in other words we are making the process more efficient and palatable for those clients we do NOT consider acceptable versus those clients that ARE acceptable. Secondly, if we accept and process incomplete applications, we are actually mis-prioritizing the application volume. Incomplete applications should never be processed ahead of completed packages yet under the quick no objective, the incomplete application is processed ahead of completed applications simply based upon date and time of submission. Consequently we are actually incenting and fostering the submission of incomplete applications by our lenders. Bluntly this is a backward approach that only serves to make the life of the relationship manager more efficient and not the client. Fair lending regulation This perspective poses a potential issue when it comes to consistency. In my 10 years working with hundreds of financial institutions, only a very small minority of times have I encountered a financial institution that is willing to state with absolute certainty that a particular characteristic will cause an application to e declined 100% of the time. As a result, I wish to present this scenario: Applicant A provides an incomplete application (missing financial statements, for example). {C}Application is processed in an incomplete status with personal and business bureaus pulled. Personal credit bureau has blemishes which causes the financial institution to decline the application Process is complete Applicant B provides a completed application package with financial statements Application is processed with personal and business bureaus pulled, financial statements spread and analysis performed Personal credit bureau has the same blemishes as Applicant A Financial performance prompts the underwriter or lender to pursue an explanation of why the blemishes occurred and the response is acceptable to the lender/underwriter. Assuming Applicant A had similar financial performance, we have a case of inconsistency due to a portion of the information that we “state” is required for an application to be complete yet was not received prior to rendering the decision. Bottom line the approach causes doubt with respect to inconsistent treatment and we need to avoid any potential doubt in the minds of our regulators. Let’s go back to the question of financial statements. Check back Thursday for my follow-up post, or part II, where we’ll cover the topic in greater detail.