{"id":2417,"date":"2024-09-03T12:39:47","date_gmt":"2024-09-03T11:39:47","guid":{"rendered":"https:\/\/blogs.bath.ac.uk\/iprblog\/?p=2417"},"modified":"2024-09-03T12:39:47","modified_gmt":"2024-09-03T11:39:47","slug":"ai-lending-will-make-finance-deals-even-more-unfair-for-women-heres-how-this-can-be-avoided","status":"publish","type":"post","link":"https:\/\/blogs.bath.ac.uk\/iprblog\/2024\/09\/03\/ai-lending-will-make-finance-deals-even-more-unfair-for-women-heres-how-this-can-be-avoided\/","title":{"rendered":"AI lending will make finance deals even more unfair for women \u2013 here\u2019s how this can be\u00a0avoided"},"content":{"rendered":"<div class=\"theconversation-article-body\">\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2418\" src=\"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/55.png\" alt=\"\" width=\"1024\" height=\"576\" srcset=\"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/55.png 1024w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/55-300x169.png 300w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/55-768x432.png 768w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/55-382x215.png 382w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p><em><a href=\"https:\/\/researchportal.bath.ac.uk\/en\/persons\/christopher-amaral\">Christopher Amaral<\/a> is an Assistant Professor of Marketing at the <a href=\"https:\/\/www.bath.ac.uk\/\">University of Bath<\/a>. This article is republished from <a href=\"https:\/\/theconversation.com\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/ai-lending-will-make-finance-deals-even-more-unfair-for-women-heres-how-this-can-be-avoided-237783\">original article here<\/a>.<\/em><\/p>\n<p>It\u2019s fairly well known that women receive less favourable loan terms from salespeople, on average, than men when they borrow money. <a href=\"https:\/\/www.informs.org\/News-Room\/INFORMS-Releases\/News-Releases\/New-Research-Finds-Women-and-Minorities-Likely-to-Pay-Higher-Auto-Loan-Premiums\">One recent study<\/a> into lending practices in US car dealerships recently confirmed as much. Equally, it has been found in <a href=\"https:\/\/www.spglobal.com\/marketintelligence\/en\/news-insights\/latest-news-headlines\/women-pay-higher-interest-rates-on-bank-loans-than-men-danish-study-finds-60093020\">bank lending<\/a> and <a href=\"https:\/\/www.nytimes.com\/2007\/01\/21\/realestate\/21mort.html\">mortgages<\/a> for many years around the world.<\/p>\n<p>The academic literature <a href=\"https:\/\/doi.org\/10.1509\/jmr.13.0291\">suggests that<\/a> salespeople may offer women worse terms in the belief they know less about the market, and so will be less capable of assessing whether they\u2019re getting a fair deal. It might also be that women are penalised for <a href=\"https:\/\/doi.org\/10.1509\/jmr.13.0291\">not being<\/a> as assertive as men.<\/p>\n<p>One increasingly pressing question is how this will be affected by artificial intelligence (AI) as it comes to play a bigger part in lending. Though banks and other lenders can be coy about the extent to which they\u2019re using <a href=\"https:\/\/en.wikipedia.org\/wiki\/Machine_learning\">machine learning<\/a> and <a href=\"https:\/\/en.wikipedia.org\/wiki\/Generative_artificial_intelligence\">generative AI<\/a> in lending, it\u2019s certainly <a href=\"https:\/\/www.creditstrategy.co.uk\/cs-ai-and-tech\/ai-and-tech\/ai-in-lending-disruption-ethics-and-the-future#:%7E:text=AI%20and%20machine%20learning%20can,creditworthiness%20and%20affordability%20as%20required.\">already happening<\/a> behind the scenes and is set to become much <a href=\"https:\/\/www.finastra.com\/viewpoints\/white-paper\/rise-generative-artificial-intelligence-lending?state=unlocked\">more important<\/a> over the next couple of years.<\/p>\n<p>You might think AI could reduce lending discrimination against women, perhaps by neutralising the biases of sales representatives. In fact, a <a href=\"https:\/\/doi.org\/10.1177\/10591478241259791\">new study<\/a> from my research group indicates that it has the potential to get worse. So why is this, and can it be avoided?<\/p>\n<p>Our research looked at more than 50,000 car loans in Canada, and found yet more evidence of lending discrimination against women. In the field of credit research, the standard way of comparing loans is known as \u201cexpected utility\u201d.<\/p>\n<p>This measures how much a loan benefits a borrower by considering factors like the interest rate, the likelihood of it being approved, and the amount of effort the salesperson allocates to the borrower. We found that the expected utility of loans was 68% lower for women than for men.<\/p>\n<p>To see how AI might change the car industry, which is still only in the early stages of adopting it, we looked at how machine learning could optimise the commissions that lenders pay to salespeople for arranging loans for car buyers. Commissions play an essential role in car lending, influencing sales representatives\u2019 <a href=\"https:\/\/www.canada.ca\/content\/dam\/canada\/financial-consumer-agency\/migration\/eng\/resources\/researchsurveys\/documents\/auto-finance-market-trends.pdf\">loan-pricing decisions<\/a> and making up a substantial portion of <a href=\"https:\/\/www.nber.org\/system\/files\/working_papers\/w28136\/w28136.pdf\">dealership revenue<\/a>.<\/p>\n<p>Perhaps in an ideal world, incorporating AI into this process would mean you could automate loan pricing, remove salespeople\u2019s involvement and just do away with their commissions. In reality, there\u2019s enough competition between lenders, and the dealerships make so much money from the commissions, that they would probably just take their business elsewhere. The loan commission model is therefore unlikely to change \u2013 either in the car industry or in consumer lending more generally.<\/p>\n<p>Instead, the opportunity for lenders is to use machine learning to optimise commissions so that sales representatives select loan rates that yield higher expected profits for the lender, and are motivated to devote enough effort to the customer to get them to agree to the deal. By doing this, we <a href=\"https:\/\/doi.org\/10.1177\/10591478241259791\">found that<\/a> lenders would be able to boost their profits by 8%. This, of course, is at the expense of customers. We found that the expected utility of loans to customers falls by 20% in this scenario.<\/p>\n<p>However, when we compared men and women borrowers, we found that the fall for women was 42% while it was only 17% for men. We didn\u2019t test for exactly what was happening, but it\u2019s a fair assumption that since the back data was \u201ccontaminated\u201d with bad loan deals for women, the AI exacerbated this by assuming women are more tolerant of worse offers than men.<\/p>\n<h2>The workaround<\/h2>\n<p>This confirms <a href=\"https:\/\/www.ft.com\/content\/e24c93b8-85e6-4002-afdd-dd650a274f16\">longstanding fears<\/a> among some industry watchers that AI could end up widening discrimination in lending, not only to women but to other groups who receive less favourable loan terms, such as certain ethnic minorities.<\/p>\n<p>It could be argued that the prudent approach would be for lenders to steer clear of AI altogether. Yet we wondered whether a compromise might be possible. Could we encourage lenders to use AI more responsibly, to change the trade-off between profits and social justice?<\/p>\n<p>We tested this in our study by programming the machine-learning algorithm to maximise profits while not worsening the expected utility of loans for women. In other words, utility only decreased for men. Under this restriction, we found that lenders could still increase their profits by 4%.<\/p>\n<p>This indicates that when used thoughtfully, AI can both benefit lenders and protect disadvantaged groups at the same time. In response to those who would rather keep AI away from financial services, it might be better to accept its inevitability and instead use it as a tool to make lending fairer.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img loading=\"lazy\" decoding=\"async\" style=\"border: none !important;box-shadow: none !important;margin: 0 !important;max-height: 1px !important;max-width: 1px !important;min-height: 1px !important;min-width: 1px !important;padding: 0 !important\" src=\"https:\/\/counter.theconversation.com\/content\/237783\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" \/><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n<p><em>All articles posted on this blog give the views of the author(s), and not the position of the IPR, nor of the University of Bath.<\/em><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Christopher Amaral is an Assistant Professor of Marketing at the University of Bath. This article is republished from The Conversation under a Creative Commons license. Read the original article here. It\u2019s fairly well known that women receive less favourable loan...<\/p>\n","protected":false},"author":1742,"featured_media":2419,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[150,128,112],"tags":[],"class_list":["post-2417","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-the-labour-market","category-economics"],"acf":[],"jetpack_featured_media_url":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/09\/54.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts\/2417","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/users\/1742"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/comments?post=2417"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts\/2417\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/media\/2419"}],"wp:attachment":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/media?parent=2417"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/categories?post=2417"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/tags?post=2417"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}