{"id":2506,"date":"2024-11-28T11:23:19","date_gmt":"2024-11-28T11:23:19","guid":{"rendered":"https:\/\/blogs.bath.ac.uk\/iprblog\/?p=2506"},"modified":"2025-03-10T21:26:02","modified_gmt":"2025-03-10T21:26:02","slug":"ai-feels-like-an-unstoppable-force-but-it-is-not-a-panacea-for-businesses-or-society","status":"publish","type":"post","link":"https:\/\/blogs.bath.ac.uk\/iprblog\/2024\/11\/28\/ai-feels-like-an-unstoppable-force-but-it-is-not-a-panacea-for-businesses-or-society\/","title":{"rendered":"AI feels like an unstoppable force. But it is not a panacea for businesses or\u00a0society"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2508\" src=\"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-copy.png\" alt=\"\" width=\"1024\" height=\"576\" srcset=\"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-copy.png 1024w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-copy-300x169.png 300w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-copy-768x432.png 768w, https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-copy-382x215.png 382w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p><em>Akhil Bhardwaj and Anastasia Sergeeva of the University of Bath explore the unintended consequences of AI. While AI holds immense promise, its reliance on past data risks stifling innovation, exacerbating overconfidence, and eroding human skills. They call for regulatory oversight to navigate AI\u2019s challenges responsibly.\u00a0<\/em><\/p>\n<p><em><a href=\"https:\/\/researchportal.bath.ac.uk\/en\/persons\/akhil-bhardwaj\">Akhil Bhardwaj<\/a> is an Associate Professor (Strategy and Organisation) in the School of Management, <a href=\"https:\/\/www.bath.ac.uk\/homepage\/\">University of Bath<\/a> and <a href=\"https:\/\/researchportal.bath.ac.uk\/en\/persons\/anastasia-sergeeva\">Anastasia Sergeeva<\/a> is a Senior Lecturer (Associate Professor) in Management Strategy &amp; Organisation at the <a href=\"https:\/\/www.bath.ac.uk\/homepage\/\">University of Bath.<\/a> This article is republished from <a href=\"https:\/\/theconversation.com\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/ai-feels-like-an-unstoppable-force-but-it-is-not-a-panacea-for-businesses-or-society-242886\">original article here<\/a>.<\/em><\/p>\n<div class=\"theconversation-article-body\">\n<p>In <a href=\"https:\/\/theconversation.com\/im-an-expert-in-ancient-greece-netflixs-kaos-is-the-cleverest-retelling-of-greek-mythology-ive-ever-seen-236824\">Greek mythology<\/a>, Prometheus is credited with giving humans fire as well as the \u201cspark\u201d that spurred civilisation. One of the unintended consequences of Prometheus\u2019s \u201cgift\u201d was that the need for celestial Gods diminished. Modern humans have been up to all sorts of things that present similar unintended consequences, from using CFCs that led to a <a href=\"https:\/\/ozonewatch.gsfc.nasa.gov\/facts\/hole_SH.html\">hole in the ozone layer<\/a> to building systems that they do not understand or <a href=\"https:\/\/doi.org\/10.5465\/AMBPP.2019.30\">cannot fully control<\/a>.<\/p>\n<p>In dabbling with artificial intelligence (AI), humans seem to have taken on the role of Prometheus \u2013 apparently gifting machines the \u201cfire\u201d that sparked civilisation.<\/p>\n<p>Predicting the future is best left to shamans and futurologists. But we could be better informed about the dangers that follow from how AI operates and work out how to avoid the pitfalls.<\/p>\n<p>First, we must recognise that AI holds immense promise for human society. AI is becoming <a href=\"https:\/\/www.europarl.europa.eu\/topics\/en\/article\/20200827STO85804\/what-is-artificial-intelligence-and-how-is-it-used\">ubiquitous<\/a> \u2013 from mundane tasks such as writing emails to complex settings that require human expertise.<\/p>\n<p>AI \u2013 by which we mean large language models (LLMs) that appear to \u201cunderstand\u201d and produce human language \u2013 are <a href=\"https:\/\/www.predictionmachines.ai\/\">prediction machines<\/a>. They are trained on large datasets that enable them to establish statistical associations between a huge number of variables and to predict what is next.<\/p>\n<p>If you have used Google, you might have experienced some version of this through its predictive prompts. For example, you might type \u201chow to drive\u201d and Google will complete it as \u201chow to drive an automatic car\u201d. It is unlikely to complete it with \u201chow to drive an aeroplane\u201d. Google establishes this by looking at the history of what words come after \u201chow to drive\u201d. The larger the dataset upon which it has been trained, the more accurate its prediction will be.<\/p>\n<p>Variations of this logic are used in all of its current applications. AI\u2019s strength, of course, is that it can process untold amounts of data, and extrapolate it to apply to the future.<\/p>\n<p>But this strength is also its weakness \u2013 it makes it vulnerable to a phenomenon management scholars refer to as the <a href=\"https:\/\/doi.org\/10.1287\/msom.2023.0034\">\u201cconfidence trap\u201d<\/a>. This is the tendency to assume that since earlier decisions have led to positive outcomes, continuing in the same way in future will continue to be OK.<\/p>\n<p>Consider an example: the intervals between maintenance of critical aeroplane parts. If increasing the intervals in the past has worked out fine (no failures), these might be adopted widely and there might be a push to increase the intervals further. Yet, it turned out that this was a recipe for <a href=\"https:\/\/www.routledge.com\/Drift-into-Failure-From-Hunting-Broken-Components-to-Understanding-Complex-Systems\/Dekker\/p\/book\/9781409422211?srsltid=AfmBOooilNMk09MpMdk7deJEQeyPXIBS5vT4Q6IFgWtVof1rx_Jhe1ab\">disaster<\/a>. Alaska Airlines flight 261 crashed into the Pacific Ocean killing all 88 people on board because \u2013 perhaps influenced by previous success \u2013 a decision was made to <a href=\"https:\/\/www.aviationpros.com\/home\/press-release\/10435303\/faa-investigates-safety-complaint-against-alaska-airlines\">delay the maintenance<\/a> of a critical part.<\/p>\n<p>AI might just exacerbate this tendency. It can take attention away from <a href=\"https:\/\/journals.aom.org\/doi\/abs\/10.5465\/AMPROC.2024.18485abstract\">signs that there are problems<\/a> as AI analysis feeds into the picture to inform decision-making.<\/p>\n<p>Or AI can extrapolate the results of the past and take decisions without human intervention. Take the example of driverless cars, which have been involved in <a href=\"https:\/\/www.theguardian.com\/technology\/2024\/apr\/26\/tesla-autopilot-fatal-crash\">more than a dozen cases<\/a> of pedestrians being killed. No dataset, no matter its size, can provide training for every potential action a pedestrian could take. AI cannot yet compete with human discretion in situations like these.<\/p>\n<p>But more worryingly, AI can diminish human capabilities to the extent that the ability to determine when to intervene might be lost. Researchers have found that use of AI leads to <a href=\"https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC11239631\/#:%7E:text=Thus%2C%20as%20AI%20assistants%20become,with%20automation%20induces%20skill%20decay\">skill decay<\/a> \u2013 a particular concern where workplace decisions involve life-or-death consequences.<\/p>\n<p>Amazon learned the hard way about letting \u201cprediction machines\u201d make decisions when its internal hiring tool <a href=\"https:\/\/www.cbsnews.com\/news\/new-york-city-artificial-intelligence-hiring-restriction\">discriminated against women<\/a> as it was trained on a database spanning a ten-year period that skewed towards males. These are, of course, examples that we are aware of. As LLMs get more complex and their inner workings become more opaque, we might not even realise when things go astray.<\/p>\n<h2>Looking backwards<\/h2>\n<p>Because AI mirrors the past, it might also be <a href=\"https:\/\/www.youtube.com\/watch?v=PF08uqhM978\">limited in its ability<\/a> to spark radical innovation. By definition, a radical innovation is a break from the past.<\/p>\n<p>Consider the context of photography. Innovative photographers were able to change the way in which the business was done \u2013 the <a href=\"https:\/\/dialnet.unirioja.es\/servlet\/tesis?codigo=288367\">history of photojournalism<\/a> is an example of how something that started as a way of illustrating the news gradually acquired storytelling power and was elevated to the status of an art form.<\/p>\n<p>Similarly, fashion designers such as Coco Chanel <a href=\"https:\/\/doi.org\/10.1017\/eso.2021.58\">modernised women\u2019s clothing<\/a>, freeing them from uncomfortable long skirts and corsets that lost their relevance in the post-war world.<\/p>\n<p>The founder of sportswear manufacturer Under Armour, former college football player Kevin Plank, used the discomfort from sweaty cotton undershirts as an opportunity to develop clothing using <a href=\"https:\/\/www.si.com\/more-sports\/2009\/04\/09\/under-armour\">microfibres<\/a> that draw moisture away from the body. AI can improve on these innovations. But because of how it operates in its current form, it is unlikely to be the source of novelties.<\/p>\n<p>Simply put, AI is unable to see or show us the world in a new way, a shortcoming we have termed the <a href=\"https:\/\/purehost.bath.ac.uk\/ws\/portalfiles\/portal\/343681757\/THE_AI_Chris_Rock_problem_Times_Higher_Education_.pdf\">\u201cAI Chris Rock problem\u201d<\/a>, inspired by a joke the comedian cracked about making bullets prohibitively expensive. By suggesting a remedy that involved \u201cbullet control\u201d rather than gun control to curb violence, Rock got laughs tapping into the cultural zeitgeist and presenting an innovative solution. In doing so, he also highlighted the absurdity of the situation \u2013 something that requires human perception.<\/p>\n<p>AI shows its shortcomings when what previously worked loses its relevance or problem-solving power. AI\u2019s past success means it will roll out in ever-widening circles \u2013 but this itself constitutes a confidence trap that humans should avoid.<\/p>\n<p>Prometheus was ultimately rescued by Hercules. No such god stands in the wings for humans. This implies more, rather than less, responsibility rests on our shoulders. Part of this includes ensuring our elected representatives provide regulatory oversight for AI. After all, we cannot let the technocrats play with fire at our expense.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img loading=\"lazy\" decoding=\"async\" style=\"border: none !important;box-shadow: none !important;margin: 0 !important;max-height: 1px !important;max-width: 1px !important;min-height: 1px !important;min-width: 1px !important;padding: 0 !important\" src=\"https:\/\/counter.theconversation.com\/content\/242886\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" \/><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n<p><em>All articles posted on this blog give the views of the author(s), and not the position of the IPR, nor of the University of Bath.<\/em><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Akhil Bhardwaj and Anastasia Sergeeva of the University of Bath explore the unintended consequences of AI. While AI holds immense promise, its reliance on past data risks stifling innovation, exacerbating overconfidence, and eroding human skills. They call for regulatory oversight...<\/p>\n","protected":false},"author":1742,"featured_media":2507,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[150,128,109,143,116,126],"tags":[],"class_list":["post-2506","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-the-labour-market","category-data-politics-and-policy","category-emerging-technologies","category-evidence-and-policymaking","category-science-and-research-policy"],"acf":[],"jetpack_featured_media_url":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-content\/uploads\/sites\/115\/2024\/11\/Blog-Images-2-2.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts\/2506","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/users\/1742"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/comments?post=2506"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/posts\/2506\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/media\/2507"}],"wp:attachment":[{"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/media?parent=2506"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/categories?post=2506"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/iprblog\/wp-json\/wp\/v2\/tags?post=2506"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}