{"id":1074,"date":"2023-03-16T17:25:20","date_gmt":"2023-03-16T17:25:20","guid":{"rendered":"https:\/\/blogs.bath.ac.uk\/clt\/?p=1074"},"modified":"2023-03-16T17:26:28","modified_gmt":"2023-03-16T17:26:28","slug":"generative-artificial-intelligence-ai-and-academic-integrity-part-2","status":"publish","type":"post","link":"https:\/\/blogs.bath.ac.uk\/clt\/2023\/03\/16\/generative-artificial-intelligence-ai-and-academic-integrity-part-2\/","title":{"rendered":"Generative Artificial Intelligence (AI) and Academic Integrity - Part 2"},"content":{"rendered":"

UPDATE:<\/span><\/h4>\n

On the 7 March, the CLT hosted a webinar on Generative AI as part of our EduTalk series. Colleagues from the Departments of Computer Science, Health and the School of Management presented on their initial work and findings using ChatGPT in the context of learning, teaching and assessment. Find our more and watch the recordings on our Teaching Hub<\/a>.<\/span><\/p>\n

NEW DEVELOPMENT:<\/span><\/h4>\n

On the 14\u00a0March, ChatGPT-4 was released, which includes some refinements (such as permitting up to 25K words as an input, and the ability to input images in the search<\/a>). Currently, this is available either as a paid version via OpenAI (including their APIs), or via the Bing ChatGPT trial. Only the developer API version can be used, at present, to accept images.<\/span><\/p>\n

\"Decorative
Image generated by AI image generator, Craiyon.<\/figcaption><\/figure>\n

Can we ban students from using AI?\u202f<\/span><\/b>\u202f<\/span><\/b>\u00a0<\/span><\/h2>\n

In a word: no.<\/span>\u00a0<\/span><\/p>\n

TL:DR: even if we could ban students use of generative AI entirely in assessments, this would not enable them to learn how to use such technologies effectively, ethically and transparently in their studies, and this might fail to prepare them for the future world of work.<\/p>\n

The longer answer: w<\/span>hen<\/span> a new technology appears \u2013 or is thrust into the limelight in a new way<\/span> \u2013 it is quite natural to be sceptical (after all, how many times have we been promised that technology will solve all our problems, only to end up generating new challenges to solve<\/span> or being put at the back of our technological cupboard never to be played with again<\/span>?)<\/span> What<\/span> is<\/span> more,<\/span> t<\/span>he UK government<\/span> h<\/span>as banned engaging in <\/span><\/span>Essay Mills<\/span><\/span><\/a> and contract cheating <\/span>\u2013<\/span> and if<\/span> ChatGPT<\/span> and tools like it is<\/span> essentially a glorified essay mill<\/span>, and <\/span>poses such a threat to academic integrity, should we ban <\/span>generative AI<\/span> too?\u202f<\/span><\/span>\u00a0<\/span><\/p>\n

Whilst tempting, it is precisely the ubiquity of such tools \u2013 and the likelihood that they will become even more ubiquitous in the future \u2013 both in the workplace and for learning and teaching \u2013 that makes banning ChatGPT and generative AI tools a zero-sum game. Moreover, as noted earlier, banning students from using such tools in assessment might also have unintended consequences. As the <\/span>National Centre for AI argues<\/span><\/a>:<\/span>\u00a0<\/span><\/p>\n

\u2026on the face of it, this seems [simple], but then again there are problems with the detail.\u202f As I write this in Microsoft Word, I have predictive text enabled, and AI is indeed generating some of the words that I\u2019m writing (it just wrote the word \u2018writing\u2019 for me then!).<\/span>\u00a0<\/span><\/p>\n

I make extensive use of Grammarly and often utilize it to revise sentences, improving their readability and rectifying mistakes. Yes, that last sentence was rewritten for me by Grammarly. \u202fIt\u2019s been generated by AI.\u202f This is almost certainly not the kind of use case we actually want to prohibit though.<\/span>\u00a0<\/span><\/p><\/blockquote>\n

A ban may achieve little in the short term and could mean we do our students a disservice by preventing them from accessing some of the benefits of these technologies, and training students to use such tools in a thoughtful way \u2013 critically evaluating the pros and cons for themselves and knowing when (and perhaps more importantly when not) to use them and for what purposes.\u202fWe should also be mindful that AI can also <\/span>help<\/span><\/i> us to create more accessible content, and so in banning its use, we may inadvertently ban something that can make <\/span>learning and teaching more accessible<\/span><\/a>.<\/span>\u00a0<\/span><\/p>\n

Perhaps, then, our approach should focus on people and not on the technologies themselves. As <\/span>JISC have recently advised<\/span><\/a>, we may be best off focusing on clarifying acceptable student behaviours and understanding what drives them to cheat, and ensuring good assessment design, rather than specifying prohibited technologies which are continually evolving and being embedded into other tools.<\/span>\u00a0<\/span><\/p>\n

Further, as a recent article in the <\/span>Time<\/span><\/i>s <\/span>Higher<\/span><\/i> notes<\/span><\/a>, before we rush into action: \u2018<\/span>Nothing has really changed; academic integrity is difficult to police and always has been<\/span><\/b>. If we want to deter cheating, the best way to do so is to remove the motivation for cheating in the first place\u2019.\u202fIn that sense, our first line of defence, as we advise on <\/span>our Teaching Hub<\/span><\/a>, is to double down on efforts on educating students to participate in good academic citizenship, signposting <\/span>support and help<\/span><\/a>, and by designing assessments that are authentic and embrace assessment for learning (which is already underway with CT).\u00a0<\/span> Second, and to quote Michael Draper, professor in legal education at the University of Swansea, from <\/span>the Guardian<\/span><\/a>: \u2018lf we\u2019re preparing students for the outside world of work and if in the workplace this sort of technology is given to us, then I think we need to embrace it rather than ban it.\u2019\u202f\u202f<\/span>\u00a0<\/span><\/p>\n

This viewpoint is shared by JISC, which provides network and IT services to higher education. To quote at length its Director, <\/span>Michael Webb<\/span><\/a>:\u202f<\/span>\u00a0<\/span><\/p>\n

While assistive computation tools like ChatGPT can undoubtedly be seen as presenting a challenge to the sector, they also have the potential to change it in really positive ways \u2013 by cutting staff workloads, for example, or enabling new assessment models.\u202f<\/span>\u00a0<\/span><\/p>\n

The fact that ChatGPT can generate properly structured, grammatically correct pieces means that students could well use it to produce essays. Equally, though, it could be used by educators to help them generate course content, reports and feedback.\u202f<\/span>\u00a0<\/span><\/p>\n

The knee-jerk reaction might be to block these tools in order to stop students cheating, but that\u2019s neither feasible nor advisable. We should really regard them as simply the next step up from spelling or grammar checkers: technology that can make everyone\u2019s life easier.\u202f<\/span>\u00a0<\/span><\/p>\n

Like it or not, AI-powered computation tools for written content, image generation and coding are here to stay. Aspects of them will soon be integrated into apps like Microsoft Office. The key is to understand their shortcomings and weak points as well as their strengths. We should all be aware, for example, that ChatGPT\u2019s output can be poorly argued, out of date and factually inaccurate.\u202f<\/span>\u00a0<\/span><\/p>\n

We don\u2019t need to revert to in-person exams: this is a great opportunity for the sector to explore new assessment techniques that measure learners on critical thinking, problem-solving and reasoning skills rather than essay-writing abilities. Factual knowledge can be assessed during the learning process, while the application of that knowledge could be tested in project work<\/span><\/i>.\u202f<\/span>\u00a0<\/span><\/p><\/blockquote>\n

On the last point, as we indicate on the CLT\u2019s <\/span>Teaching Hub page for Generative AI<\/span><\/a>, despite the hype, the issues that ChatGPT might be seen to raise for assessment practice are not necessarily new to Higher Education. Responding to such challenges align with positive opportunities to transform why and how we carry out assessment, including:<\/span>\u00a0<\/span><\/p>\n