ChatGPT challenge: 5 ways to change how students are graded

The Conversation

ChatGPT challenge: 5 ways to change how students are graded

Educators need to carefully consider ChatGPT and issues of academic integrity to move toward an assessment system that leverages AI tools.

By Louis Volante (Brock) 鈥⒙燙hristopher DeLuca (成人大片) 鈥 Don A. Klinger (Waikato)

March 3, 2023

Share

A group of three university students look at a laptop with a professor
Caption

Universities and schools have entered a new phase in how they need to address academic integrity as our society navigates a , which include publicly available generative artificial intelligence (AI) like ChatGPT. Such platforms allow students to .

The Conversation logoWhile many worry these advanced AI technologies are ushering in a , these technologies also introduce opportunities for educators to rethink assessment practices and engage students in deeper and more meaningful learning that can promote critical thinking skills.

We believe the emergence of ChatGPT creates an opportunity for schools and post-secondary institutions to reform traditional approaches to assessing students that rely heavily on testing and written tasks focused on students鈥 recall, remembering and basic synthesis of content.

Cheating and ChatGPT

Estimates of cheating .

Sarah Elaine Eaton, an expert who studies academic integrity, cautions cheating : she has estimated that at Canadian universities, buy cheating services every year.

How the recent launch of ChatGPT by OpenAI will impact cheating in both compulsory and higher education settings is unknown, but how this evolves may depend on whether or not institutions retain or reform traditional assessment practices.

Evading plagiarism detection software?

The ability of popular plagiarism detection tools to identify cheating using ChatGPT to generate assignments remains a challenge.

, not yet peer reviewed, found that 50 essays generated using ChatGPT produced sophisticated texts that were able to evade the traditional plagiarism check software.

Given that ChatGPT reached in January, just two months after its launch, it is understandable why some have argued AI applications such as ChatGPT will spur in contemporary schooling.

Policy responses to AI and ChatGPT

Not surprisingly, there are opposing views on how to respond to ChatGPT and other AI language models.

Some argue educators should embrace AI as a valuable technological tool, provided .

Others believe are required so educators are better able to catch instances of cheating.

Still others, such as New York City鈥檚 Department of Education, .

Three circles are seen overlapping in the middle; the circles say AI, student assessment and academic integrity.
Institutions and educators must examine the intersection of AI, academic integrity and how we assess students. (Louis Volante), Author provided

Forward-thinking assessment

The figure below depicts three critical elements of a forward-thinking assessment system. Although each element could be elaborated, our focus is in offering educators a series of strategies that will allow them to maintain academic standards and promote authentic learning and assessment in the face of current and future AI applications.

Teachers and university professors have relied heavily on 鈥渙ne and done鈥 essay assignments for decades. Essentially, a student is assigned or asked to pick a generic essay topic from a list and submit their final assignment on a specific date.

Such assignments are particularly susceptible to new AI applications, as well as 鈥 whereby a student buys a completed essay. Educators now need to rethink such assignments. Here are some strategies.

1. Consider ways to incorporate AI in valid assessment.

It鈥檚 not useful or practical for institutions to outright ban AI and applications like ChatGPT.

AI has already been incorporated into some . We believe AI technologies must be selectively integrated so that students are able to reflect on appropriate uses and connect their reflections to learning competencies.

For example, Paul Fyfe, an English professor describes a 鈥減edagogical experiment鈥 in which into their final essay.

Students were then asked to confront the availability of AI as a writing tool and reflect on the ethical use and evaluation of language modes.

2. Engage students in setting learning goals.

Ensuring students understand how they will be graded is key to any good assessment system.

Inviting students to collaboratively establish learning goals and criteria for the task, with consideration for the role of AI software, would help students to evaluate and judge appropriate contexts in which AI can work as a learning tool.

3. Require students to submit drafts for feedback.

Although students should still complete essay assignments, research into academic integrity policy in response to generative AI suggests students should be required to and feedback. Apart from helping to detect plagiarism, this .

Feedback can be offered by the teacher or by students themselves. Peer- and self-feedback can serve to critically evaluate work in progress (or work generated by AI software).

4. Grade subcomponents of the task.

Students could receive a grade for each subcomponent 鈥 including their involvement in feedback processes. They would also be evaluated in relation to how well they incorporated and attended to the specific feedback provided.

The assignment becomes bigger than a final essay, it becomes a product of learning, where students鈥 ideas are evaluated from development to final submission.

5. Move to more authentic assessments or include performance elements.

Good assessment practice involves an educator observing student learning across multiple contexts.

For example, educators can invite students to present their work, discuss an essay in a conference format or share a video articulation or an artistic representation. The aim here is to encourage students to share their learning through an alternative format. An important question to ask is whether or not you need the essay component at all? Is there a more authentic way to effectively assess student learning?

Authentic assessments are those that relate content to context. When students are asked to do this, they must apply knowledge in more practical settings, often making AI tools less helpful.

For help in rethinking assessment practices towards more authentic and alternative approaches, educators can consider taking the free course, .

Improve benefits for students

Collectively, these suggestions may be more time-consuming, particularly in larger undergraduate classes.

But they do provide greater learning and that benefit students: formative assessment to guide teaching and learning, and 鈥渟ummative assessment,鈥 primarily used for grading and evaluation purposes.

AI is here and here to stay, and we must embrace it as part of our learning environment. Incorporating AI into how we assess student learning will yield more reliable assessment processes and valid and valued assessment outcomes.The Conversation

__________________________________________

, Professor of Education Governance and Policy Analysis, ; , Associate Dean, School of Graduate Studies & Professor, Faculty of Education, , and , Pro Vice-Chancellor of Te W膩nanga Toi Tangata Division of Education; Professor of Measurement, Assessment and Evaluation,

This article is republished from under a Creative Commons license. Read the .

Arts and Humanities
The Conversation Canada
Education
Graduate Studies and Postdoctoral Affairs