Join us at Lumivero’s virtual conference as we present our research, “ChatGPT for Automated Writing Evaluation in Scholarly Writing Instruction.”

Abstract: There is a need for effective strategies for developing scholarly writing skills in post-secondary nursing students. Generative artificial intelligence (GAI) tools such as ChatGPT for automated writing evaluation (AWE) hold promise for mitigating challenges associated with scholarly writing instruction in nursing education. This paper describes our exploration of the suitability of ChatGPT for AWE in writing instruction. We assessed ChatGPT's feedback on 42 nursing student texts from the Michigan Corpus of Upper-Level Student Papers. Assessment criteria were derived from recent AWE research. ChatGPT demonstrated its utility as an AWE tool. Its scoring performance demonstrated stricter grading than human raters, related feedback to macro-level writing features, and supported multiple submissions and learner autonomy. Despite concerns surrounding GAI in academia, educators can accelerate the feedback process without increasing their workload, and students can receive individualized feedback by incorporating AWE provided by ChatGPT into the writing process.