Piloting Natural Language Generation for Personalized Progress Feedback

Loading...
Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2022-10

Major/Subject

Mcode

Degree programme

Language

en

Pages

8

Series

2022 IEEE Frontiers in Education Conference (FIE), Conference proceedings : Frontiers in Education Conference

Abstract

Full research paper—We describe the results of a pilot study wherein we applied simple natural language generation methods to produce automated feedback for students of an online course based on student high-level progress data. Experimenting with both personalized and non-personalized feedback, we show that such feedback can be easily produced given access to even rudimentary data regarding student assignment submissions and their correctness. Our results suggest that students perceive automatically generated feedback generally positively and believe it to be useful. Our results also indicate that minor personalization and stylistic alterations in the feedback can have meaningful effects on how the feedback is interacted with and perceived. In particular, we observe that personalized feedback is perceived as being slightly easier to understand and as being better aligned with their progress. Students also felt better about the personalized feedback in comparison to non-personalized feedback. We conclude that the automated generation of personalized textual feedback shows promise as a low-threshold way of increasing student satisfaction. Further research is needed to assess the effect of different types of automated personalized feedback on student performance and behavior.

Description

Keywords

Other note

Citation

Leppänen, L, Hellas, A & Leinonen, J 2022, Piloting Natural Language Generation for Personalized Progress Feedback . in 2022 IEEE Frontiers in Education Conference (FIE) . Conference proceedings : Frontiers in Education Conference, IEEE, Frontiers in Education Conference, Uppsala, Sweden, 08/10/2022 . https://doi.org/10.1109/FIE56618.2022.9962555