Robosourcing Educational Resources - Leveraging Large Language Models for Learnersourcing

Loading...
Thumbnail Image

Access rights

openAccess
CC BY
publishedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

Major/Subject

Mcode

Degree programme

Language

en

Pages

17

Series

Proceedings of the Workshop on Learnersourcing: Student-Generated Content @ Scale 2022, Volume 3410, pp. 3-19, CEUR WORKSHOP PROCEEDINGS

Abstract

In this article, we introduce and evaluate the concept of robosourcing for creating educational content. Robosourcing lies in the intersection of crowdsourcing and large language models, where requests to large language models replace some of the work traditionally performed by the crowd. Robosourcing includes a human-in-the-loop to provide priming (input) as well as to evaluate and potentially adjust the generated artefacts; these evaluations could also be used to improve the large language models. We explore the feasibility of robosourcing in the context of education by conducting an evaluation of robosourced programming exercises, generated using OpenAI Codex. Our results suggest that robosourcing could significantly reduce human effort in creating diverse educational content while maintaining quality similar to human-created content. Thus, we argue that robosourcing has the potential to alleviate known issues around learner motivation and content quality that have been shown to limit the benefits of learnersourcing in practice.

Description

Publisher Copyright: © 2022 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0).

Other note

Citation

Denny, P, Sarsa, S, Hellas, A & Leinonen, J 2022, Robosourcing Educational Resources - Leveraging Large Language Models for Learnersourcing. in Proceedings of the Workshop on Learnersourcing: Student-Generated Content @ Scale 2022. vol. 3410, CEUR WORKSHOP PROCEEDINGS, CEUR, pp. 3-19, Learnersourcing: Student-generated Content @ Scale, New York City, New York, United States, 01/06/2022. < https://ceur-ws.org/Vol-3410/paper1.pdf >