Jask: Generation of Questions About Learners' Code in Java

Loading...
Thumbnail Image

Access rights

openAccess

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Date

2022-07-07

Major/Subject

Mcode

Degree programme

Language

en

Pages

7
117-123

Series

ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1, Volume 1

Abstract

We present Jask, a system capable of generating questions about a learner's code written in Java. Given Java code as input, Jask provides a set of meaningful questions formulated in terms of the actual code (using its constructs and identifiers) and the corresponding correct answers. We integrated Jask in a web-based system where students submit their code (e.g., from lab exercises), answer questions about it, and obtain immediate formative feedback with the correct answers. An initial study involving 123 distinct introductory programming students providing 2274 answers revealed that questions pertaining to program dynamics tend to register low scores, possibly evidencing fragile comprehension of programming constructs. Participants were surveyed, revealing a positive view towards the usefulness of Jask, especially with respect to consolidating terminology.

Description

Keywords

automatic assessment, program comprehension, question generation, self-explanation

Other note

Citation

Santos, A, Soares, T, Garrido, N & Lehtinen, T 2022, Jask: Generation of Questions About Learners' Code in Java . in ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1 . vol. 1, 3524761, ACM, pp. 117-123, Annual Conference on Innovation and Technology in Computer Science Education, Dublin, Ireland, 08/07/2022 . https://doi.org/10.1145/3502718.3524761