Jask: Generation of Questions About Learners' Code in Java

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
Date
2022-07-07
Major/Subject
Mcode
Degree programme
Language
en
Pages
7
117-123
Series
ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1, Volume 1
Abstract
We present Jask, a system capable of generating questions about a learner's code written in Java. Given Java code as input, Jask provides a set of meaningful questions formulated in terms of the actual code (using its constructs and identifiers) and the corresponding correct answers. We integrated Jask in a web-based system where students submit their code (e.g., from lab exercises), answer questions about it, and obtain immediate formative feedback with the correct answers. An initial study involving 123 distinct introductory programming students providing 2274 answers revealed that questions pertaining to program dynamics tend to register low scores, possibly evidencing fragile comprehension of programming constructs. Participants were surveyed, revealing a positive view towards the usefulness of Jask, especially with respect to consolidating terminology.
Description
Keywords
automatic assessment, program comprehension, question generation, self-explanation
Other note
Citation
Santos , A , Soares , T , Garrido , N & Lehtinen , T 2022 , Jask: Generation of Questions About Learners' Code in Java . in ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1 . vol. 1 , 3524761 , ACM , pp. 117-123 , Annual Conference on Innovation and Technology in Computer Science Education , Dublin , Ireland , 08/07/2022 . https://doi.org/10.1145/3502718.3524761