Fluid Interfaces and Fixed Patterns: Understanding LLM Behavior in Educational Contexts

Thumbnail Image

Files

master_Kucheria_Aayush_2025.pdf (1.08 MB)

URL

Journal Title

Journal ISSN

Volume Title

School of Science | Master's thesis
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.

Authors

Date

2024-12-31

Department

Major/Subject

Machine Learning, Data Science and Artificial Intelligence

Mcode

Degree programme

Master's Programme in Computer, Communication and Information Sciences

Language

en

Pages

58

Series

Abstract

As Large Language Models (LLMs) emerge as potential tutoring agents, they promise more fluid, adaptive educational interactions than traditional intelligent tutoring systems. However, the extent to which LLM behavior actually aligns with human tutoring patterns remains poorly understood. This thesis examines this tension between fluid interfaces and fixed behavioral patterns in AI tutoring. Drawing on constructivist learning theory and analysis of historical constraints in educational technology, we investigate how LLMs process and respond in the tutoring task compared to human teachers. Through systematic analysis of the CIMA dataset, we compare action distributions and response patterns between human tutors and three state-of-the-art LLMs (GPT-4o, Gemini Pro 1.5, and LLaMA 3.1 405B) in language teaching dialogues. Rather than evaluating performance or effectiveness, we focus on understanding fundamental differences in how artificial and human tutors structure their teaching interactions. Our results reveal systematic deviations in LLM behavior from human tutoring patterns, particularly in action selection and response adaptation to student behavior. These findings suggest that while LLMs enable more fluid interaction, they may develop fixed behavioral patterns distinct from human teaching strategies. This research contributes to both theoretical understanding of AI tutoring behavior and practical development of more effective educational technologies, while raising important questions about the nature of machine teaching and learning.

Description

Supervisor

Sawhney, Nitin

Thesis advisor

Kauppinen, Tomi
Vitiugin, Fedor

Keywords

large language models, tutoring behavior, educational technology, human-AI interaction, action pattern analysis, intelligent tutoring systems

Other note

Citation

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202501302238

Collections

[dipl] Perustieteiden korkeakoulu / SCI