Exploring the Need for Explainable Artificial Intelligence (XAI) in Intelligent Tutoring Systems (ITS)
An initial pilot study is conducted to explore student attitudes towards incorporating explanations to an ITS, by asking participants for suggestions on the type of explanations, if any, that they would like to see.
Abstract
This work is the first step towards understanding when and if it is necessary for an Intelligent Tutoring System (ITS) to explain its underlying user modeling techniques to students. We conduct an initial pilot study to explore student attitudes towards incorporating explanations to an ITS, by asking participants for suggestions on the type of explanations, if any, that they would like to see. Our results indicate an overall positive sentiment towards wanting explanation and suggest a few design directions for incorporating explanation into an existing ITS.