Artificial intelligence (AI) is changing language education through personalized and interactive practice. However, its impact on language achievement and emotional aspects of learning is unclear. Therefore, this mixed-methods study investigated the effects of Chatbot-Assisted Language Learning (CHALL) on learners’ English language achievement and sense of metavolvement—the deepest level of metacognitive engagement. In phase 1, the Sense of Metavolvement Scale (SOMS) was developed and validated. In phase 2, following a quasi-experimental design, 44 intermediate Iranian EFL learners were divided into an experimental group (n=22, using the AI chatbot Pi) and a control group (n=22, receiving conventional classroom instruction). Both groups had pre- and post-tests for language achievement and metavolvement, and the experimental group sat for semi-structured interviews post-intervention. There were significant gains in the experimental group’s in-class metavolvement and language achievement. There were also significant differences between the two groups in post-test metavolvement, while there was no significant difference in their post-test language achievement. Furthermore, interview data illustrated CHALL as a low-anxiety practice context with cultural and pragmatic limitations. Therefore, CHALL can complement but not replace conventional instruction.

Keywords