Multimodal speech recognition errors and second language acquisition: An activity theoretic account
AuthorFarmer, Mr Rod
Source TitleProceedings, Sixieme colloque des Usages des Nouvelles Technologies dans l'Enseignement des Langues Etrangeres (UNTELE 2005)
University of Melbourne Author/sFARMER, RODERICK ALEXANDER
AffiliationEngineering: Department of Computer Science and Software Engineering
Arts: Horwood Language Centre
Document TypeConference Paper
CitationsFarmer, Mr Rod (2005) Multimodal speech recognition errors and second language acquisition: An activity theoretic account, in Proceedings, Sixieme colloque des Usages des Nouvelles Technologies dans l'Enseignement des Langues Etrangeres (UNTELE 2005), Compiegne.
Access StatusOpen Access
Researchers in Computer-Aided Language Learning (CALL) have long recognized the potential benefits of Human Language Technology (HLT) for affording more naturalistic and authentic language learning contexts. Historically, CALL practitioners have argued that advancements in HLT would provide more intuitive, adaptive and compelling human-computer interfaces for effective language learning environments. However, CALL researchers have yet to demonstrate an understanding of how multimodal interaction affects the language learning process. Moreover, there are few Human-Computer Interaction (HCI) studies in CALL that critically examine the relationship between multimodal interaction, cognitive complexity and language acquisition.HCI methodologies in CALL have traditionally been couched within the cognitivist (information processing) paradigm. However, there is growing awareness amongst HCI practitioners of the importance of post-cognitivist, situated methodologies in modeling social systems, such as language learning. In contrast to cognitivist approaches, the goal of socially-oriented methodologies is to uncover emerging themes or patterns across subjective interpretations of user experiences. Such methodologies are therefore more relativistic and qualitative in nature. It is argued here that post-cognitivist HCI frameworks are more amenable to capturing the complexities of learner-computer interaction in CALL.This paper submits two contributions to the study of language learning and technology. Firstly, the paper presents initial findings from an exploratory study that undertook the development and evaluation of multimodal speech technology for second language vocabulary acquisition. Secondly, an activity theoretic examination of these findings is proffered. Findings from this study suggest future research agendas for the design and evaluation of multimodal systems in learner-centred environments.
Keywordsmultimodal interaction; spoken language technology; task analysis; speech recognition errors; CALL; second language acquisition; human-computer interaction
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References