Human behaviour in multimodal interaction: main effects of civic action and interpersonal and problem-solving skills

TitleHuman behaviour in multimodal interaction: main effects of civic action and interpersonal and problem-solving skills
Publication TypeJournal Article
Year of Publication2020
AuthorsMarkri E, Spiliotopoulos D, Vassilakis C, Margaris D
JournalJournal of Ambient Intelligence and Humanized Computing
VolumeTBD
PaginationTBD
Date Publishedmar
KeywordsHuman Behaviour, Individual- and Community-Level Related Attitudes and Skills, Metacognitive, Multimodal Interaction, Skill Training
AbstractMetacognitive skill training may rest within any kind of social interaction that requires awareness of what an individual and others think, in social, educational and organizational settings alike. This work explores an extensive study of multimodal application interaction (virtual agent, spoken dialogue, visual communication of progress) for metacognitive skill training via negotiation skill training settings. Human behaviour, as effected by civic action and interpersonal and problem-solving skill training, is investigated through interaction sessions with a virtual agent on multimodal multiparty negotiation. This work reports on the results of the user-system evaluation sessions involving 41 participants before-and-after interaction with the system, integrating macro- (dialogue system performance) and micro- (metacognitive-related and individual-and-community level-related attitudes and skills) factors. Findings indicate significant and positive relationships between user and system evaluation questions after interaction with the dialogue system and between self-efficacy, self-regulation, individual readiness to change, mastery goal orientation, interpersonal and problem-solving skills and civic action before-and-after the interaction experience. Implications, limitations and further research issues are discussed in light of context of the multimodal interaction and its effects on the human behaviour during metacognitive skill training.
DOI10.1007/s12652-020-01846-x