Authors:

Beatrice Biancardi, Chen Wang, Maurizio Mancini, Angelo Cafaro, Guillaume Chanel, Catherine Pelachaud

Publication Type:

Refereed Conference Meeting Proceeding

Abstract:

This paper presents a computational model for managing an Embodied Conversational Agent’s first impressions of warmth and competence towards the user. These impressions are important to manage because they can impact users’ perception of the agent and their willingness to continue the interaction with the agent. The model aims at detecting user’s impression of the agent and producing appropriate agent’s verbal and nonverbal behaviours in order to maintain a positive impression of warmth and competence. User’s impressions are recognized using a machine learning approach with facial expressions (action units) which are important indicators of users’ affective states and intentions. The agent adapts in real-time its verbal and nonverbal behaviour, with a reinforcement learning algorithm that takes user’s impressions as reward to select the most appropriate combination of verbal and non-verbal behaviour to perform. A user study to test the model in a contextualized interaction with users is also presented. Our hypotheses are that users’ ratings differs when the agents adapts its behaviour according to our reinforcement learning algorithm, compared to when the agent does not adapt its behaviour to user’s reactions (i.e., when it randomly selects its behaviours). The study shows a general tendency for the agent to perform better when using our model than in the random condition. Significant results shows that user’s ratings about agent’s warmth are influenced by their a-priori about virtual characters, as well as that users’ judged the agent as more competent when it adapted its behaviour compared to random condition.

Conference Name:

8th International Conference on Affective Computing and Intelligent Interaction (ACII 2019)

Digital Object Identifer (DOI):

10.1109/ACII.2019.8925495

Publication Date:

03/09/2019

Conference Location:

United Kingdom (excluding Northern Ireland)

Research Group:

Personal Sensing

Institution:

National University of Ireland, Cork (UCC)

Open access repository:

No