Don’t Blink! Computer Characters With Feelings

Vishal Nayak, who is now working in the games industry, implemented a model I developed that allows for real-time emotional expression. While I won’t detail much right now, the model can also be used to enable computer characters to talk about their feelings!!

Virtual agents should be able to interact and communicate effectively with a human. If virtual agents can connect with the user on a personal and emotional level, they will be able to be maximally effective in their interaction with humans. This connection is especially important for applications that attempt to significantly affect the user, such as certain educational applications or games that aim to challenge the individual emotionally.

We believe that individuals will be able to better relate to virtual agents if these agents exhibit personality and emotions through affective behaviors. Their believability would increase, since the expression of personality and emotions causes the agents to seem more like living characters.

Using a procedural, 3-dimensional, character animation system, and using Playspace’s Emotivation Model, we have implemented body language for seven main mental state characteristics: confidence, anxiety, interest, thought, anger, defensiveness, and physical pain in various body parts. We have implemented this body language by procedurally animating the character’s body movements (body part adjustments as well as additional actions) and facial expressions.

Here’s a link to Vishal’s conference paper.