Environment Expression: Expressing Emotions Through Cameras, Lights and Music

Environment expression is about going beyond the usual Human emotion expression channels in virtual worlds. This work proposes an integrated storytelling model – the environment expression model – capable of expressing emotions through three channels: cinematography, illumination and music. Stories are organized into prioritized points of interest which can be characters or dialogues. Characters synthesize cognitive emotions based on the OCC emotion theory. Dialogues have collective emotional states which reflect the participant’s emotional state. During storytelling, at each instant, the highest prioritypoint of interest is focused through the expression channels. The cinematography channel and the illumination channel reflect the point of interest’s strongest emotion type and intensity. The music channel reflectsthe valence of the point of interest’s mood. Finally, a study was conducted to evaluate the model. Results confirm the influence of environment expression on emotion perception and reveal moderate success of this work’s approach.

Authors and Affiliations

1. IST-Technical University of Lisbon and INESC-ID, Avenida Prof. Cavaco Silva – Taguspark, 2780-990, Porto Salvo, Portugal

   Celso de Melo & Ana Paiva

Editors and Affiliations

1. National Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences,  

   Jianhua Tao

2. National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China

   Tieniu Tan

3. MIT Media Laboratory, 20 Ames Street, 02139, Cambridge, MA, USA

   Rosalind W. Picard

Reprints and permissions

© 2005 Springer-Verlag Berlin Heidelberg

Policies and ethics