How Do You Like Your Virtual Agent?: Human-Agent Interaction Experience through Nonverbal Features and Personality Traits

1. Aran, O., Gatica-Perez, D.: One of a Kind: Inferring Personality Impressions in Meetings. In: International Conference on Multimodal Interaction (ICMI), Sydney, pp. 11–18 (2013)

   Google Scholar 

2. Argyle, M.: Bodily communication. Methuen (1988)

   Google Scholar 

3. Biel, J.-I., Gatica-Perez, D.: The Youtube lens: Crowdsourced personality impression and audiovisual of vlogs. IEEE Transactions on Multimedia 15(1), 41–55 (2012)

   Article  Google Scholar 

4. Biel, J.-I., Aran, O., Gatica-Perez, D.: The Good, the Bad, and the Angry: Analyzing Crowdsourced Impressions of Vloggers. In: International Conference on Weblogs and Social Media, ICWSM (2012)

   Google Scholar 

5. Buisine, S., Martin, J.C.: The influence of user’s personality and gender on the processing of virtual agents multimodal behavior. Advances in Psychology Research, 1–14 (2010)

   Google Scholar 

6. Cafaro, A., Vilhjálmsson, H.H., Bickmore, T., Heylen, D., Jóhannsdóttir, K.R., Valgarðsson, G.S.: First impressions: Users’ judgments of virtual agents’ personality and interpersonal attitude in first encounters. In: Nakano, Y., Neff, M., Paiva, A., Walker, M. (eds.) IVA 2012. LNCS, vol. 7502, pp. 67–80. Springer, Heidelberg (2012)

   Chapter  Google Scholar 

7. Cuperman, R., Ickes, W.: Big five predictors of behavior and perceptions in initial dyadic interactions: personality similarity helps extraverts and introverts, but hurts disagreeables. Journal of Personality and Social Psychology 97(4), 667–684 (2009)

   Article  Google Scholar 

8. Ekman, P., Friesen, W., O’Sullivan, M., Cherer, K.: Relative importance of face, body, and speech in judgments of personality and affect. Journal of Personality and Social Psychology 38(2), 270–277 (1980)

   Article  Google Scholar 

9. Funder, D.C., Sneed, C.D.: Behavioral manifestations of personality: An ecological approach to judgmental accuracy. Journal of Personality and Social Psychology 64, 479–490 (1993)

   Article  Google Scholar 

10. Isbister, K., Nass, C.: Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics. International Journal of Human-Computer Studies 53(2), 251–267 (2000)

    Article  Google Scholar 

11. Jung, C.: Psychological types. Harcourt, Brace, New York (1921)

    Google Scholar 

12. Kang, S.-H., Gratch, J., Wang, N., Watt, J.H.: Agreeable people like agreeable virtual humans. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 253–261. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

13. Knapp, M.L., Hall, J.A., Horgan, T.G.: Nonverbal Communication in Human Interaction, 8th edn. Cengage Learning (January 2013)

    Google Scholar 

14. Lefter, I., Burghouts, G.J., Rothkrantz, L.J.M.: Automatic Audio-Visual Fusion for Aggression Detection Using Meta-information avss. In: 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance, pp. 19–24 (2012)

    Google Scholar 

15. Maxwell, G.M., Cook, M.W.: Postural congruence and judgements of liking and perceived similarity. New Zealand Journal of Psychology 15(1), 20–26 (1985)

    Google Scholar 

16. McCrae, R.R., Costa, P.T.: A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences 36(3), 587–596 (2004)

    Article  Google Scholar 

17. McRorie, M., Sneddon, I., McKeown, G., Bevacqua, E., Sevin, E., Pelachaud, C.: Evaluation of four designed virtual agent personalities. Transactions on Affective Computing 3(3), 311–322 (2012)

    Article  Google Scholar 

18. Mehrabian, A.: Significance of posture and position in the communication of attitude and status relationships. Psychological Bulletin 71(5), 359–372 (1969)

    Article  Google Scholar 

19. Nass, C., Lee, K.M.: Does computer-generated speech manifest personality? an experimental test of similarity-attraction. In: CHI 2000: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA, pp. 329–336 (2000)

    Google Scholar 

20. Nguyen, L., Marcos-Ramiro, A., Marron-Romera, M., Gatica-Perez, D.: Multimodal Analysis of Body Communication Cues in Employment Interviews. In: Proc. ACM Int. Conf. on Multimodal Interaction (ICMI), Sydney (December 2013)

    Google Scholar 

21. Palmer, M.T., Simmons, K.B.: Communicating intentions through nonverbal behaviors conscious and nonconscious encoding of liking. Human Communication Research 22(1), 128–160 (1995)

    Article  Google Scholar 

22. Pentland, A.S.: Honest Signals: How They Shape Our World. The MIT Press (2008)

    Google Scholar 

23. Pianesi, F., Zancanaro, M., Lepri, B., Cappelletti, A.: A multimodal annotated corpus of consensus decision making meetings. Language Resources and Evaluation 41(3), 409–429 (2007)

    Article  Google Scholar 

24. Ray, G.B., Floyd, K.: Nonverbal expressions of liking and disliking in initial interaction: Encoding and decoding perspectives. Southern Communication Journal 71(1), 45–65 (2006)

    Article  Google Scholar 

25. Sanchez-Cortes, D., Aran, O., Jayagopi, D., Schmid Mast, M., Gatica-Perez, D.: Emergent Leaders through Looking and Speaking: From Audio-Visual Data to Multimodal Recognition. Journal on Multimodal User Interfaces Special Issue on Multimodal Corpora 7(1-2), 39–53 (2013) (published online August 2012)

    Google Scholar 

26. Sun, X., Nijholt, A., Truong, K.P., Pantic, M.: Automatic understanding of affective and social signals by multimodal mimicry recognition. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011, Part II. LNCS, vol. 6975, pp. 289–296. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

27. Tapus, A., Mataric, M.J.: Socially assistive robots: The link between personality, empathy, physiological signals, and task performance. In: Emotion, Personality, and Social Behavior, pp. 133–140. AAAI (2008)

    Google Scholar 

28. von der Pütten, A.M., Krämer, N.C., Gratch, J.: How our personality shapes our interactions with virtual characters - implications for research and development. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 208–221. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

29. Vacharkulksemsuk, T.B., Fredrickson, L.: Strangers in sync: Achieving embodied rapport through shared movements. Journal of Experimental Social Psychology 48(1), 399–402 (2012)

    Article  Google Scholar 

30. Vijayasenan, D., Valente, F., Bourlard, H.: An Information Theoretic Combination of MFCC and TDOA Features for Speaker Diarization. IEEE Transactions on Audio Speech and Language Processing 19(2) (2011)

    Google Scholar 

31. Waldron, J.: Judgement of like-dislike from facial expression and body posture. Perceptual and Motor Skills 41(3), 799–804 (1975)

    Article  Google Scholar 

Download references