More Web Proxy on the site http://driver.im/

research-article

Video agent: interactive autonomous agents generated from real-world creatures

Authors:

Yoshifumi Kitamura,

Yoshinori Hirano,

Fumio KishinoAuthors Info & Claims

VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

Pages 30 - 38

https://doi.org/10.1145/1450579.1450586

Published: 27 October 2008 Publication History

Abstract

We present a novel approach for interactive multimedia content creation that establishes an interactive environment in cyberspace in which users interact with autonomous agents generated from video images of real-world creatures. Each agent has autonomy, personality traits, and behaviors that reflect the results of various interactions determined by an emotional model with fuzzy logic. After an agent's behavior is determined, a sequence of video images that best match the determined behavior is retrieved from the database in which a variety of video image sequences of the real creature's behaviors are stored. The retrieved images are successively displayed on the cyberspace to make it responsive. Thus the autonomous agent behaves continuously. In addition, an explicit sketch-based method directly initiate the reactive behavior of the agent without involving the emotional process. This paper describes the algorithm that establishes such an interactive system. First, an image processing algorithm to generate a video database is described. Then the process of behavior generation using emotional models and sketch-based instruction are introduced. Finally, two application examples are demonstrated: video agents with humans and goldfish.

Supplementary Material

JPG File (videoagentdemo2008.jpg)

Download
18.79 KB

MPG File (videoagentdemo2008.mpg)

Download
36.73 MB

References

[1]

Asai, K., Kitamura, Y., Nishimoto, T., Hirano, Y., Hama, E., and Kishino, F., 2007. Video agents. ACM SIGGRAPH Emerging Technologies.

Digital Library

[2]

Balaguer, J., and Gobbetti, E. 1995. Sketching 3D animations. Computer Graphics Forum 14, 3, 241--258.

Digital Library

[3]

Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M. P., and Tomlinson, B. 2002. Integrated learning for interactive synthetic characters. In Proc. of ACM SIGGRAPH, 417--426.

Digital Library

[4]

Chetverikov, D., and Szabó, Z. 1999. A simple and efficient algorithm for detection of high curvature points in planar curves. In Workshop of Austrian Pattern Recognition Group, 175--184.

[5]

Costa, P. T., and McCrae, R. R. 1985. The NEO Personality Inventory. Psychological Assessment Resources.

[6]

de Juan, C., and Bodenheimer, B. 2004. Cartoon textures. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 267--276.

Digital Library

[7]

Donikian, S. 2002. Hpts: A behaviour modeling language for autonomous agents. In Proc. of International Conference on Autonomous Agents, 401--408.

Digital Library

[8]

Ekman, P., and Davidson, R. J. 1994. The nature of emotion: fundamental questions. Oxford University Press.

[9]

Elliott, C. 1992. The affective reasoner: a process model of emotions in a multi-agent system. PhD thesis, Northwestern University.

Digital Library

[10]

Frijda, N. 1986. The emotions. Cambridge University Press.

[11]

Kombis, S. 1998. Virtual fishtank. In ACM SIGGRAPH Conference Abstracts and Applications, 116.

Digital Library

[12]

Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In Proc. of ACM SIGGRAPH, 473--482.

Digital Library

[13]

Kruskal, J. B., and Seery, J. B. 1980. Designing network diagrams. In Proc. of General Conference on Social Graphics, 22--50.

[14]

Lin, I.-J., and Kung, S. Y. 2000. Video object extraction and representation: Theory and applications. Kluwer Academic Publishers.

Digital Library

[15]

Loyall, A. B., Reilly, W. S. N., Bates, J., and Weyhrauch, P. 2004. System for authoring highly interactive, personality-rich interactive characters. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 59--68.

Digital Library

[16]

Minsky, M. 1985. The society of mind. Simon and Schuster. Open source computer vision library. http://www.intel.com/technology/computing/opencv/.

Digital Library

[17]

Popovic, J., Seits, S. M., and Erdmann, M. 2003. Motion sketching for control of rigid-body aimulations. ACM Transactions on Graphics 22, 4, 1034--1054.

Digital Library

[18]

Radica, 2005. Cube world. http://www.radicauk.com/.

[19]

Reynolds, C. W. 1987. Flocks, herds and schools: A distributed behavioral model. In Proc. of ACM SIGGRAPH, 25--34.

Digital Library

[20]

Ronald, A., Fujita, M., Takagi, T., and Hasegawa, R. 2003. An ethological and emotional basis for human-robot interaction. Robotics and Autonomous Systems 42, 191--201.

[21]

Schödl, A., and Essa, I. A. 2002. Controlled animation of video sprites. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 121--127.

Digital Library

[22]

Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proc. of ACM SIGGRAPH, 489--498.

Digital Library

[23]

Sloman, A. 1997. Designing human-like minds. In Proc. of European Conference on Artificial Life.

[24]

Starck, J., Miller, G., and Hilton, A. 2005. Video-based character animation. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 49--58.

Digital Library

[25]

Su, W.-P., Pham, B., and Wardhani, A. 2005. High-level control posture of story characters based on personality and emotion. In Proc. of Australasian Conference on Interactive Entertainment, 179--186.

Digital Library

[26]

Sun, J., Zhang, W., Tang, X., and Shum, H.-Y. 2006. Background cut. In Proc. of European Conference on Computer Vision, 628--641.

Digital Library

[27]

Terzopoulos, D., and Tu, X. 1994. Artificial fishes: Physics, locomotion, perception, behavior. In Proc. of ACM SIGGRAPH, 43--50.

Digital Library

[28]

Thorne, M., Burke, D., and van de Panne, M. 2004. Motion doodles: an interface for sketching character motion. ACM Transactions on Graphics 23, 3 (Proc. of SIGGRAPH), 424--431.

Digital Library

[29]

Tomlinson, B., Downie, M., Berlin, M., Gray, J., Lyons, D., Cochran, J., and Blumberg, B. 2002. Leashing the alphawolves: mixing user direction with autonomous emotion in a pack of semi-autonomous virtual characters. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 7--14.

Digital Library

[30]

Ushida, H., Hirayama, Y., and Nakajima, H. 1998. Emotion model for life-like agent and its evaluation. In Proc. of Conference on Artificial Intelligence (AAAI), 62--69.

Digital Library

[31]

Velasquez, J. D. 1997. Modeling emotions and other motivations in synthetic agents. In Proc. of Conference on Artificial Intelligence (AAAI), 10--15.

Digital Library

[32]

Wang, J., Bhat, P., Colburn, R. A., Agrawala, M., and Cohen, M. F. 2005. Interactive video cutout. In Proc. of ACM SIGGRAPH, 585--594.

Digital Library

Cited By

Saputri TLee S(2020)The Application of Machine Learning in Self-Adaptive Systems: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2020.30360378(205948-205967)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3036037
Tripathi AHossain SSingh VAtrey P(2015)Assessing personality using demographic information from social media dataProceedings of the 2015 International Conference on Social Media & Society10.1145/2789187.2789201(1-7)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2789187.2789201
Lai JChen CWu PKao CHu MChien S(2012)Tennis Real PlayIEEE Transactions on Multimedia10.1109/TMM.2012.219719014:6(1602-1617)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1109/TMM.2012.2197190
Show More Cited By

Index Terms

Video agent: interactive autonomous agents generated from real-world creatures

Recommendations

Osaka developing story: an application of video agents
ACE '10: Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology

In this paper, we put forward a novel idea to create virtual alter egos by using video images of real-world humans; these alter egos can act autonomously and interactively in a virtual world. The design inspiration of this virtual world is Osaka City in ...
Image enhancement - An emergent pattern formation approach via decentralised multi-agent systems
Special Issue on Nature inspired systems for parallel, asynchronous and decentralised environments

A multi-agent framework inspired by natural and physical systems is presented for data discovery and image enhancement. The input image is represented as a topographic landscape upon which a large population of independent simple, reactive, mobile ...
Faking dynamics of cloth animation for animated films
AMDO'10: Proceedings of the 6th international conference on Articulated motion and deformable objects

In this paper we argue for the concept of fake dynamics to allow animators to interactively create visually pleasing animations of cloth models while keeping him/her in full control of the animation process. Existing animation and simulation techniques ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '08: Proceedings of the 2008 ACM symposium on Virtual reality software and technology

October 2008

288 pages

ISBN:9781595939517

DOI:10.1145/1450579

Conference Chairs:
Steven Feiner
Columbia University
,
Daniel Thalmann
Ecole Polytechnique Fédérale de Lausanne
,
Pascal Guitton
Université de Bordeaux
,
Program Chairs:
Bernd Fröhlich
Bauhaus-Univ. Weimar
,
Ernst Kruijff
TU Graz
,
Martin Hachet
INRIA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VRST08

Sponsor:

VRST08: The ACM Symposium on Virtual Reality Software and Technology

October 27 - 29, 2008

Bordeaux, France

Acceptance Rates

VRST '08 Paper Acceptance Rate 12 of 68 submissions, 18%;

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
428
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Saputri TLee S(2020)The Application of Machine Learning in Self-Adaptive Systems: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2020.30360378(205948-205967)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3036037
Tripathi AHossain SSingh VAtrey P(2015)Assessing personality using demographic information from social media dataProceedings of the 2015 International Conference on Social Media & Society10.1145/2789187.2789201(1-7)Online publication date: 27-Jul-2015
https://dl.acm.org/doi/10.1145/2789187.2789201
Lai JChen CWu PKao CHu MChien S(2012)Tennis Real PlayIEEE Transactions on Multimedia10.1109/TMM.2012.219719014:6(1602-1617)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1109/TMM.2012.2197190
von Haugwitz RKitamura YTakashima K(2012)Modulating reinforcement-learning parameters using agent emotionsThe 6th International Conference on Soft Computing and Intelligent Systems, and The 13th International Symposium on Advanced Intelligence Systems10.1109/SCIS-ISIS.2012.6505340(1281-1285)Online publication date: Nov-2012
https://doi.org/10.1109/SCIS-ISIS.2012.6505340
Lai JChen CWu PKao CChien SCandan KPanchanathan SPrabhakaran BSundaram HFeng WSebe N(2011)Tennis real playProceedings of the 19th ACM international conference on Multimedia10.1145/2072298.2072361(483-492)Online publication date: 28-Nov-2011
https://dl.acm.org/doi/10.1145/2072298.2072361
Sherstyuk AGavrilova M(2011)Virtual Roommates in multiple shared spaces2011 IEEE International Symposium on VR Innovation10.1109/ISVRI.2011.5759607(81-88)Online publication date: Mar-2011
https://doi.org/10.1109/ISVRI.2011.5759607
Sherstyuk AGavrilova M(2011)Virtual Roommates: Sampling and Reconstructing Presence in Multiple Shared SpacesHandbook of Augmented Reality10.1007/978-1-4614-0064-6_9(211-230)Online publication date: 13-Jul-2011
https://doi.org/10.1007/978-1-4614-0064-6_9
Rong RKitamura YKitaoka SKato HKishi KNakashima KYamazaki KHoriuchi SShioda TKamakura KMatsuyama SShen VDuh HInami MHaller MKitamura Y(2010)Osaka developing storyProceedings of the 7th International Conference on Advances in Computer Entertainment Technology10.1145/1971630.1971652(71-74)Online publication date: 17-Nov-2010
https://dl.acm.org/doi/10.1145/1971630.1971652

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents