[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Complexity of bird song caused by adversarial imitation learning

  • Original Article
  • Published:
Artificial Life and Robotics Aims and scope Submit manuscript

Abstract

Biological evolution produces complexity through genetic variations based on randomness. In conventional communication or language simulation models, genetic variations based on randomness and fitness function rewarding task achievements play an important role in evolving communication signals to complex ones. However, it is known that not only genetic variations evolve communication but also imitative learning during developmental processes contributes to the evolution of communication. What we investigated here was to find a different principle of generating complexity which does not rely on the randomness or external environmental complexity but only on the learning processes in communication. Our hypothesis is that the contradictory learning mechanism we call the adversarial imitation learning can work to increase the complexity without relying on the random processes. To investigate our hypothesis, we implemented the adversarial imitation learning on a simulation where two agents interact with and imitate each other. Our results showed that the adversarial imitation learning causes chaotic dynamics and investigating the learning results in different types of interaction between the two; it was clarified that the adversarial imitation learning is necessary for the emergence of the chaotic time series.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Holland JH (1975) Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control and artificial intelligence, 2nd edn, expanded 1992. University of Michigan Press

  2. Darwin C, Wallace A (1858) On the tendency of species to form varieties; and on the perpetuation of varieties and species by natural means of selection. J Proc Linn Soc Lond Zool 3:45–62

    Article  Google Scholar 

  3. Wilson DS (1983) The group selection controversy: history and current status. Ann Rev Ecol Syst 14:159–187

    Article  Google Scholar 

  4. Froese T, Virgo N, Ikegami T (2011) Life as a process of open-ended becoming: analysis of a minimal model. In: Lenaerts T, Giacobini M, Bersini H, Bourgine P, Dorigo M, Doursat R (eds) Advances in artificial life, ECAL 2011: proceedings of the eleventh european conference on the synthesis and simulation of living systems. MIT Press, Cambridge, MA, pp 250–257

    Google Scholar 

  5. Miconi T (2008) Evosphere: evolutionary dynamics in a population of fighting virtual creatures. IEEE, pp 3066–3073

  6. Tchernichovski O, Marcus G (2014) Vocal learning beyond imitation: mechanisms of adaptive vocal development in songbirds and human infants. Curr Opin Neurobiol 28:42–47

    Article  Google Scholar 

  7. Tchernichovski O, Nottebohm F (1998) Social inhibition of song imitation among sibling male zebra finches. Proc Natl Acad Sci 95:8951–8956

    Article  Google Scholar 

  8. Derégnaucourt S, Gahr M (2013) Horizontal transmission of the father’s song in the zebra finch (Taeniopygia guttata). Biol Lett 9:20130247

    Article  Google Scholar 

  9. ten Cate C, Okanoya K (2012) Revisiting the syntactic abilities of non-human animals: natural vocalizations and artificial grammar learning. Philos Trans R Soc B Biol Sci 367:1984–1994

    Article  Google Scholar 

  10. Catchpole CK (1981) Vocal communication in birds. Jpn J Ornithol 30:87–89

    Article  Google Scholar 

  11. Steels L, Vogt P (1997) Grounding adaptive language games in robotic agents. In: Proceedings of the fourth European conference on artificial life, Brighton, UK, pp 474–482

  12. Marocco D, Nolfi S (2007) Emergence of communication in embodied agents evolved for the ability to solve a collective navigation problem. Connect Sci 19:53–74

    Article  Google Scholar 

  13. Sasahara K, Ikegami T (2007) Evolution of birdsong syntax by interjection communication. Artif Life 13:259–277

    Article  Google Scholar 

  14. Hashimoto T, Ikegami T (1996) Emergence of net-grammar in communicating agents. BioSystems 38:1–14

    Article  Google Scholar 

  15. Suzuki J, Kaneko K (1994) Imitation games. Phys D Nonlinear Phenom 75:328–342

    Article  Google Scholar 

  16. Yamazaki S, Iizuka H, Yamamoto M (2018) Emergence of chaotic time series by adversarial imitation learning. MIT Press, pp 659–664

  17. Robinson AJ, Frank Fallside (1987) The utility driven dynamic error propagation network. University of Cambridge Department of Engineering, Cambridge

    Google Scholar 

  18. Pascanu R, Mikolov T, Bengio Y (2013) On the difficulty of training recurrent neural networks. In: Proceedings of the 30th international conference on machine learning, ICML 2013, Atlanta, GA, USA, 16–21 June 2013, pp 1310–1318

  19. Lyapunov AM (1992) The general problem of the stability of motion. Int J Control 55:531–534

    Article  MathSciNet  Google Scholar 

  20. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets, pp 2672–2680

  21. Moran N, Pollack JB (2017) Effects of cooperative and competitive coevolution on complexity in a linguistic prediction game, pp 298–205

Download references

Acknowledgements

This work was partially supported by JSPS KAKENHI Grant number JP18H05057.

Author information

Authors and Affiliations

  1. Graduate School of Information Science and Technology, Hokkaido University, Kita 14, Nishi 9, Kita-ku, Sapporo, Hokkaido, 060-0814, Japan

    Seiya Yamazaki, Hiroyuki Iizuka & Masahito Yamamoto

Authors
  1. Seiya Yamazaki
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Hiroyuki Iizuka
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Masahito Yamamoto
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Seiya Yamazaki.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yamazaki, S., Iizuka, H. & Yamamoto, M. Complexity of bird song caused by adversarial imitation learning. Artif Life Robotics 25, 124–132 (2020). https://doi.org/10.1007/s10015-019-00559-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10015-019-00559-5

Keywords