Enhancing Biodiversity Monitoring: An Interactive Tool for Efficient Identification of Species in Large Bioacoustics Datasets
Authors: 
Hannes Kath, Ilira Troshani, Bengt Lüers, Thiago S. Gouvêa, Daniel SonntagAuthors Info & Claims
Pages 91 - 93
Abstract
Biodiversity loss is a major challenge for humanity, which has increased the rate of species extinction by a factor of 100-1000 compared to pre-industrial times. XPRIZE Rainforest is a competition focused on developing a pipeline for real-time biodiversity measurement: teams have 24 hours to collect data and another 48 hours to produce a list of species present in the data. Passive acoustic monitoring (PAM) is a scalable technology for data acquisition in wildlife monitoring. However, analyzing large PAM datasets poses a significant challenge. This paper presents a tool used by the Brazilian team during the XPRIZE Rainforest finals. Using a combination of audio separation, weakly supervised learning, transfer learning, active learning, multiple-instance learning, and novel class detection, samples are carefully selected and presented to the user for annotation.
References
[1]
Bradley J. Cardinale, J. Emmett Duffy, Andrew Gonzalez, 2012. Biodiversity loss and its impact on humanity. Nature 486 (2012), 59–67. https://api.semanticscholar.org/CorpusID:4333166
[2]
Juan Cañas, María Toro-Gómez, Larissa Sugai, 2023. A dataset for benchmarking Neotropical anuran calls identification in passive acoustic monitoring. Scientific Data 10, 1 (2023), 771. https://doi.org/10.1038/s41597-023-02666-2
[3]
Jurriaan De Vos, Lucas Joppa, John Gittleman, 2015. Estimating the normal background rate of species extinction. Conservation biology 29, 2 (2015), 452–462.
[4]
Thiago S. Gouvêa, Ilira Troshani, Marc Herrlich, and Daniel Sonntag. 2022. Annotating Sound Events Through Interactive Design of Interpretable Features. In HHAI 2022: Augmenting Human Intellect - Proceedings of the First International Conference on Hybrid Human-Artificial Intelligence, Amsterdam, The Netherlands, 13-17 June 2022(Frontiers in Artificial Intelligence and Applications, Vol. 354). IOS Press, 305–306. https://doi.org/10.3233/FAIA220225
[5]
Thiago Gouvêa, Hannes Kath, Ilira Troshani, 2023. Interactive Machine Learning Solutions for Acoustic Monitoring of Animal Wildlife in Biosphere Reserves. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence. ijcai.org, Macau, SAR China, 6405–6413. https://doi.org/10.24963/ijcai.2023/711
[6]
IPBES. 2019. Summary for policymakers of the global assessment report on biodiversity and ecosystem services. Technical Report. Zenodo. https://doi.org/10.5281/ZENODO.3553579 Version Number: summary for policy makers.
[7]
Stefan Kahl, Connor Wood, Maximilian Eibl, and Holger Klinck. 2021. BirdNET: A deep learning solution for avian diversity monitoring. Ecological Informatics 61 (2021), 101236. https://doi.org/10.1016/j.ecoinf.2021.101236
[8]
Hannes Kath, Thiago Gouvêa, and Daniel Sonntag. 2023. A Human-in-the-Loop Tool for Annotating Passive Acoustic Monitoring Datasets. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence. Macau, SAR China, 7140–7144. https://doi.org/10.24963/ijcai.2023/835
[9]
Hannes Kath, Thiago S. Gouvêa, and Daniel Sonntag. 2024. Active and Transfer Learning for Efficient Identification of Species in Multi-Label Bioacoustic Datasets. In Proceedings of the 2024 ACM Conference on Information Technology for Social Good, GoodIT 2024, Bremen, Germany, September 4-6, 2023. ACM.
[10]
Hannes Kath, Patricia P. Serafini, Ivan B. Campos, 2024. Demo: Enhancing Wildlife Acoustic Data Annotation Efficiency through Transfer and Active Learning. In Proceedings of the 33nd International Joint Conference on Artificial Intelligence, IJCAI.
[11]
Hannes Kath, Patricia P. Serafini, Ivan B. Campos, 2024. Leveraging transfer learning and active learning for data annotation in passive acoustic monitoring of wildlife. Ecological Informatics 82 (2024), 102710. https://doi.org/10.1016/j.ecoinf.2024.102710
[12]
Bengt Lüers, Patricia P. Serafini, Ivan Braga Campos, and others Gouvêa. 2024. BirdNET-Annotator: AI-Assisted Strong Labelling of Bird Sound Datasets. In 3rd Annual AAAI Workshop on AI to Accelerate Science and Engineering (AI2ASE). Vancouver, Canada.
[13]
Félix Michaud, Jérôme Sueur, Maxime LE Cesne, and Sylvain Haupert. 2022. Unsupervised classification to improve the quality of a bird song recording dataset. ArXiv abs/2302.07560 (2022). https://api.semanticscholar.org/CorpusID:254625204
[14]
Sean Perry, Vaibhav Tiwari, Nishant Balaji, 2021. Pyrenote: a Web-based, Manual Annotation Tool for Passive Acoustic Monitoring. In IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems, MASS 2021, Denver, CO, USA, October 4-7, 2021. IEEE, 633–638. https://doi.org/10.1109/MASS52906.2021.00091
[15]
S. Pimm, C. Jenkins, R. Abell, 2014. The biodiversity of species and their rates of extinction, distribution, and protection. Science 344, 6187 (2014), 1246752.
[16]
Samuel Ross, Darren O’Connell, Jessica Deichmann, 2023. Passive acoustic monitoring provides a fresh perspective on fundamental ecological questions. Functional Ecology 37, 4 (2023), 959–975.
[17]
Alba Solsona-Berga, Kaitlin E. Frasier, Simone Baumann-Pickering, 2020. DetEdit: A graphical user interface for annotating and editing events detected in long-term acoustic monitoring data. PLoS Comput. Biol. 16, 1 (2020). https://doi.org/10.1371/journal.pcbi.1007598
[18]
Jérôme Sueur, Sandrine Pavoine, Olivier Hamerlynck, and Stéphanie Duvail. 2008. Rapid Acoustic Survey for Biodiversity Appraisal. PLOS ONE 3, 12 (2008), e4065.
[19]
Larissa Sugai and Diego Llusia. 2019. Bioacoustic time capsules: Using acoustic monitoring to document biodiversity. Ecological Indicators 99 (2019), 149–152.
[20]
Larissa Sugai, Thiago Silva, José Ribeiro, and Diego Llusia. 2019. Terrestrial Passive Acoustic Monitoring: Review and Perspectives. BioScience 69, 1 (2019), 15–25.
[21]
Maxim Tkachenko, Mikhail Malyuk, Andrey Holmanyuk, and Nikolai Liubimov. 2020. Label Studio: Data labeling software. https://github.com/heartexlabs/label-studio
[22]
Ilira Troshani, Thiago Gouvea, and Daniel Sonntag. 2024. Leveraging Weakly Supervised and Multiple Instance Learning for Multi-label Classification of Passive Acoustic Monitoring Data. In KI 2024: Advances in Artificial Intelligence. German Conference on Artificial Intelligence (KI-2024), 47th German Conference on AI, Würzburg, Germany, September 25–27, 2023, located at 47th German Conference on AI, September 25-27, Würzburg, Germany. Springer.
[23]
Devis Tuia, Benjamin Kellenberger, Sara Beery, 2022. Perspectives in machine learning for wildlife conservation. Nature Communications 13, 1 (Feb. 2022), 792. https://doi.org/10.1038/s41467-022-27980-y Number: 1, Publisher: Nature Publishing Group.
[24]
Juan Sebastián Ulloa, Sylvain Haupert, Juan Felipe Latorre, 2021. scikit‐maad: An open‐source and modular toolbox for quantitative soundscape analysis in Python. Methods in Ecology and Evolution (Sept. 2021), 2041–210X.13711. https://doi.org/10.1111/2041-210X.13711
[25]
E.O. Wilson and Harvard University (Eds.). 1988. Biodiversity. The National Academies Press, Washington, DC.
Index Terms
- Enhancing Biodiversity Monitoring: An Interactive Tool for Efficient Identification of Species in Large Bioacoustics Datasets
Recommendations
Active and Transfer Learning for Efficient Identification of Species in Multi-Label Bioacoustic Datasets
GoodIT '24: Proceedings of the 2024 International Conference on Information Technology for Social GoodThe complex system of life on Earth, biodiversity, provides the essential resources for human survival. However, humanity is the primary driver of species extinction, accelerating the extinction rate to 100-1000 times higher than pre-industrial times. ...
A Human-in-the-Loop Tool for Annotating Passive Acoustic Monitoring Datasets (Extended Abstract)
KI 2024: Advances in Artificial IntelligenceActive Learning in Multi-label Classification of Bioacoustic Data
KI 2024: Advances in Artificial IntelligenceAbstractPassive Acoustic Monitoring (PAM) has become a key technology in wildlife monitoring, providing vast amounts of acoustic data. The recording process naturally generates multi-label datasets; however, due to the significant annotation time required,...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2024
252 pages
ISBN:9798400704635
DOI:10.1145/3686215
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 November 2024
Check for updates
Author Tags
Qualifiers
- Demonstration
- Research
- Refereed limited
Funding Sources
- Niedersächsisches Ministerium für Wissenschaft und Kultur
Conference
ICMI '24
Sponsor:
ICMI '24: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
November 4 - 8, 2024
San Jose, Costa Rica
Acceptance Rates
Overall Acceptance Rate 453 of 1,080 submissions, 42%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 41Total Downloads
- Downloads (Last 12 months)41
- Downloads (Last 6 weeks)30
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format