research-article

ViRMA: Virtual Reality Multimedia Analytics at LSC 2021

Authors:

Aaron Duane,

Bjorn Þór JónssonAuthors Info & Claims

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

Pages 29 - 34

https://doi.org/10.1145/3463948.3469067

Published: 21 August 2021 Publication History

Get Access

Abstract

In this paper we describe the first iteration of the ViRMA prototype system, a novel approach to multimedia analysis in virtual reality and inspired by the M3 data model. We intend to evaluate our approach via the Lifelog Search Challenge (LSC) to serve as a benchmark against other multimedia analytics systems.

References

[1]

Aaron Duane, Björn Þór Jónsson, and Cathal Gurrin. 2020. VRLE: Lifelog Interaction Prototype in Virtual Reality: Lifelog Search Challenge at ACM ICMR 2020. In Proceedings of the Third Annual Workshop on Lifelog Search Challenge (Dublin, Ireland) (LSC '20). Association for Computing Machinery, New York, NY, USA, 7--12. https://doi.org/10.1145/3379172.3391716

Digital Library

Google Scholar

[2]

Snorri Gíslason, Björn Þór Jónsson, and Laurent Amsaleg. 2019. Integration of Exploration and Search: A Case Study of the M 3 Model. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 11295 LNCS. 156--168. https://doi.org/10.1007/978--3-030-05710--7_13

Crossref

Google Scholar

[3]

Cathal Gurrin, Björn Þór Jónsson, Klaus Schöffmann, Duc-Tien Dang-Nguyen, Jakub Lokoč, Minh-Triet Tran, Wolfgang Hürst, Luca Rossetto, and Graham Healy. 2021. Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21. In Proc. International Conference on Multimedia Retrieval (ICMR'21). ACM, Taipei, Taiwan.

Digital Library

Google Scholar

[4]

Pascal Mettes, Dennis C Koelma, and Cees GM Snoek. 2016. The ImageNet shuffle: Reorganized pre-training for video event detection. In Proc. ACM ICMR. 175--182.

Digital Library

Google Scholar

[5]

Daniel Seebacher, Johannes Häußler, Manuel Stein, Halldor Janetzko, Tobias Schreck, and Daniel A. Keim. 2017. Visual analytics and similarity search: concepts and challenges for effective retrieval considering users, tasks, and data. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10609 LNCS (2017), 324--332. https://doi.org/10.1007/978--3--319--68474--1_23

Crossref

Google Scholar

[6]

Mel Slater and Sylvia Wilbur. 1997. A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators and Virtual Environments 6, 6 (12 1997), 603--616. https://doi.org/10.1162/pres.1997.6.6.603

Digital Library

Google Scholar

[7]

Saining Xie, Ross Girshick, Piotr Dollar, Zhuowen Tu, and Kaiming He. 2017. Aggregated Residual Transformations for Deep Neural Networks. In Proc. CVPR.

Crossref

Google Scholar

[8]

Jan Zahalka and Marcel Worring. 2014. Towards interactive, intelligent, and integrated multimedia analytics. In 2014 IEEE Conference on Visual Analytics Science and Technology, VAST 2014 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 3--12. https://doi.org/10.1109/VAST.2014.7042476

Crossref

Google Scholar

Cited By

View all

Ly DDuong-Le DVuong GHo VNinh VTran MLe K(2024)CollaXRSearch: A Collaborative Virtual Reality System for Lifelog RetrievalProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661125(76-81)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661125
Spiess FSchuldt HRossetto L(2024)Spatiotemporal Lifelog Analytics in Virtual Reality with vitrivr-VRProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661113(7-11)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661113
Schoeffmann K(2023)lifeXplore at the Lifelog Search Challenge 2023Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593105(53-58)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593105
Show More Cited By

Index Terms

ViRMA: Virtual Reality Multimedia Analytics at LSC 2021
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality
2. Information systems
  1. Information retrieval
    1. Users and interactive retrieval

Recommendations

ViRMA: Virtual Reality Multimedia Analytics
ICMR '22: Proceedings of the 2022 International Conference on Multimedia Retrieval

In this paper we describe the latest iteration of the Virtual Reality Multimedia Analytics (ViRMA) system, a novel approach to multimedia analysis in virtual reality which is supported by the Multi-dimensional Multimedia Model.
ViRMA: Virtual Reality Multimedia Analytics at Video Browser Showdown 2022
MultiMedia Modeling
Abstract
In this paper we describe the first iteration of the ViRMA prototype system, a novel approach to multimedia analysis in virtual reality, that is inspired by the M $^{3}$ data model. In this model, media is mapped into a multidimensional space, based on ...
Haptics in Virtual Reality and Multimedia

Imagine that you're chatting with a good friend who tells you about her new cashmere pullover, and that you're able to touch it and appreciate the soft sensation of the cashmere wool--remotely over the Web in your virtual chatroom! In this article, the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

August 2021

102 pages

ISBN:9781450385336

DOI:10.1145/3463948

General Chairs:
Cathal Gurrin
Dublin City University, Ireland
,
Klaus Schoeffmann
Klagenfurt University, Austria
,
Björn Jónsson
IT University of Copenhagen, Denmark
,
Duc-Tien Dang-Nguyen
University of Bergen, Norway
,
Jakub Lokoč
Charles University, Czech Republic
,
Minh-Triet Tran
HCM University of Science, Vietnam
,
Wolfgang Hürst
Utrecht University, Netherlands
,
Luca Rossetto
University of Zurich, Switzerland
,
Graham Healy
Dublin City University, Ireland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Marie Curie Individual Fellowship (MCSA-IF)

Conference

ICMR '21

Sponsor:

SIGMM

ICMR '21: International Conference on Multimedia Retrieval

August 21, 2021

Taipei, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
116
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)3

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ly DDuong-Le DVuong GHo VNinh VTran MLe K(2024)CollaXRSearch: A Collaborative Virtual Reality System for Lifelog RetrievalProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661125(76-81)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661125
Spiess FSchuldt HRossetto L(2024)Spatiotemporal Lifelog Analytics in Virtual Reality with vitrivr-VRProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661113(7-11)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661113
Schoeffmann K(2023)lifeXplore at the Lifelog Search Challenge 2023Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593105(53-58)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593105
Alateeq ARoantree MGurrin C(2023)Voxento 4.0: A More Flexible Visualisation and Control for LifelogsProceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593097(7-12)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593097
Tran LNguyen MDang-Nguyen DHeller SSpiess FLokoč JPeška LNguyen TKhan ODuane AJónsson BRossetto LYen AAlateeq AAlam NTran MHealy GSchoeffmann KGurrin C(2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3248284
Hoang-Xuan NTrang-Trung HTran MLe TNguyen ENinh VLe TTran M(2023)First-flexible interactive retrieval system for visual lifelog explorationMultimedia Tools and Applications10.1007/s11042-023-16287-982:24(37877-37902)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1007/s11042-023-16287-9
Tran LNguyen MNguyen BLee HZhou LGurrin CGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)E-Myscéal: Embedding-based Interactive Lifelog Retrieval System for LSC'22Proceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533012(32-37)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533012
Alateeq ARoantree MGurrin CGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)Voxento 3.0: A Prototype Voice-Controlled Interactive Search Engine for LifelogProceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533009(43-47)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533009

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

ViRMA: Virtual Reality Multimedia Analytics

ViRMA: Virtual Reality Multimedia Analytics at Video Browser Showdown 2022

Haptics in Virtual Reality and Multimedia