More Web Proxy on the site http://driver.im/

research-article

lifeXplore at the Lifelog Search Challenge 2021

Authors:

Andreas Leibetseder,

Klaus SchoeffmannAuthors Info & Claims

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

Pages 23 - 28

https://doi.org/10.1145/3463948.3469060

Published: 21 August 2021 Publication History

Abstract

Since its first iteration in 2018, the Lifelog Search Challenge (LSC) continues to rise in popularity as an interactive lifelog data retrieval competition, co-located at the ACM International Conference on Multimedia Retrieval (ICMR). The goal of this annual live event is to search a large corpus of lifelogging data for specifically announced memories using a purposefully developed tool within a limited amount of time. As long-standing participants, we present our improved lifeXplore -- a retrieval system combining chronologic day summary browsing with interactive combinable concept filtering. Compared to previous versions, the tool is improved by incorporating temporal queries, advanced day summary features as well as usability improvements.

References

[1]

Ahmed Alateeq, Mark Roantree, and Cathal Gurrin. 2020. Voxento: A Prototype Voice-controlled Interactive Search Engine for Lifelogs. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 77--81. https://doi.org/10.1145/3379172.3391728

Digital Library

[2]

Tai-Te Chu, Chia-Chun Chang, An-Zi Yen, Hen-Hsen Huang, and Hsin-Hsi Chen. 2020. Multimodal Retrieval through Relations between Subjects and Objects in Lifelog Images. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 51--55. https://doi.org/10.1145/3379172.3391723

Digital Library

[3]

Aaron Duane, Björn Þór Jónsson, and Cathal Gurrin. 2020. VRLE: Lifelog Interaction Prototype in Virtual Reality: Lifelog Search Challenge at ACM ICMR 2020. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 7--12. https://doi.org/10.1145/3379172.3391716

Digital Library

[4]

Cathal Gurrin, Tu-Khiem Le, Van-Tu Ninh, Duc-Tien Dang-Nguyen, Björn Þor Jonsson, Klaus Schoeffmann, Jakub Lokoc, Wolfgang Huerst, and Minh-Triet Tran. 2020. An Introduction to the Third Annual Lifelog Search Challenge. In ICMR '20, The 2020 International Conference on Multimedia Retrieval. ACM, Dublin, Ireland.

Digital Library

[5]

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Dang Nguyen, Duc Tien, Michael Riegler, Luca Piras, et al. 2019 a. Comparing approaches to interactive lifelog search at the lifelog search challenge (LSC2018). ITE Transactions on Media Technology and Applications, Vol. 7, 2 (2019), 46--59.

[6]

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Bernd Munzer, Rami Albatal, Frank Hopfgartner, Liting Zhou, and Duc-Tien Dang-Nguyen. 2019 b. A test collection for interactive lifelog retrieval. In International Conference on Multimedia Modeling. Springer, Springer, Cham, 312--324.

[7]

Cathal Gurrin, Björn Þór Jónsson, Klaus Schöffmann, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, Wolfgang Hürst, Luca Rossetto, and Graham Healy. 2021. Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21. In Proc. International Conference on Multimedia Retrieval (ICMR'21). ACM, Taipei, Taiwan.

Digital Library

[8]

Silvan Heller, Mahnaz Amiri Parian, Ralph Gasser, Loris Sauter, and Heiko Schuldt. 2020. Interactive Lifelog Retrieval with vitrivr. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 1--6. https://doi.org/10.1145/3379172.3391715

Digital Library

[9]

Omar Shahbaz Khan, Mathias Dybkjær Larsen, Liam Alex Sonto Poulsen, Björn Þór Jónsson, Jan Zahálka, Stevan Rudinac, Dennis Koelma, and Marcel Worring. 2020. Exquisitor at the Lifelog Search Challenge 2020. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 19--22. https://doi.org/10.1145/3379172.3391718

Digital Library

[10]

Gregor Kovalcik, Vit Skrhak, Tomá s Soucek, and Jakub Lokoc. 2020. VIRET Tool with Advanced Visual Browsing and Feedback. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 63--66. https://doi.org/10.1145/3379172.3391725

Digital Library

[11]

Tu-Khiem Le, Van-Tu Ninh, Minh-Triet Tran, Thanh-An Nguyen, Hai-Dang Nguyen, Liting Zhou, Graham Healy, and Cathal Gurrin. 2020. LifeSeeker 2.0: Interactive Lifelog Search Engine at LSC 2020. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 57--62. https://doi.org/10.1145/3379172.3391724

Digital Library

[12]

Andreas Leibetseder, Bernd Münzer, Jürgen Primus, Sabrina Kletz, and Klaus Schoeffmann. 2020. diveXplore 4.0: The ITEC Deep Interactive Video Exploration System at VBS2020. In International Conference on Multimedia Modeling. Springer, 753--759.

Digital Library

[13]

Andreas Leibetseder, Bernd Münzer, Manfred Jürgen Primus, Sabrina Kletz, Klaus Schoeffmann, Fabian Berns, and Christian Beecks. 2019. lifeXplore at the Lifelog Search Challenge 2019. In Proc. of the ACM Workshop on Lifelog Search Challenge. ACM, 13--17.

Digital Library

[14]

Andreas Leibetseder and Klaus Schoeffmann. 2020. lifeXplore at the Lifelog Search Challenge 2020. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 37--42. https://doi.org/10.1145/3379172.3391721

Digital Library

[15]

Jiayu Li, Min Zhang, Weizhi Ma, Yiqun Liu, and Shaoping Ma. 2020. A Multi-level Interactive Lifelog Search Engine with User Feedback. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schö ffmann, Bjö rn Þó r Jó nsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 29--35. https://doi.org/10.1145/3379172.3391720

Digital Library

[16]

J. Lokoc, W. Bailer, K. Schoeffmann, B. Muenzer, and G. Awad. 2018. On influential trends in interactive video retrieval: Video Browser Showdown 2015--2017. IEEE Transactions on Multimedia (2018), 1--1. https://doi.org/10.1109/TMM.2018.2830110

Digital Library

[17]

Jakub Lokovc, Gregor Kovalvcik, Bernd Münzer, Klaus Schöffmann, Werner Bailer, Ralph Gasser, Stefanos Vrochidis, Phuong Anh Nguyen, Sitapa Rujikietgumjorn, and Kai Uwe Barthel. 2019. Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl., Vol. 15, 1, Article 29 (Feb. 2019), 18 pages. https://doi.org/10.1145/3295663

Digital Library

[18]

Anh-Vu Mai-Nguyen, Trong-Dat Phan, Anh-Khoa Vo, Van-Luon Tran, Minh-Son Dao, and Koji Zettsu. 2020. BIDAL-HCarnegie Mellon UniversityS@LSC2020: An Interactive Multimodal Lifelog Retrieval with Query-to-Sample Attention-based Search Engine. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 43--49. https://doi.org/10.1145/3379172.3391722

Digital Library

[19]

Frantisek Mejzlik, Patrik Veselý, Miroslav Kratochvil, Tomás Soucek, and Jakub Lokoc. 2020. SOMHunter for Lifelog Search. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 73--75. https://doi.org/10.1145/3379172.3391727

Digital Library

[20]

Bernd Münzer, Andreas Leibetseder, Sabrina Kletz, Manfred Jürgen Primus, and Klaus Schoeffmann. 2018. lifeXplore at the Lifelog Search Challenge 2018. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY, USA, 3--8. https://doi.org/10.1145/3210539.3210541

Digital Library

[21]

Luca Rossetto, Matthias Baumgartner, Narges Ashena, Florian Ruosch, Romana Pernischová, and Abraham Bernstein. 2020. LifeGraph: A Knowledge Graph for Lifelogs. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hürst (Eds.). ACM, 13--17. https://doi.org/10.1145/3379172.3391717

Digital Library

[22]

Klaus Schoeffmann. 2014. A User-Centric Media Retrieval Competition: The Video Browser Showdown 2012--2014. MultiMedia, IEEE, Vol. 21, 4 (Oct 2014), 8--13. https://doi.org/10.1109/MMUL.2014.56

[23]

Klaus Schoeffmann, Bernd Münzer, Andreas Leibetseder, Jürgen Primus, and Sabrina Kletz. 2019. Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at VBS2019. In MultiMedia Modeling, Ioannis Kompatsiaris, Benoit Huet, Vasileios Mezaris, Cathal Gurrin, Wen-Huang Cheng, and Stefanos Vrochidis (Eds.). Springer International Publishing, Cham, 585--590.

[24]

Ly-Duyen Tran, Manh-Duy Nguyen, Nguyen Thanh Binh, Hyowon Lee, and Cathal Gurrin. 2020 a. Myscéal: An Experimental Interactive Lifelog Retrieval System for LSC'20. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 23--28. https://doi.org/10.1145/3379172.3391719

Digital Library

[25]

Minh-Triet Tran, Thanh-An Nguyen, Quoc-Cuong Tran, Mai-Khiem Tran, Khanh Nguyen, Van-Tu Ninh, Tu-Khiem Le, Hoang-Phuc Trang-Trung, Hoang-Anh Le, Hai-Dang Nguyen, Trong-Le Do, Viet-Khoa Vo-Ho, and Cathal Gurrin. 2020 b. FIRST - Flexible Interactive Retrieval SysTem for Visual Lifelog Exploration at LSC 2020. In Proceedings of the Third ACM Workshop on Lifelog Search Challenge, LSC@ICMR 2020, Dublin, Ireland, June 8--11, 2020, Cathal Gurrin, Klaus Schöffmann, Björn Þór Jónsson, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, and Wolfgang Hü rst (Eds.). ACM, 67--72. https://doi.org/10.1145/3379172.3391726

Digital Library

Cited By

Tegegne TTran LNourse RGurrin CMaddison R(2024)Daily Activity Lifelogs of People With Heart Failure: Observational StudyJMIR Formative Research10.2196/512488(e51248)Online publication date: 21-Feb-2024
https://doi.org/10.2196/51248
Tran QNguyen BJones GGurrin C(2024)MemoriEase 2.0: A Conversational Lifelog Retrieve System for LSC'24Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661114(12-17)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661114
Ho HPham MTran QPham QNguyen L(2024)Glimpse: A Multimodal-based Transforming Image Collection with Vector Database2024 International Conference on Information Networking (ICOIN)10.1109/ICOIN59985.2024.10572095(415-420)Online publication date: 17-Jan-2024
https://doi.org/10.1109/ICOIN59985.2024.10572095
Show More Cited By

Index Terms

lifeXplore at the Lifelog Search Challenge 2021
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools
2. Information systems
  1. Information retrieval
    1. Specialized information retrieval
      1. Multimedia and multimodal retrieval
    2. Users and interactive retrieval
      1. Search interfaces

Recommendations

lifeXplore at the Lifelog Search Challenge 2019
LSC '19: Proceedings of the ACM Workshop on Lifelog Search Challenge

First held in Yokohama, Japan in 2018, the Lifelogging Search Challenge (LSC) is an interactive lifelogging content retrieval competition, where international teams are faced with the task of finding specific moments within a large collection of ...
lifeXplore at the Lifelog Search Challenge 2022
LSC '22: Proceedings of the 5th Annual on Lifelog Search Challenge

Lifelogging creates substantial data archives that are challenging to manage and search. The annual Lifelog Search Challenge (LSC) aims at improving this situation by encouraging international teams to create interactive retrieval systems for searching ...
lifeXplore at the Lifelog Search Challenge 2018
LSC '18: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge

With the growing hype for wearable devices recording biometric data comes the readiness to capture and combine even more personal information as a form of digital diary - lifelogging today is practiced ever more and can be categorized anywhere between ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

August 2021

102 pages

ISBN:9781450385336

DOI:10.1145/3463948

General Chairs:
Cathal Gurrin
Dublin City University, Ireland
,
Klaus Schoeffmann
Klagenfurt University, Austria
,
Björn Jónsson
IT University of Copenhagen, Denmark
,
Duc-Tien Dang-Nguyen
University of Bergen, Norway
,
Jakub Lokoč
Charles University, Czech Republic
,
Minh-Triet Tran
HCM University of Science, Vietnam
,
Wolfgang Hürst
Utrecht University, Netherlands
,
Luca Rossetto
University of Zurich, Switzerland
,
Graham Healy
Dublin City University, Ireland

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMR '21

Sponsor:

SIGMM

ICMR '21: International Conference on Multimedia Retrieval

August 21, 2021

Taipei, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
162
Total Downloads

Downloads (Last 12 months)21
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tegegne TTran LNourse RGurrin CMaddison R(2024)Daily Activity Lifelogs of People With Heart Failure: Observational StudyJMIR Formative Research10.2196/512488(e51248)Online publication date: 21-Feb-2024
https://doi.org/10.2196/51248
Tran QNguyen BJones GGurrin C(2024)MemoriEase 2.0: A Conversational Lifelog Retrieve System for LSC'24Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661114(12-17)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661114
Ho HPham MTran QPham QNguyen L(2024)Glimpse: A Multimodal-based Transforming Image Collection with Vector Database2024 International Conference on Information Networking (ICOIN)10.1109/ICOIN59985.2024.10572095(415-420)Online publication date: 17-Jan-2024
https://doi.org/10.1109/ICOIN59985.2024.10572095
Tran MTo TThai VCao TNguyen T(2023)AGAIN: A Multimodal Human-Centric Event Retrieval System using dual image-to-text representationsProceedings of the 12th International Symposium on Information and Communication Technology10.1145/3628797.3628975(931-937)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3628797.3628975
Schoeffmann K(2023)lifeXplore at the Lifelog Search Challenge 2023Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593105(53-58)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593105
Rossetto LInel OLange SRuosch FWang RBernstein A(2023)Multi-Mode Clustering for Graph-Based Lifelog RetrievalProceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593102(36-40)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593102
Tran QTran LNguyen BGurrin C(2023)MemoriEase: An Interactive Lifelog Retrieval System for LSC’23Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593101(30-35)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593101
Tran LNguyen MDang-Nguyen DHeller SSpiess FLokoč JPeška LNguyen TKhan ODuane AJónsson BRossetto LYen AAlateeq AAlam NTran MHealy GSchoeffmann KGurrin C(2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3248284
Hoang-Xuan NTrang-Trung HTran MLe TNguyen ENinh VLe TTran M(2023)First-flexible interactive retrieval system for visual lifelog explorationMultimedia Tools and Applications10.1007/s11042-023-16287-982:24(37877-37902)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1007/s11042-023-16287-9
Ribiero RTrifan ANeves AGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022Proceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533011(8-13)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533011
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents