More Web Proxy on the site http://driver.im/

poster

CamFi: An AI-driven and Camera-based System for Assisting Users in Finding Lost Objects in Multi-Person Scenarios

Authors:

Cheng YaoAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 457, Pages 1 - 7

https://doi.org/10.1145/3491101.3519780

Published: 28 April 2022 Publication History

Abstract

It is important to study how to help people quickly find misplaced objects. However, previous studies have focused on single-person scenarios without considering the influence of other people in public places. Based on the technology of object detection and face recognition, our system can help reduce the burden upon people's memory. It can provide useful information, whether the user forgets where the object is or because someone else has moved the object. The system includes a camera, processing server and smartphone application. To evaluate our approach, we conducted a quantitative and qualitative user study with participants (n=12). We demonstrated the usability of this system in helping users find misplaced items in public settings with multiple people.

Supplementary Material

MP4 File (3491101.3519780-video-figure.mp4)

Video Figure

Download
75.93 MB

MP4 File (3491101.3519780-video-preview.mp4)

Video Preview

Download
3.67 MB

MP4 File (3491101.3519780-talk-video.mp4)

Talk Video

Download
35.29 MB

References

[1]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual sus scores mean: adding an adjective rating scale. J. Usability Stud. 4, 3 (May 2009), 114–123.

[2]

Alexey Bochkovskiy, Chien-Yao Wang, Hong-Yuan Mark Liao. 2020. YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv: 2004.10934. Retrieved from https://doi.org/10.48550/arXiv.2004.10934

[3]

John Brooke. 1996. SUS: a “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (Eds.), Usability Evaluation in Industry. Taylor and Francis.

[4]

Andreas Butz, Michael Schneider, and Mira Spassova. 2004. SearchLight – a lightweight search function for pervasive environments. In Pervasive Computing (Lecture Notes in Computer Science). Springer, Berlin, Heidelberg, 351–356. https://doi.org/10.1007/978-3-540-24646-6_26

[5]

Sunsern Cheamanunkul, Evan Ettinger, Matt Jacobsen, Patrick Lai, and Yoav Freund. 2009. Detecting, tracking and interacting with people in a public space. In Proceedings of the 2009 international conference on Multimodal interfaces (ICMI-MLMI ’09). Association for Computing Machinery, New York, NY, USA, 79–86. https://doi.org/10.1145/1647314.1647330

Digital Library

[6]

Anooshmita Das, Krister Jens, and Mikkel Baun Kjærgaard. 2020. Space utilization and activity recognition using 3d stereo vision camera inside an educational building. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers (UbiComp-ISWC ’20). Association for Computing Machinery, New York, NY, USA, 629–637. https://doi.org/10.1145/3410530.3414318

[7]

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: a large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition. 248–255. https://doi.org/10.1109/CVPR.2009.5206848

[8]

Margery Eldridge, Abigail Sellen, and Debra Bekerian. 1992. Memory Problems at Work: Their Range, Frequency and Severity. Rank Xerox EUROPARC. Retrieved from https://europe.naverlabs.com/research/publications/memory-problems-at-work-their-range-frequency-and-severity/

[9]

Nicholas R. Fyfe and Jon Bannister. 1996. City watching: closed circuit television surveillance in public spaces. Area 28, 1 (1996), 37–46.

[10]

Julie A. Kientz, Shwetak N. Patel, Arwa Z. Tyebkhan, Brian Gane, Jennifer Wiley, and Gregory D. Abowd. 2006. Where's my stuff? design and evaluation of a mobile system for locating lost items for the visually impaired. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility (Assets ’06). Association for Computing Machinery, New York, NY, USA, 103–110. https://doi.org/10.1145/1168987.1169006

[11]

Mizuho Komatsuzaki, Koji Tsukada, Itiro Siio, Pertti Verronen, Mika Luimula, and Sakari Pieskä. 2011. IteMinder: finding items in a room using passive rfid tags and an autonomous robot (poster). In Proceedings of the 13th international conference on Ubiquitous computing - UbiComp ’11. ACM Press, Beijing, China, 599. https://doi.org/10.1145/2030112.2030232

Digital Library

[12]

Sandjar Kozubaev and Carl DiSalvo. 2021. Cracking public space open: design for public librarians. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–14. Retrieved from https://doi.org/10.1145/3411764.3445730

Digital Library

[13]

Xiaotao Liu, Mark D. Corner, and Prashant Shenoy. 2006. Ferret: rfid localization for pervasive multimedia. In Proceedings of the 8th international conference on Ubiquitous Computing (UbiComp’06). Springer-Verlag, Berlin, Heidelberg, 422–440. https://doi.org/10.1007/11853565_25

Digital Library

[14]

Clive Norris and Jade Moran. 2016. Surveillance, Closed Circuit Television and Social Control. Routledge.

[15]

Ling Pei, Ruizhi Chen, Jingbin Liu, Tomi Tenhunen, Heidi Kuusniemi, and Yuwei Chen. 2010. Inquiry-based bluetooth indoor positioning via rssi probability distributions. In Proceedings of the 2010 Second International Conference on Advances in Satellite and Space Communications (SPACOMM ’10). IEEE Computer Society, USA, 151–156. https://doi.org/10.1109/SPACOMM.2010.18

Digital Library

[16]

Rodney E. Peters, Richard Pak, Gregory D. Abowd, Arthur D. Fisk, and Wendy A. Rogers. 2004. Finding Lost Objects: Informing the Design of Ubiquitous Computing Services for the Home. Georgia Institute of Technology. Retrieved from https://smartech.gatech.edu/handle/1853/51

[17]

Pixie Technology. 2017. The nation's biggest lost and found survey by pixie. Retrieved January 12, 2022 from https://tinyurl.com/yxrzbsnp

[18]

Sarah Prange, Lukas Mecke, Michael Stadler, Maximilian Balluff, Mohamed Khamis, and Florian Alt. 2019. Securing personal items in public space: stories of attacks and threats. In Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (MUM ’19). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3365610.3365628

Digital Library

[19]

David Schwarz, Max Schwarz, Jörg Stückler, and Sven Behnke. 2015. Cosero, find my keys! object localization and retrieval using bluetooth low energy tags. In RoboCup 2014: Robot World Cup XVIII (Lecture Notes in Computer Science). Springer International Publishing, Cham, 195–206. https://doi.org/10.1007/978-3-319-18615-3_16

[20]

Masaya Tanbo, Ryoma Nojiri, Yuusuke Kawakita, and Haruhisa Ichikawa. 2017. Active rfid attached object clustering method with new evaluation criterion for finding lost objects. Mob. Inf. Syst. 2017, (February 2017), e3637814. https://doi.org/10.1155/2017/3637814

[21]

Paul Wilson, Daniel Prashanth, and Hamid Aghajan. 2007. Utilizing rfid signaling scheme for localization of stationary objects and speed estimation of mobile objects. In 2007 IEEE International Conference on RFID. 94–99. https://doi.org/10.1109/RFID.2007.346155

[22]

Dan Xie, Tingxin Yan, Deepak Ganesan, and Allen Hanson. 2008. Design and implementation of a dual-camera wireless sensor network for object retrieval. In Proceedings of the 7th international conference on Information processing in sensor networks (IPSN ’08). IEEE Computer Society, USA, 469–480. https://doi.org/10.1109/IPSN.2008.57

Digital Library

[23]

Takuma Yagi, Takumi Nishiyasu, Kunimasa Kawasaki, Moe Matsuki, and Yoichi Sato. 2021. GO-finder: a registration-free wearable system for assisting users in finding lost objects via hand-held object discovery. In 26th International Conference on Intelligent User Interfaces. ACM, College Station TX USA, 139–149. https://doi.org/10.1145/3397481.3450664

Digital Library

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Oshimi HPerusquía-Hernández MIsoyama NUchiyama HKiyokawa KWard JMcGill MMarky K(2023)LocatAR: An AR Object Search Assistance System for a Shared SpaceProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582712(66-76)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582712

Recommendations

GO-Finder: A Registration-Free Wearable System for Assisting Users in Finding Lost Objects via Hand-Held Object Discovery
IUI '21: Proceedings of the 26th International Conference on Intelligent User Interfaces

People spend an enormous amount of time and effort looking for lost objects. To help remind people of the location of lost objects, various computational systems that provide information on their locations have been developed. However, prior systems for ...
GO-Finder: A Registration-free Wearable System for Assisting Users in Finding Lost Hand-held Objects
People spend an enormous amount of time and effort looking for lost objects. To help remind people of the location of lost objects, various computational systems that provide information on their locations have been developed. However, prior systems for ...
Personal object discovery in first-person videos
People know and care for personal objects, which can be different for individuals. Automatically discovering personal objects is thus of great practical importance. We, in this paper, pursue this task with wearable cameras based on the common sense that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

Engineering Research Center of Computer Aided Product Innovation Design, Ministry of Education, Fundamental Research Funds for the Central Universities, National Natural Science Foundation of China
National Social Science Foundation of China

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
200
Total Downloads

Downloads (Last 12 months)74
Downloads (Last 6 weeks)6

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qin YSu JQin HTian Y(2024)Exploring the Role of Video Playback Visual Cues in Object Retrieval TasksSensors10.3390/s2410314724:10(3147)Online publication date: 15-May-2024
https://doi.org/10.3390/s24103147
Oshimi HPerusquía-Hernández MIsoyama NUchiyama HKiyokawa KWard JMcGill MMarky K(2023)LocatAR: An AR Object Search Assistance System for a Shared SpaceProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582712(66-76)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582712

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents