A Mobile Robot Generating Video Summaries of Seniors' Indoor Activities
Article No.: 54, Pages 1 - 6
Abstract
We develop a system which generates summaries from seniors' indoor-activity videos captured by a social robot to help remote family members know their seniors' daily activities at home. Unlike the traditional video summarization datasets, indoor videos captured from a moving robot poses additional challenges, namely, (i) the video sequences are very long (ii) a significant number of videoframes contain no-subject or with subjects at ill-posed locations and scales (iii) most of the well-posed frames contain highly redundant information. To address this problem, we propose to exploit pose estimation for detecting people in frames. This guides the robot to follow the user and capture effective videos. We use person identification to distinguish a target senior from other people. We also make use of action recognition to analyze seniors' major activities at different moments, and develop a video summarization method to select diverse and representative keyframes as summaries.
References
[1]
Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. In CVPR.
[2]
Chaona Chen, Oliver G. B. Garrod, Jiayu Zhan, Jonas Beskow Philippe G. Schyns, and Rachael E. Jack. 2018. Reverse Engineering Psychologically Valid Facial Expressions of Emotion into Social Robots. In FG.
[3]
Sandra Eliza Fontes de Avila, Ana Paula Brand ao Lopes, Antonio da Luz Jr., and Arnaldo de Albuquerque Araújo. 2011. VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method. Pattern Recognition Letters 32, 1 (2011), 56--68.
[4]
Boqing Gong, Wei-Lun Chao, Kristen Grauman, and Fei Sha. 2014. Diverse Sequential Subset Selection for Supervised Video Summarization. In NIPS.
[5]
Forrest N. Iandola, Matthew W. Moskewicz, Khalid Ashraf, Song Han, William J. Dally, and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size.arXiv:1602.07360 (2016).
[6]
Intel. 2019. Distribution of OpenVINO Toolkit. https://software.intel.com/en-us/openvino-toolkit. (2019).
[7]
Tineke Klamer and Soumaya Ben Allouch. 2010. Acceptance and use of a social robot by elderly users in a domestic environment. In Proceedings of IEEE International Conference on Pervasive Computing Technologies for Healthcare.
[8]
José Luis Pech-Pacheco, Gabriel Cristóbal, Jesús Chamorro-Martínez, and Joaquín Fernández-Valdivia. 2000. Diatom Autofocusing in Brightfield Microscopy: a Comparative Study. In ICPR.
[9]
M. Saquib Sarfraz, Arne Schumann, Andreas Eberle, and Rainer Stiefelhagen. 2018. A Pose-Sensitive Embedding for Person Re-Identification with Expanded Cross Neighborhood Re-Ranking. In CVPR.
[10]
Gunnar A. Sigurdsson, Göl Varol, Xiaolong Wang, Ali Farhadi, Ivan Laptev, and Abhinav Gupta. 2016. Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding. In ECCV.
[11]
Zheng-Hua Tan, Nicolai Bæk Thomsen, Xiaodong Duan, Evgenios Vlachos, Sven Ewan Shepstone, Morten Højfeldt Rasmussen, and Jesper Lisby Højvang. 2018. iSocioBot: A Multimodal Interactive Social Robot. IJSR 10, 1 (2018), 5--19.
[12]
Ke Zhang, Wei-Lun Chao, Fei Sha, and Kristen Grauman. 2016. Video summarization with long short-term memory. In ECCV.
[13]
Kaiyang Zhou, Yu Qiao, and Tao Xiang. 2018. Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward. In AAAI.
Index Terms
- A Mobile Robot Generating Video Summaries of Seniors' Indoor Activities
Recommendations
A transformable wheel-legged mobile robot
This paper proposes a new type of transformable wheel-legged mobile robot that could be applied on both flat and rugged terrains. It integrates stability and maneuverability of wheeled robot and obstacle climbing capability of legged robot by means of a ...
Velocity planning for a mobile robot to track a moving target - a potential field approach
Potential field method has been widely used for mobile robot path planning, but mostly in a static environment where the target and the obstacles are stationary. The path planning result is normally the direction of the robot motion. In this paper, the ...
Obstacle avoidance of a mobile robot using vision system and ultrasonic sensor
ICIC'07: Proceedings of the intelligent computing 3rd international conference on Advanced intelligent computing theories and applicationsThis paper proposes obstacle collision avoidance algorithm for a mobile robot. To navigate without colliding with obstacles the mobile robot uses both the vision system approach and edge detection approach using ultrasonic sensor. The vision system ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2019
646 pages
ISBN:9781450368254
DOI:10.1145/3338286
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 October 2019
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
MobileHCI '19
Sponsor:
MobileHCI '19: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
October 1 - 4, 2019
Taipei, Taiwan
Acceptance Rates
Overall Acceptance Rate 202 of 906 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 156Total Downloads
- Downloads (Last 12 months)12
- Downloads (Last 6 weeks)1
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in