A video dataset of a wooden box assembly process: dataset
Authors: 
Jiayun Zhang, Petr Byvshev, Yu XiaoAuthors Info & Claims
Pages 35 - 39
Abstract
This paper presents a video dataset of a 9-step wooden box assembly process including 17 subjects. The main strength of this dataset is the design of a standard and uniform workflow and the use of multiple cameras capturing videos from two different viewpoints. 62 video files were collected with the total size of 20 GB and the total duration of 13 hours. Each of the video is complemented with temporal annotations that indicate the starting and ending timestamps of each work step in the assembly process. We also provide statistical descriptive analyses of the recorded processes. Our dataset can be utilized for developing solutions to human activity recognition, process documentation, and many others that involve human-object interaction.
References
[1]
Jean-Baptiste Alayrac, Piotr Bojanowski, Nishant Agrawal, Josef Sivic, Ivan Laptev, and Simon Lacoste-Julien. 2016. Unsupervised learning from narrated instruction videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4575--4583.
[2]
Jean-Baptiste Alayrac, Ivan Laptev, Josef Sivic, and Simon Lacoste-Julien. 2017. Joint discovery of object states and manipulation actions. In Proceedings of the IEEE International Conference on Computer Vision. 2127--2136.
[3]
Kai Kang, Hongsheng Li, Tong Xiao, Wanli Ouyang, Junjie Yan, Xihui Liu, and Xiaogang Wang. 2017. Object detection in videos with tubelet proposal networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 727--735.
[4]
Alina Kuznetsova, Sung Ju Hwang, Bodo Rosenhahn, and Leonid Sigal. 2015. Expanding object detector's horizon: Incremental learning framework for object detection in videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 28--36.
[5]
Jonathan Malmaud, Jonathan Huang, Vivek Rathod, Nick Johnston, Andrew Rabinovich, and Kevin Murphy. 2015. What's cookin'? interpreting cooking videos using text, speech and vision. arXiv preprint arXiv:1503.01558 (2015).
[6]
Antoine Miech, Dimitri Zhukov, Jean-Baptiste Alayrac, Makarand Tapaswi, Ivan Laptev, and Josef Sivic. 2019. HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips. CoRR abs/1906.03327 (2019). arXiv:1906.03327 http://arxiv.org/abs/1906.03327
[7]
Alba Roda-Sales, Margarita Vergara, Joaquín L Sancho-Bru, Verónica Gracia-Ibáñez, and Néstor J Jarque-Bou. 2019. Human hand kinematic data during feeding and cooking tasks. Scientific data 6, 1 (2019), 1--10.
[8]
Ozan Sener, Amir R Zamir, Silvio Savarese, and Ashutosh Saxena. 2015. Unsupervised semantic parsing of video collections. In Proceedings of the IEEE International Conference on Computer Vision. 4480--4488.
[9]
Dongsong Zhang, Lina Zhou, Robert O Briggs, and Jay F Nunamaker Jr. 2006. Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & management 43, 1 (2006), 15--27.
[10]
Jiayun Zhang, Petr Byvshev, and Yu Xiao. 2020. A video dataset for wooden box assembly. Funded by Business Finland (1660/31/2018) European Union's Horizon 2020 Research and Innovation Programme (grant number: 777222.
[11]
Luowei Zhou, Chenliang Xu, and Jason J Corso. 2018. Towards automatic learning of procedures from web instructional videos. In Proceedings of Thirty-Second AAAI Conference on Artificial Intelligence.
[12]
Dimitri Zhukov, Jean-Baptiste Alayrac, Ramazan Gokberk Cinbis, David Fouhey, Ivan Laptev, and Josef Sivic. 2019. Cross-task weakly supervised learning from instructional videos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3537--3545.
Recommendations
Template-based variant process planning for manned assembly lines
Most major appliances are produced in manned assembly lines consisting of multiple workstations controlled by human labour. Since, human workers are very flexible in adapting to components’ major and minor changes, assembly process planning for manned ...
SyDog-Video: A Synthetic Dog Video Dataset for Temporal Pose Estimation
AbstractWe aim to estimate the pose of dogs from videos using a temporal deep learning model as this can result in more accurate pose predictions when temporary occlusions or substantial movements occur. Generally, deep learning models require a lot of ...
A Real-Virtual Mapping Method for Mechanical Product Assembly Process Planning in Virtual Assembly Environment
VMR '09: Proceedings of the 3rd International Conference on Virtual and Mixed Reality: Held as Part of HCI International 2009In order to realize assembly process planning in virtual reality environment, an assembly process planning generation method based on real-virtual mapping of basic motion sequence is proposed. Based on the analysis of current assembly process content ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2020
42 pages
ISBN:9781450381369
DOI:10.1145/3419016
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
- SIGCOMM: ACM Special Interest Group on Data Communication
- SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
- SIGOPS: ACM Special Interest Group on Operating Systems
- SIGBED: ACM Special Interest Group on Embedded Systems
- SIGARCH: ACM Special Interest Group on Computer Architecture
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 November 2020
Check for updates
Qualifiers
- Research-article
Funding Sources
- Business Finland
Conference
SenSys '20: The 18th ACM Conference on Embedded Networked Sensor Systems
November 16 - 19, 2020
Virtual Event, Japan
Acceptance Rates
Overall Acceptance Rate 74 of 167 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 128Total Downloads
- Downloads (Last 12 months)19
- Downloads (Last 6 weeks)2
Reflects downloads up to 11 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in