demonstration

Autonomous Inventory Monitoring through Multi-Modal Sensing (AIM3S) for Cashier-Less Stores

Authors:

Pei ZhangAuthors Info & Claims

BuildSys '19: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

Pages 395 - 396

https://doi.org/10.1145/3360322.3361018

Published: 13 November 2019 Publication History

Get Access

Abstract

Auto-checkout technology could revolutionize physical retail by bringing down operating costs and enabling automated stores. The first step towards fully autonomous stores is automated live inventory monitoring. Existing automated approaches tend to focus on vision only and are cost prohibitive, slow, or inaccurate for practical real-world applications. To overcome these challenges we propose a novel sensor fusion framework through cameras, weight sensors and prior knowledge of item arrangement. Namely we focus on the tasks of event detection (i.e. when did customers pick up or return an item?), and robust item classification (i.e. what product was it?). In this demo we show the system can be implemented to accurately predict inventory in real-time.

References

[1]

Amazon. 2019. Amazon.com: Amazon Go. https://www.amazon.com/b?node=16008589011 Accessed: 2019-08-29.

Google Scholar

[2]

Adrian Beck. 2011. Self-scan checkouts and retail loss: Understanding the risk and minimising the threat. Security Journal 24, 3 (2011), 199--215.

Crossref

Google Scholar

[3]

eft Supply Chain & Logistics Business Intelligence. 2018. The Last Mile Retail Study. https://img03.en25.com/Web/FCBusinessIntelligenceLtd/%7B2aee9e05-4e7b-4270-b271-cd403ab94d17%7D_4914-EFT0118_TheLastMileRetailStudy_V16.pdf Accessed: 2019-08-29.

Google Scholar

[4]

Rena Kamoda, Mayumi Ueda, Takuya Funatomi, Masaaki Iiyama, and Michihiko Minoh. 2012. Grocery re-identification using load balance feature on the shelf for monitoring grocery inventory. In Computers workshop (CwC). Citeseer, 13.

Google Scholar

[5]

Recode. 2019. Amazon's store of the future has no cashiers, but humans are watching from behind the scenes. https://www.recode.net/2017/1/6/14189880/amazon-go-convenience-store-computer-vision-humans Accessed: 2019-08-29.

Google Scholar

[6]

Yacine Rekik, Evren Sahin, and Yves Dallery. 2008. Analysis of the impact of the RFID technology on reducing product misplacement errors at retail stores. International Journal of Production Economics 112, 1 (2008), 264--278.

Crossref

Google Scholar

[7]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems. 91--99.

Google Scholar

[8]

George Roussos. 2006. Enabling RFID in retail. Computer 39, 3 (2006), 25--30.

Digital Library

Google Scholar

[9]

Carlos Ruiz, Joao Falcao, Shijia Pan, Hae Young Noh, and Pei Zhang. 2019. AIM3S: Autonomous Inventory Monitoring through Multi-Modal Sensing for Cashier-Less Convenience Stores. In Proceedings of the 6th Conference on Systems for Built Environments. ACM.

Digital Library

Google Scholar

[10]

Albrecht Schmidt, Martin Strohbach, Kristof Van Laerhoven, Adrian Friday, and Hans-Werner Gellersen. 2002. Context acquisition based on load sensing. In International Conference on Ubiquitous Computing. Springer, 333--350.

Digital Library

Google Scholar

[11]

TechCrunch. 2019. Inside Amazon's surveillance-powered, no-checkout convenience store. https://techcrunch.com/2018/01/21/inside-amazons-surveillance-powered-no-checkout-convenience-store/ Accessed: 2019-08-29.

Google Scholar

Cited By

View all

Zhang JPati SCodling JBannis ARuiz CNoh HZhang P(2023)Poster Abstract: Vibration-Based Object Classification with Structural Response of Ambient MusicProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3589825(314-315)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3589825
Zhang YFang SRuiz CHu ZRohal SPan S(2023)Augmenting Vibration-Based Customer-Product Interaction Recognition with Sparse Load SensingProceedings of Cyber-Physical Systems and Internet of Things Week 202310.1145/3576914.3589560(266-271)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3576914.3589560
Zhang YRuiz CRohal SPan S(2023)Single-Point Vibration Sensing for Product Pickup/Put-Down Detection in Autonomous RetailsProceedings of the 24th International Workshop on Mobile Computing Systems and Applications10.1145/3572864.3581583(136-136)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1145/3572864.3581583
Show More Cited By

Recommendations

AIM3S: Autonomous Inventory Monitoring through Multi-Modal Sensing for Cashier-Less Convenience Stores
BuildSys '19: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

A common pain point for physical retail stores is live inventory monitoring, i.e. knowing how many items of each product are left on the shelves. About 4% of sales are lost due to an average 5-10% out-of-shelf stockout rate, while additional supplies ...
A Deterministic Multiproduct, Multi-Facility Production and Inventory Model

A deterministic multiproduct, multifacility, multiperiod production planning model is analyzed. The model considers concave production costs, which can depend upon the production in several different facilities, and piecewise concave inventory costs. ...
On the optimality of multi item integrated production inventory systems
ASMCSS'09: Proceedings of the 3rd International Conference on Applied Mathematics, Simulation, Modelling, Circuits, Systems and Signals

In some industrial systems like petrochemicals, the same raw materials are used in producing several products. However, most of the classical production inventory systems treat the economic order quantities (EOQ) of raw materials, which are used in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

BuildSys '19: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

November 2019

413 pages

ISBN:9781450370059

DOI:10.1145/3360322

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2019

Check for updates

Qualifiers

Demonstration
Research
Refereed limited

Conference

BuildSys '19

Sponsor:

SIGEnergy

BuildSys '19: The 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

November 13 - 14, 2019

NY, New York, USA

Acceptance Rates

BuildSys '19 Paper Acceptance Rate 40 of 131 submissions, 31%;

Overall Acceptance Rate 148 of 500 submissions, 30%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
444
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang JPati SCodling JBannis ARuiz CNoh HZhang P(2023)Poster Abstract: Vibration-Based Object Classification with Structural Response of Ambient MusicProceedings of the 22nd International Conference on Information Processing in Sensor Networks10.1145/3583120.3589825(314-315)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3583120.3589825
Zhang YFang SRuiz CHu ZRohal SPan S(2023)Augmenting Vibration-Based Customer-Product Interaction Recognition with Sparse Load SensingProceedings of Cyber-Physical Systems and Internet of Things Week 202310.1145/3576914.3589560(266-271)Online publication date: 9-May-2023
https://dl.acm.org/doi/10.1145/3576914.3589560
Zhang YRuiz CRohal SPan S(2023)Single-Point Vibration Sensing for Product Pickup/Put-Down Detection in Autonomous RetailsProceedings of the 24th International Workshop on Mobile Computing Systems and Applications10.1145/3572864.3581583(136-136)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1145/3572864.3581583
Zhang YRuiz CRohal SPan S(2023)CPAProceedings of the 24th International Workshop on Mobile Computing Systems and Applications10.1145/3572864.3580328(8-14)Online publication date: 22-Feb-2023
https://dl.acm.org/doi/10.1145/3572864.3580328
Lin RTiwari AOyekan J(2022)Counting assistant through multi-sensor fusion for inventory monitoring2022 27th International Conference on Automation and Computing (ICAC)10.1109/ICAC55051.2022.9911172(1-6)Online publication date: 1-Sep-2022
https://doi.org/10.1109/ICAC55051.2022.9911172
Falcão JRuiz CBannis ANoh HZhang P(2021)ISACSProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34780865:3(1-26)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3478086
Alhassoun NUddin MVenkatasubramanian N(2020)Multi-Network Provisioning for Perpetual Operations in IoT-Enabled Smart Spaces2020 IEEE International Conference on Smart Computing (SMARTCOMP)10.1109/SMARTCOMP50058.2020.00032(89-97)Online publication date: Sep-2020
https://doi.org/10.1109/SMARTCOMP50058.2020.00032

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

AIM3S: Autonomous Inventory Monitoring through Multi-Modal Sensing for Cashier-Less Convenience Stores

A Deterministic Multiproduct, Multi-Facility Production and Inventory Model

On the optimality of multi item integrated production inventory systems