More Web Proxy on the site http://driver.im/

short-paper

Building book inventories using smartphones

Authors:

Cheng-Hsin Hsu,

Jatinder Pal SinghAuthors Info & Claims

MM '10: Proceedings of the 18th ACM international conference on Multimedia

Pages 651 - 654

https://doi.org/10.1145/1873951.1874043

Published: 25 October 2010 Publication History

Abstract

Manual generation of a book inventory is time-consuming and tedious, while deployment of barcode and radio-frequency identification (RFID) management systems is costly and affordable only to large institutions. In this paper, we design and implement a mobile book recognition system for conveniently generating an inventory of books by snapping photos of a bookshelf with a smartphone. Since smartphones are becoming ubiquitous and affordable, our inventory management solution is cost-effective and very easy to deploy. Automatic and robust book recognition is achieved in our system using a combination of spine segmentation and bag-of-features image matching. At the same time, the location of each book is inferred from the smartphone's sensor readings, including accelerometer traces, digital compass measurements, and WiFi signatures. This location information is combined with the image recognition results to construct a location-aware book inventory. We demonstrate the effectiveness of our book spine recognition and location estimation techniques in recognition experiments and in an actual mobile book recognition system.

References

[1]

M. Azizyan, I. Constandache, and R. Choudhury. SurroundSense: Mobile phone localization via ambience fingerprinting. In Proc. ACM International Conference on Mobile Computing and Networking (MobiCom'09), pages 261--272, Beijing, China, September 2009.

Digital Library

[2]

P. Bahl and V. Padmanabhan. RADAR: An in-building RF-based user location and tracking system. In Proc. IEEE International Conference on Computer Communications (INFOCOM'00), pages 775--784, Tel Aviv, Israel, March 2000.

[3]

H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool. Speeded-up robust features (SURF). Computer Vision and Image Understanding, 110(3):346--359, 2008.

Digital Library

[4]

J. Canny. A computational approach to edge detection. IEEE Trans. Pattern Analysis and Machine Intelligence, 8(6):679--698, 1986.

Digital Library

[5]

D. Chen, S. Tsai, V. Chandrasekhar, G. Takacs, J. Singh, and B. Girod. Robust image retrieval using multiview scalable vocabulary trees. In Proc. Visual Communications and Image Processing (VCIP'09), page 72570V, San Jose, CA, January 2009.

[6]

D. Crasto, A. Kale, and C. Jaynes. The smart bookshelf: A study of camera projector scene augmentation of an everyday environment. In Proc. IEEE Workshop on Applications of Computer Vision (WACV'05), pages 218--225, Breckenridge, CO, January 2005.

Digital Library

[7]

M. Fischler and R. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381--395, 1981.

Digital Library

[8]

J. Kosecka and W. Zhang. Video compass. In Proc. European Conference on Computer Vision (ECCV'02), pages 476--490, Copenhagen, Denmark, May 2002.

Digital Library

[9]

D. Lee, Y. Chang, J. Archibald, and C. Pitzak. Matching book-spine images for library shelf-reading process automation. In Proc. IEEE International Conference on Automation Science and Engineering (CASE'08), pages 738--743, Arlington, VA, September 2008.

[10]

D. Lowe. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2):91--110, 2004.

Digital Library

[11]

D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR'06), pages 2161--2168, New York, NY, June 2006.

Digital Library

[12]

J. Philbin, M. Isard, J. Sivic, and A. Zisserman. Lost in quantization: Improving particular object retrieval in large scale image databases. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR'08), pages 1--8, Anchorage, AL, June 2008.

[13]

N. Quoc and W. Choi. A framework for recognition books on bookshelves. In Proc. International Conference on Intelligent Computing (ICIC'09), pages 386--395, Ulsan, Korea, September 2009.

Digital Library

[14]

R. Smith. An overview of the Tesseract OCR engine. In Proc. Conference on Document Analysis and Recognition (ICDAR'07), pages 629--633, Parana, Brazil, September 2007.

Digital Library

[15]

S. Tsai, D. Chen, J. Singh, and B. Girod. Rate-efficient, real-time CD cover recognition on a camera-phone. In Proc. ACM Multimedia (MM'08'), pages 1023--1024, Vancouver, BC, Canada, October 2008. Technical Demo.

Digital Library

[16]

Y. Zhao. Standardization of mobile phone positioning for 3G systems. IEEE Communications Magazine, 40(7):108--116, 2002.

Digital Library

Cited By

Ma HWang CLi AXu AHan D(2024)An Accurate Book Spine Detection Network Based on Improved Oriented R-CNNSensors10.3390/s2424799624:24(7996)Online publication date: 14-Dec-2024
https://doi.org/10.3390/s24247996
Jones LNousir AEverrett TNabil S(2023)Libraries of Things: Understanding the Challenges of Sharing Tangible Collections and the Opportunities for HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581094(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581094
Zhou SSun TXia XZhang NHuang BXian GChai X(2022)Library on-shelf book segmentation and recognition based on deep visual featuresInformation Processing and Management: an International Journal10.1016/j.ipm.2022.10310159:6Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.ipm.2022.103101
Show More Cited By

Index Terms

Building book inventories using smartphones
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing

Recommendations

OpenHaystack Mobile - Tracking Custom Find My Accessories on Smartphones
WiSec '22: Proceedings of the 15th ACM Conference on Security and Privacy in Wireless and Mobile Networks

In 2021 OpenHaystack on macOS was the first step into liberating Apple's Find My technology to be integrated into any Bluetooth-capable device. By using custom firmware for microchips like the ESP32, it was possible to build custom trackable accessories ...
Deep Multi-mode Learning for Book Spine Recognition
Web Information Systems and Applications
Abstract
Traditional library book inventory or shelf-reading costs a tremendous human resource to ensure the reading accuracy of books. This paper provides a deep multi-mode learning solution for book spine recognition in the library with higher ...
Face recognition on smartphones via optimised sparse representation classification
IPSN '14: Proceedings of the 13th international symposium on Information processing in sensor networks

Face recognition is an element of many smartphone apps, e.g. face unlocking, people tagging and games. Sparse Representation Classification (SRC) is a state-of-the-art face recognition algorithm, which has been shown to outperform many classical face ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '10: Proceedings of the 18th ACM international conference on Multimedia

October 2010

1836 pages

ISBN:9781605589336

DOI:10.1145/1873951

General Chairs:
Alberto del Bimbo
University of Florence, Italy
,
Shih-Fu Chang
Columbia University, USA
,
Program Chair:
Arnold Smeulders
University of Amsterdam, NL

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '10

Sponsor:

SIGMM

MM '10: ACM Multimedia Conference

October 25 - 29, 2010

Firenze, Italy

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
515
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ma HWang CLi AXu AHan D(2024)An Accurate Book Spine Detection Network Based on Improved Oriented R-CNNSensors10.3390/s2424799624:24(7996)Online publication date: 14-Dec-2024
https://doi.org/10.3390/s24247996
Jones LNousir AEverrett TNabil S(2023)Libraries of Things: Understanding the Challenges of Sharing Tangible Collections and the Opportunities for HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581094(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581094
Zhou SSun TXia XZhang NHuang BXian GChai X(2022)Library on-shelf book segmentation and recognition based on deep visual featuresInformation Processing and Management: an International Journal10.1016/j.ipm.2022.10310159:6Online publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.ipm.2022.103101
Kulkarni SKatebi NValderrama CRohloff PClifford G(2021)CNN-Based LCD Transcription of Blood Pressure From a Mobile Phone CameraFrontiers in Artificial Intelligence10.3389/frai.2021.5431764Online publication date: 21-May-2021
https://doi.org/10.3389/frai.2021.543176
Mitts PDebarba H(2021)On the Use of Handheld Augmented Reality for Inventory Tasks: A Study with Magazine RetailersHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85623-6_33(566-589)Online publication date: 26-Aug-2021
https://doi.org/10.1007/978-3-030-85623-6_33
Fatema KAhmed MArefin M(2021)Developing a System for Automatic Detection of BooksSecond International Conference on Image Processing and Capsule Networks10.1007/978-3-030-84760-9_27(309-321)Online publication date: 10-Sep-2021
https://doi.org/10.1007/978-3-030-84760-9_27
Anegawa RAritsugi M(2019)Text Detection on Books Using CNN Trained with Another Domain Data2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech)10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00041(170-176)Online publication date: Aug-2019
https://doi.org/10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00041
Meetei LSingh TBandyopadhyay S(2019)Extraction and Identification of Manipuri and Mizo Texts from Scene and Document ImagesPattern Recognition and Machine Intelligence10.1007/978-3-030-34869-4_44(405-414)Online publication date: 25-Nov-2019
https://doi.org/10.1007/978-3-030-34869-4_44
Pham HGiordano AMiller LGiannitti JMena MDiNardi A(2018)A Ubiquitous Approach for Automated Library Book Location ManagementProceedings of the 2018 International Conference on Computing and Big Data10.1145/3277104.3277115(78-82)Online publication date: 8-Sep-2018
https://dl.acm.org/doi/10.1145/3277104.3277115
Pham HDvorak APerez M(2018)Recognizing Call Numbers for Library Books: The Problem and Issues2018 International Conference on Computational Science and Computational Intelligence (CSCI)10.1109/CSCI46756.2018.00079(386-391)Online publication date: Dec-2018
https://doi.org/10.1109/CSCI46756.2018.00079
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten