More Web Proxy on the site http://driver.im/

abstract

Newspaper Navigator: Open Faceted Search for 1.5 Million Images

Authors:

Benjamin C.G. Lee,

Daniel S. WeldAuthors Info & Claims

UIST '20 Adjunct: Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Pages 120 - 122

https://doi.org/10.1145/3379350.3416143

Published: 20 October 2020 Publication History

Abstract

Despite the marked improvements in image classification and recognition tasks over the past decade, affordances and interfaces for searching images have remained largely unchanged on the web. In this demo, we present Newspaper Navigator, an open faceted search system for 1.5 million historic newspaper photographs. In contrast to standard faceted search, which requires facets to be pre-selected and applied to images, Newspaper Navigator empowers users to specify their own facets in an open-domain fashion during the search process by selecting relevant examples and iteratively training a machine learner. With Newspaper Navigator, users can quickly sort 1.5 million images according to dynamically-specified facets such as "baseball player'' and "oval-shaped portrait.'' Newspaper Navigator also drives facet exploration by suggesting related keyword search queries for a user to perform. Our demo walks through examples of searching with Newspaper Navigator and highlights the facet learning and exploration affordances.

Supplementary Material

VTT File (3379350.3416143.vtt)

Download
7.52 KB

MP4 File (3379350.3416143.mp4)

Presentation Video

Download
43.56 MB

References

[1]

Saleema Amershi, Maya Cakmak, William Bradley Knox, and Todd Kulesza. 2014. Power to the People: The Role of Humans in Interactive Machine Learning. AI Magazine 35, 4 (Dec. 2014), 105--120.

Digital Library

[2]

Saleema Amershi, James Fogarty, Ashish Kapoor, and Desney Tan. 2009. Overview Based Example Selection in End User Interactive Concept Learning. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). Association for Computing Machinery, New York, NY, USA, 247--256.

Digital Library

[3]

Saleema Amershi, James Fogarty, Ashish Kapoor, and Desney Tan. 2010. Examining Multiple Potential Models in End-User Interactive Concept Learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 1357--1360.

Digital Library

[4]

Saleema Amershi, James Fogarty, Ashish Kapoor, and Desney Tan. 2011. Effective End-User Interaction with Machine Learning. In Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence (AAAI'11). AAAI Press, 1529--1532.

Digital Library

[5]

Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13.

Digital Library

[6]

Joseph Chee Chang, Nathan Hahn, Adam Perer, and Aniket Kittur. 2019. SearchLens: Composing and Capturing Complex User Interests for Exploratory Search. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 498--509.

Digital Library

[7]

Jennifer English, Marti Hearst, Rashmi Sinha, Kirsten Swearingen, and Ka-Ping Yee. 2002. Hierarchical Faceted Metadata in Site Search Interfaces. In CHI '02 Extended Abstracts on Human Factors in Computing Systems (CHI EA '02). Association for Computing Machinery, New York, NY, USA, 628--639.

Digital Library

[8]

James Fogarty, Desney Tan, Ashish Kapoor, and Simon Winder. 2008. CueFlik: Interactive Concept Learning in Image Search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 29--38.

Digital Library

[9]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Deep Residual Learning for Image Recognition. arXiv preprint arXiv:1512.03385 (2015).

[10]

Marti A. Hearst. 2009. Search User Interfaces (1st ed.). Cambridge University Press, USA.

Digital Library

[11]

Joemon M. Jose, Jonathan Furner, and David J. Harper. 1998. Spatial Querying for Image Retrieval: A User-Oriented Evaluation. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98). Association for Computing Machinery, New York, NY, USA, 232--240.

Digital Library

[12]

Benjamin Charles Germain Lee, Jaime Mears, Eileen Jakeway, Meghan Ferriter, Chris Adams, Nathan Yarasavage, Deborah Thomas, Kate Zwaard, and Daniel S. Weld. 2020. The Newspaper Navigator Dataset: Extracting And Analyzing Visual Content from 16 Million Historic Newspaper Pages in Chronicling America. (2020).

[13]

Marjo Markkula and Eero Sormunen. 2000. End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive. Information Retrieval 1, 4 (Jan. 2000), 259--285.

Digital Library

[14]

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.

Digital Library

[15]

Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. GloVe: Global Vectors for Word Representation. In Empirical Methods in Natural Language Processing (EMNLP). 1532--1543. http://www.aclweb.org/anthology/D14--1162

[16]

Ka-Ping Yee, Kirsten Swearingen, Kevin Li, and Marti Hearst. 2003. Faceted Metadata for Image Search and Browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). Association for Computing Machinery, New York, NY, USA, 401--408.

Digital Library

Cited By

Lee B(2023) The “Collections as ML Data” checklist for machine learning and cultural heritage Journal of the Association for Information Science and Technology10.1002/asi.24765Online publication date: 2-May-2023
https://doi.org/10.1002/asi.24765
Lee BOwens T(2022)Grappling with the scale of born-digital government publications: Toward pipelines for processing and searching millions of PDFsInternational Journal of Digital Humanities10.1007/s42803-022-00042-x3:1-3(91-114)Online publication date: 17-Jan-2022
https://doi.org/10.1007/s42803-022-00042-x
Mahdi MAhmad ANatiq HSubhi MQassim Q(2021)Comprehensive Review and Future Research Directions on Dynamic Faceted SearchApplied Sciences10.3390/app1117811311:17(8113)Online publication date: 31-Aug-2021
https://doi.org/10.3390/app11178113
Show More Cited By

Index Terms

Newspaper Navigator: Open Faceted Search for 1.5 Million Images
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design
2. Information systems
  1. Information systems applications
    1. Digital libraries and archives

Recommendations

Extending Faceted Search to the Open-Domain Web

Faceted search enables users to navigate a multi-dimensional information space by combining keyword search with drill-down options in each facets. For example, when searching "computer monitor" in an e-commerce site, users can select brands and monitor ...
What do exploratory searchers look at in a faceted search interface?
JCDL '09: Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries

This study examined how searchers interacted with a web-based, faceted library catalog when conducting exploratory searches. It applied eye tracking, stimulated recall interviews, and direct observation to investigate important aspects of gaze behavior ...
Dynamic Personalized Ranking of Facets for Exploratory Search
SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

Faceted Search Systems (FSS) have gained prominence in research as one of the exploratory search approaches that support complex search tasks. They provide facets to educate users about the information space and allow them to refine their search query ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '20 Adjunct: Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

October 2020

203 pages

ISBN:9781450375153

DOI:10.1145/3379350

General Chairs:
Shamsi Iqbal
Microsoft Research, USA
,
Karon MacLean
University of British Columbia, Canada
,
Program Chairs:
Fanny Chevalier
University of Toronto, Canada
,
Stefanie Mueller
MIT CSAIL, USA

Copyright © 2020 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2020

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

National Science Foundation

Conference

UIST '20

Sponsor:

UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology

October 20 - 23, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)4

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lee B(2023) The “Collections as ML Data” checklist for machine learning and cultural heritage Journal of the Association for Information Science and Technology10.1002/asi.24765Online publication date: 2-May-2023
https://doi.org/10.1002/asi.24765
Lee BOwens T(2022)Grappling with the scale of born-digital government publications: Toward pipelines for processing and searching millions of PDFsInternational Journal of Digital Humanities10.1007/s42803-022-00042-x3:1-3(91-114)Online publication date: 17-Jan-2022
https://doi.org/10.1007/s42803-022-00042-x
Mahdi MAhmad ANatiq HSubhi MQassim Q(2021)Comprehensive Review and Future Research Directions on Dynamic Faceted SearchApplied Sciences10.3390/app1117811311:17(8113)Online publication date: 31-Aug-2021
https://doi.org/10.3390/app11178113
Qu JArguello JWang YDemartini GZuccon GCulpepper JHuang ZTong H(2021)A Study of Explainability Features to Scrutinize Faceted Filtering ResultsProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482409(1498-1507)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3459637.3482409

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents