More Web Proxy on the site http://driver.im/

research-article

Highlighting disputed claims on the web

Authors:

Beth Trushkowsky,

John Mark AgostaAuthors Info & Claims

WWW '10: Proceedings of the 19th international conference on World wide web

Pages 341 - 350

https://doi.org/10.1145/1772690.1772726

Published: 26 April 2010 Publication History

Abstract

We describe Dispute Finder, a browser extension that alerts a user when information they read online is disputed by a source that they might trust. Dispute Finder examines the text on the page that the user is browsing and highlights any phrases that resemble known disputed claims. If a user clicks on a highlighted phrase then Dispute Finder shows them a list of articles that support other points of view.

Dispute Finder builds a database of known disputed claims by crawling web sites that already maintain lists of disputed claims, and by allowing users to enter claims that they believe are disputed. Dispute Finder identifies snippets that make known disputed claims by running a simple textual entailment algorithm inside the browser extension, referring to a cached local copy of the claim database.

In this paper, we explain the design of Dispute Finder, and the trade-offs between the various design decisions that we explored.

References

[1]

B Thomas Adler and Ian Pye. Measuring Author Contributions to the Wikipedia aLU. In WikiSym, 2008.

Digital Library

[2]

S. Bayer, J. Burger, L. Ferro, J. Henderson, and A. Yeh. MITREâA Zs Submissions to the EU Pascal RTE Challenge. In PASCAL Challenge Workshop on Recognizing Textual Entailment. Citeseer, 2005.

[3]

R Bhagat, E Hovy, and S Patwardhan. Acquiring paraphrases from text corpora. In K-CAP, 2009.

Digital Library

[4]

Eric A Bier, Edward W Ishak, and Ed Chi. Entity Workspace: an evidence file that aids memory, inference, and reading. In Intelligence and Security Informatics, 2006.

Digital Library

[5]

Johan Bos and Katja Markert. Recognising textual entailment with logical inference. In Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05, Morristown, NJ, USA, 2005. Association for Computational Linguistics.

Digital Library

[6]

Niels Olof Bouvin. Augmenting the Web through Open Hypermedia. Phd Thesis, University of Aarhus, 2000.

[7]

Jeff Conklin and Michael L Begeman. gIBIS: A Hypertext Tool for Team Design Deliberation. In Hypertext, 1987.

Digital Library

[8]

R. De Salvo Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. An inference model for semantic entailment in natural language. In Artifical Intelligence, volume 20. Springer, 2005.

Digital Library

[9]

Nicholas Diakopoulos and Irfan Essa. An Annotation Model for Making Sense of Information Quality in Online Video. In Pragmatic Web, 2008.

Digital Library

[10]

Georgiana Dinu and Rui Wang. Inference Rules and their Application to Recognizing Textual Entailment. Computational Linguistics, pages 211--219, 2009.

Digital Library

[11]

Oren Etzioni, Michele Banko, Stephen Soderland, and Daniel S Weld. Open information Extraction from the Web. Communications of the ACM, 51, 2008.

Digital Library

[12]

B J Fogg, Cathy Soohoo, David R Danielson, Leslie Marable, Julianne Stanford, and Ellen R Tauber. How Do Users Evaluate the Credibility of Web Sites? A Study with Over 2,500 Participants. In CHI, 2003.

Digital Library

[13]

Y. Gil and V. Ratnakar. TRELLIS: An interactive tool for capturing information analysis and decision making. In Knowledge Engineering and Knowledge Management. Springer, 2002.

Digital Library

[14]

Yolanda Gil and Donovan Artz. Towards Content Trust of Web Resources. In WWW, pages 565--574, 2006.

Digital Library

[15]

O. Glickman, I. Dagan, and M. Koppel. A probabilistic classification approach for lexical textual entailment. In Artifical Intelligence, volume 20. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2005.

Digital Library

[16]

Scott A Golder and Bernardo A Huberman. The Structure of Collaborative Tagging Systems. Journal of Information Science, 2006.

Digital Library

[17]

Thomas F Gordon and Nikos Karacapilidis. The Zeno Argumentation Framework. In Artificial Intelligence and Law, 1997.

Digital Library

[18]

Marti a. Hearst. Automatic acquisition of hyponyms from large text corpora. In Computational linguistics, Morristown, NJ, USA, 1992. Association for Computational Linguistics.

Digital Library

[19]

Edward S Herman and Noam Chomsky. Manufacturing Consent: The Political Economy of the Mass Media. Pantheon, 2002.

[20]

L. Hong and E.H. Chi. Annotate once, appear anywhere: collective foraging for snippets of interest using paragraph fingerprinting. In CHI. ACM New York, NY, USA, 2009.

Digital Library

[21]

Severin Isenmann and Wolf D Reuter. IBIS - a Convincing Concept . . . But a Lousy Instrument? In Designing Interactive Systems (DIS), 1997.

Digital Library

[22]

Valentin Jijkoun and Maarten De Rijke. Recognizing Textual Entailment: Is Word Similarity Enough? In Machine Learning Challenges, 2006.

[23]

Jose Kahan and Marja-Ritta Koivunen. Annotea: an open RDF infrastructure for shared Web annotations. In WWW, volume 39, 2002.

Digital Library

[24]

Jong Wook Kim. Ef cient Overlap and Content Reuse Detection in Blogs and Online News Articles. In WWW, 2009.

Digital Library

[25]

Aniket Kittur and Robert E Kraut. Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination. CSCW, pages 37--46, 2008.

Digital Library

[26]

Okan Kolak and Bill N Schilit. Generating Links by Mining Quotations. In Hypertext, 2008.

Digital Library

[27]

Jure Lescovec, Lars Backstrom, and Jon Kleinberg. Meme-tracking and the Dynamics of the News Cycle. In Knowledge Discovery and Data Mining (KDD), 2009.

Digital Library

[28]

Dekang Lin and Patrick Pantel. DIRT âAS Discovery of Inference Rules from Text. In Knowledge Discovery and Data Mining (KDD), 2001.

Digital Library

[29]

Farhad Manjou. True Enough: Learning to Live in a Post-Fact Society. Wiley, 2008.

[30]

Cameron Marlow, Mor Naaman, Danah Boyd, and Marc Davis. HT06, Tagging Paper, Taxonomy, Flickr, Academic Article, To Read. In Hypertext, 2006.

Digital Library

[31]

Dan R Olsen, Trent Taufer, and Jerry Alan Fails. ScreenCrayons: Annotating Anything. In User Interface Software and Technology, volume 6, 2004.

Digital Library

[32]

Souneil Park, Seungwoo Kang, Sangyoung Chung, and Junehwa Song. NewsCube: Delivering Multiple Aspects of News to Mitigate Media Bias. In CHI. Information Today, 2009.

Digital Library

[33]

Pew Research. The Pew Research Center Biennial News Consumption Survey, 2008.

[34]

Alan Ritter, Doug Downey, Stephen Soderland, and Oren Etzioni. ItâAZs a ContradictionâATNo, itâAZs Not: A Case Study using Functional Relations. In Empirical Methods in Natural Language Processing, 2008.

Digital Library

[35]

Albert Selvin, Simon Buckingham Shum, Maarten Sierhuis, Jeff Conklin, Beatrix Zimmermann, Charles Palus, Wilfred Drath, and David Horth. Compendium: Making Meetings into Knowledge Events. In Knowledge Technologies, 2001.

[36]

Bertrand Sereno, Simon Buckingham, and Enrico Motta. Semi-Automatic Annotation of Contested Knowledge on the World Wide Web. WWW, 2004.

Digital Library

[37]

Bertrand Sereno, Buckingham Shum, and Enrico Motta. ClaimSpotter: an Environment to Support Sensemaking with Knowledge Triples. In Intelligent User Interfaces (IUI), 2005.

Digital Library

[38]

Simon Buckingham Shum. Cohere: Towards Web 2.0 Argumentation. In Computational Models of Argument (COMMA), volume 44, 2008.

Digital Library

[39]

Rion Snow, Lucy Vanderwende, and Arul Menezes. Effectively using syntax for recognizing false entailment. In Human Language Technology, Morristown, NJ, USA, 2006. Association for Computational Linguistics.

Digital Library

[40]

M. Theobald, J. Siddharth, and A. Paepcke. Spotsigs: robust and efficient near duplicate detection in large web collections. In SIGIR. ACM, 2008.

Digital Library

[41]

Uffe Kock Wiil and John J Leggett. The HyperDisco Approach to Open Hypermedia Systems. In Hypertext, 1996.

Digital Library

Cited By

Hartwig KDoell FReuter C(2024)The Landscape of User-centered Misinformation Interventions - A Systematic Literature ReviewACM Computing Surveys10.1145/367472456:11(1-36)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3674724
Zavolokina LSprenkamp KKatashinskaya ZJones DSchwabe G(2024)Think Fast, Think Slow, Think Critical: Designing an Automated Propaganda Detection ToolProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642805(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642805
Jahanbakhsh FKarger D(2024)A Browser Extension for in-place Signaling and Assessment of MisinformationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642473(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642473
Show More Cited By

Index Terms

Highlighting disputed claims on the web
1. Applied computing
  1. Operations research
    1. Decision analysis
2. Information systems
  1. Information systems applications
    1. Decision support systems

Recommendations

What is disputed on the web?
WICOW '10: Proceedings of the 4th workshop on Information credibility

We present a method for automatically acquiring of a corpus of disputed claims from the web. We consider a factual claim to be disputed if a page on the web suggests both that the claim is false and also that other people say it is true.

Our tool ...
What warrants our claims? A methodological evaluation of argument structure
Abstract
The process of justifying a generalized theoretical conclusion from a specific empirical analysis continues to elude us. In this article, we suggest that this stems from an incomplete understanding and specification of how arguments are ...
Modelling Judicial Context in Argumentation Frameworks
Proceedings of the 2008 conference on Computational Models of Argument: Proceedings of COMMA 2008

Much work using argumentation frameworks treats arguments as entirely abstract, related by a uniform attack relation which always succeeds unless the attacker can itself be defeated. However, this does not seem adequate for legal argumentation. Some ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

WWW '10: Proceedings of the 19th international conference on World wide web

April 2010

1407 pages

ISBN:9781605587998

DOI:10.1145/1772690

General Chairs:
Michael Rappa
North Carolina State University, USA
,
Paul Jones
University of North Carolina at Chapel Hill, USA
,
Program Chairs:
Juliana Freire
University of Utah, USA
,
Soumen Chakrabarti
Indian Institute of Technology, India

Copyright © 2010 International World Wide Web Conference Committee (IW3C2).

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WWW '10

WWW '10: The 19th International World Wide Web Conference

April 26 - 30, 2010

North Carolina, Raleigh, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

82
Total Citations
View Citations
756
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hartwig KDoell FReuter C(2024)The Landscape of User-centered Misinformation Interventions - A Systematic Literature ReviewACM Computing Surveys10.1145/367472456:11(1-36)Online publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1145/3674724
Zavolokina LSprenkamp KKatashinskaya ZJones DSchwabe G(2024)Think Fast, Think Slow, Think Critical: Designing an Automated Propaganda Detection ToolProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642805(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642805
Jahanbakhsh FKarger D(2024)A Browser Extension for in-place Signaling and Assessment of MisinformationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642473(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642473
Nishimura RMiyabe Hirabayashi MYoshino T(2022)Baseless-Rumor Alert Bot to Promote Reliability of InformationJournal of Information Processing10.2197/ipsjjip.30.230(2-14)Online publication date: 2022
https://doi.org/10.2197/ipsjjip.30.2
Suzuki MYamamoto Y(2022)Don’t Judge by Looks: Search User Interface to Make Searchers Reflect on Their Relevance Criteria and Promote Content-Quality-Oriented Web SearchesProceedings of the 2022 ACM Conference on Information Technology for Social Good10.1145/3524458.3547222(1-8)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3524458.3547222
Lee SAfroz SPark HWang ZShaikh OSehgal VPeshin AChau D(2022)MisVis: Explaining Web Misinformation Connections via Visual SummaryExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519711(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519711
Lee SAfroz SPark HWang ZShaikh OSehgal VPeshin AChau D(2022)Explaining Website Reliability by Visualizing Hyperlink Connectivity2022 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS54862.2022.00014(26-30)Online publication date: Oct-2022
https://doi.org/10.1109/VIS54862.2022.00014
Kharrat AHlaoua LBen Romdhane L(2022)Contradiction Detection Approach Based on Semantic Relations and Evidence of UncertaintyComputational Collective Intelligence10.1007/978-3-031-16014-1_19(232-245)Online publication date: 28-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-16014-1_19
Goel A(2021)Looking back, looking aheadAI Magazine10.1609/aaai.1202642:4(83-85)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1609/aaai.12026
Langley P(2021)Agents of exploration and discoveryAI Magazine10.1609/aaai.1202142:4(72-82)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1609/aaai.12021
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

EPUB

View this article in ePub.

Media

Figures

Other

Tables

View Table of Contents