More Web Proxy on the site http://driver.im/

research-article

Accessible image search for colorblindness

Authors:

Xian-Sheng HuaAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 1, Issue 1

Article No.: 8, Pages 1 - 26

https://doi.org/10.1145/1858948.1858956

Published: 22 October 2010 Publication History

Abstract

This article introduces an intelligent system that accommodates colorblind users in image search. Color plays an important role in the human perception and recognition of images. However, there are about 8% of men and 0.8% of women suffering from colorblindness. We show that the existing image search techniques cannot provide satisfactory results for these users since many images will not be well perceived by them due to the loss of color information. To deal with this difficulty, we introduce a system named Accessible Image Search (AIS) to accommodate these users. Different from the general image search scheme that aims at returning more relevant results, AIS further takes into account the colorblind accessibilities of the returned results, that is, the image qualities in the eyes of colorblind users. The system contains three components: accessibility assessment, accessibility improvement, and color indication. The accessibility assessment component measures the accessibility scores of images, and consequently different reranking methods can be performed to prioritize images with high accessibilities. In the accessibility improvement component, we propose an efficient recoloring algorithm to modify the colors of the images such that they can be better perceived by colorblind users. Color indication aims to indicate the name of the interesting color in an image. We evaluate the introduced system with more than 60 queries and 20 anonymous colorblind users, and the empirical results demonstrate its effectiveness and usefulness.

References

[1]

Andronico, P., Buzzi, M., Castillo, C., and Leporini, B. 2006. Improving search engine interfaces for blind users: a case study. Int. J. Universal Access Inform. Soc. 5, 1.

Digital Library

[2]

Arrue, M. and Vigo, M. 2007. Considering web accessibility in information retrieval systems. In Proceedings of the International Conference on Web Engineering.

Digital Library

[3]

Azzopardi, L., Glassey, R., Lalmas, M., Polajnar, T., and Ruthven, I. 2009. Puppyir: Designing an open source framework for interactive information services for children. In Proceedings of the Annual Workshop on Human-Computer Interaction and Information Retrieval.

[4]

Brettel, H., Vienot, F., and Mollon, J. 1997. Computerized simulation of color appearance for dichromats. J. Optical Soc. Amer. 14, 10.

[5]

CIE 1995. Industrial colour-difference evaluation. Tech rep. CIE 116-1995.

[6]

Evans, R. M. 1948. An Introduction to Color. Wiley.

[7]

Fajardo, I., Canas, J. J., Salmeron, L., and Abascal, J. 2006. Improving deaf users accessibility in hyptertext information retrieval: are graphical interfaces useful for them&quest; Behavior Inform. Technol. 26, 6.

[8]

Hess, R. B. 1996. Colors by name. MSDN Online Web Workshop.

[9]

Hua, M., Pei, J., Fu, A., Lin, X., and Leung, H. F. 2007. Efficiently answering top-k typicality queries on large databases. In Proceedings of the International Conference on Very Large Databases.

Digital Library

[10]

Huang, J. B., Tseng, Y. C., Wu, S. I., and Wang, S. J. 2007. Information preserving color transformation for protanopia and deuteranopia. IEEE Signal Process. Lett. 14, 10.

[11]

Huang, J. B., Wu, S. Y., and Chen, C. S. 2008. Enhancing color representation for the color vision impaired. In Proceedings of the ECCV Workshop on Computer Vision Applications for the Visually Impaired.

[12]

Iaccarino, G., Malandrino, D., Percio, M. D., and Scarano, V. 2006. Efficient edge-services for colorblind users. In Proceedings of the International World Wide Web Conference.

Digital Library

[13]

Jarvelin and Kekalainen, J. 2002. Cumulated gain-based evaluation of ir techniques. ACM Trans. Inform. Syst. 20, 4.

Digital Library

[14]

Jefferson, L. and Harvey, R. 2006. Accommodating color blind computer users. In Proceedings of the ACM Conference on Computers and Accessibility.

Digital Library

[15]

Jefferson, L. and Harvey, R. 2007. An interface to support color blind computer users. In Proceedings of SIGCHI.

Digital Library

[16]

Jing, Y. and Baluja, S. 2008a. Pagerank for product image search. In Proceedings of the International World Wide Web Conference.

Digital Library

[17]

Jing, Y. and Baluja, S. 2008b. Pagerank for product image search. In Proceedings of the International World Wide Web Conference.

Digital Library

[18]

Kovalev, V. A. 2004. Towards image retrieval for eight percent of color-blind men. In Proceedings of the International Conference on Image Processing.

[19]

Lew, M. S., Sebe, N., Djeraba, C., and Jain, R. 2006. Content-based multimedia information retrieval: state of the art and challenges. ACM Trans. Multimedia Comput. Comm. Appl.

Digital Library

[20]

Moreno, L., Martinez, P., and Ruiz-Mezcua, B. 2008. Disability standards for multimedia on the web. IEEE Multimedia 15, 4.

Digital Library

[21]

Pappas, T. N. and Safranek, R. J. 2000. Perceptual Criteria for Image Quality Evaluation, Handbook of Image and Video Processing. Academic Press.

[22]

Rasche, K., Geist, R., and Westall, J. 2005. Re-coloring images for gamuts of lower dimension. In Proceedings of Eurographics.

[23]

Smeulders, A. W., Worring, M., Santini, S., Gupta, A., and Jain, R. 2000. Content based image retrieval at the end of the early years. IEEE Trans. Patt. Anal. Mach. Intell. 22, 12.

Digital Library

[24]

Vapnik, V. 1995. The Nature of Statistical Learning Theory. Springer.

Digital Library

[25]

Wakita, K. and Shimamura, K. 2005. Smart color: disambiguation framework for the colorblind. In Proceedings of the ACM Conference on Computers and Accessibility.

Digital Library

[26]

Wandell, B. A. 1995. Foundations of Vision. Sinauer Associates.

[27]

Wang, M., Liu, B., and Hua, X. S. 2009. Accessible image search. In Proceedings of ACM Multimedia Conference.

Digital Library

[28]

Wang, Z. and Bovik, A. C. 2006. Modern Image Quality Assessment. Morgan & Claypool Publishers.

[29]

Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: from effort visibility to structural similarity. IEEE Trans. Image Process. 13, 4.

Digital Library

[30]

Winkler, S. 1999. Issues in vision modeling for perceptual video quality assessment. Signal Process. 78.

Digital Library

[31]

Yang, S. and Ro, Y. M. 2003. Visual content adaptation for color vision deficiency. In Proceedings of the International Conference on Image Processing.

[32]

Yang, S., Ro, Y. M., Wong, E. K., and Lee, J. H. 2008a. Quantification and standardized description of color vision deficiency caused by anomalous trichromats-part i: simulation and measurement. EURASIP J. Image Video Process. 1.

Digital Library

[33]

Yang, S., Ro, Y. M., Wong, E. K., and Lee, J. H. 2008b. Quantification and standardized description of color vision deficiency caused by anomalous trichromats-part ii: modeling and color compensation. EURASIP J. Image Video Process. 1.

Digital Library

[34]

Zhou, Z. H. and Dai, H. B. 2007. Exploring image contents in web search. In Proceedings of the International Conference on Artificial Intelligence.

Digital Library

Cited By

Sarraf SKushwaha AKar ADwivedi YGiannakis M(2024)How did online misinformation impact stockouts in the e-commerce supply chain during COVID-19 – A mixed methods studyInternational Journal of Production Economics10.1016/j.ijpe.2023.109064267(109064)Online publication date: Jan-2024
https://doi.org/10.1016/j.ijpe.2023.109064
Liu ZZhang CWu MWang S(2021)Auxiliary Glasses Designed for Visually Impaired People with Color Blindness and Regional Visual Impairments2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)10.1109/IC-NIDC54101.2021.9660527(274-278)Online publication date: 17-Nov-2021
https://doi.org/10.1109/IC-NIDC54101.2021.9660527
Zhu ZMao X(2021)Image recoloring for color vision deficiency compensation: a surveyThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02240-037:12(2999-3018)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1007/s00371-021-02240-0
Show More Cited By

Index Terms

Accessible image search for colorblindness
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
2. Social and professional topics
  1. Professional topics
    1. Computing profession
      1. Assistive technologies
  2. User characteristics
    1. People with disabilities

Recommendations

Accessible image search
MM '09: Proceedings of the 17th ACM international conference on Multimedia

There are about 8% of men and 0.8% of women suffering from colorblindness. We show that the existing image search techniques cannot provide satisfactory results for these users, since many images will not be well perceived by them due to the loss of ...
Accommodating colorblind users in image search
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval

There are about 8% of men and 0.8% of women suffering from colorblindness. Due to certain loss of color information, the existing image search techniques may not provide satisfactory results for these users. In this demonstration, we show an image ...
Interactive Image Search by Color Map

The availability of large-scale images from the Internet has made the research on image search attract a lot of attention. Text-based image search engines, for example, Google/Microsoft Bing/Yahoo! image search engines using the surrounding text, have ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 1, Issue 1

October 2010

117 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/1858948

Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2010

Accepted: 01 May 2010

Revised: 01 March 2010

Received: 01 January 2010

Published in TIST Volume 1, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
834
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sarraf SKushwaha AKar ADwivedi YGiannakis M(2024)How did online misinformation impact stockouts in the e-commerce supply chain during COVID-19 – A mixed methods studyInternational Journal of Production Economics10.1016/j.ijpe.2023.109064267(109064)Online publication date: Jan-2024
https://doi.org/10.1016/j.ijpe.2023.109064
Liu ZZhang CWu MWang S(2021)Auxiliary Glasses Designed for Visually Impaired People with Color Blindness and Regional Visual Impairments2021 7th IEEE International Conference on Network Intelligence and Digital Content (IC-NIDC)10.1109/IC-NIDC54101.2021.9660527(274-278)Online publication date: 17-Nov-2021
https://doi.org/10.1109/IC-NIDC54101.2021.9660527
Zhu ZMao X(2021)Image recoloring for color vision deficiency compensation: a surveyThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-021-02240-037:12(2999-3018)Online publication date: 1-Dec-2021
https://dl.acm.org/doi/10.1007/s00371-021-02240-0
Ribeiro MGomes A(2019)Recoloring Algorithms for Colorblind PeopleACM Computing Surveys10.1145/332911852:4(1-37)Online publication date: 30-Aug-2019
https://dl.acm.org/doi/10.1145/3329118
Pavai GGeetha T(2017)Improving the freshness of the search engines by a probabilistic approach based incremental crawlerInformation Systems Frontiers10.1007/s10796-016-9701-719:5(1013-1028)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1007/s10796-016-9701-7
Troiano LBirtolo CArmenise R(2016)A validation study regarding a generative approach in choosing appropriate colors for impaired usersSpringerPlus10.1186/s40064-016-2659-65:1Online publication date: 15-Jul-2016
https://doi.org/10.1186/s40064-016-2659-6
Fu HKong XWang Z(2016)Binary code reranking method with weighted hamming distanceMultimedia Tools and Applications10.1007/s11042-014-2087-y75:3(1391-1408)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1007/s11042-014-2087-y
Zhang WLiu CWang ZLi GHuang QGao W(2014)Web video thumbnail recommendation with content-aware analysis and query-sensitive matchingMultimedia Tools and Applications10.1007/s11042-013-1607-573:1(547-571)Online publication date: 1-Nov-2014
https://dl.acm.org/doi/10.1007/s11042-013-1607-5
Ribeiro MGomes A(2013)A skillet-based recoloring algorithm for dichromats2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013)10.1109/HealthCom.2013.6720766(702-706)Online publication date: Oct-2013
https://doi.org/10.1109/HealthCom.2013.6720766
Sun FWang MWang DWang X(2012)Optimizing social image search with multiple criteriaNeurocomputing10.1016/j.neucom.2011.05.04095(40-47)Online publication date: 1-Oct-2012
https://dl.acm.org/doi/10.1016/j.neucom.2011.05.040
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents