[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/1864349.1864353acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
research-article

Toolkit to support intelligibility in context-aware applications

Published: 26 September 2010 Publication History

Abstract

Context-aware applications should be intelligible so users can better understand how they work and improve their trust in them. However, providing intelligibility is non-trivial and requires the developer to understand how to generate explanations from application decision models. Furthermore, users need different types of explanations and this complicates the implementation of intelligibility. We have developed the Intelligibility Toolkit that makes it easy for application developers to obtain eight types of explanations from the most popular decision models of context-aware applications. We describe its extensible architecture, and the explanation generation algorithms we developed. We validate the usefulness of the toolkit with three canonical applications that use the toolkit to generate explanations for end-users.

References

[1]
}}Assad, M. et al. (2007). PersonisAD: Distributed, Active, Scrutable Model Framework for Context-Aware Services. Pervasive 07, 55--72.
[2]
}}Avrahami, D. & Hudson, S.E. (2006). Responsiveness in Instant Messaging: Predictive Models Supporting Inter-Personal Communication. CHI 06, 731--740.
[3]
}}Bardram, J. E. (2005). The Java Context Awareness Framework (JCAF) - A Service Infrastructure and Programming Framework for Context-Aware Applications. Pervasive 05, 98--115.
[4]
}}Barkhuus, L. & Dey, A.K. (2003). Is context-aware computing taking control away from the user? Three levels of interactivity examined. Ubicomp 03, 149--156.
[5]
}}Bellotti, V. & Edwards, W.K. (2001). Intelligibility and Accountability: Human Considerations in Context-Aware Systems, Human-Computer Interaction, 16(2-4): 193--212.
[6]
}}Borriello, G. et al. (2004). Reminding About Tagged Objects Using Passive RFIDs. Ubicomp 04, 36--53.
[7]
}}Bulling, A., Ward, J. A., Gellersen, H., & Tröster, G. (2008). Robust Recognition of Reading Activity in Transit Using Wearable Electrooculography. Pervasive 08, 19--37.
[8]
}}Chang, K., Hightower, J., & Kveton, B. (2009). Inferring Identity Using Accelerometers in Television Remote Controls. Pervasive 09, 151--167.
[9]
}}Chang, K., Chen, M. Y., & Canny, J. (2007). Tracking Free-Weight Exercises. Ubicomp 09, 19--37.
[10]
}}Cheverst, K. et al. (2005). Exploring issues of user model transparency and proactive behavior in an office environment control system. UMUAI 05, 15(3-4), 235--273.
[11]
}}Dey, A.K., Abowd, G.D. & Salber, D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16(2-4): 97--166.
[12]
}}Dey, A. K. & de Guzman, E. (2006). From awareness to connectedness: the design and deployment of presence displays. CHI 06, 899--908.
[13]
}}Dey, A. K. & Newberger, A. (2009). Support for context-aware intelligibility and control. CHI 09, 859--868.
[14]
}}Fogarty, J. & Hudson, S. E. (2007). Toolkit support for developing and deploying sensor-based statistical models of human situations. CHI 07, 135--144.
[15]
}}Franois, J.M. (2010). Jahmm: An implementation of Hidden Markov Models in Java. http://code.google.com/p/jahmm/. Retrieved 9 Mar 2010.
[16]
}}Froehlich, J. et al. (2009). UbiGreen: investigating a mobile tool for tracking and supporting green transportation habits. CHI 09, 1043--1052.
[17]
}}Gregor, S. & Benbasat, I. (1999). Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice. MIS Quarterly 23(4): 497--530.
[18]
}}Gu, T., Pung, H. K., & Zhang, D. Q. (2005). A service-oriented middleware for building context-aware services. Journal of Network and Computer Applications, 28(1), 1--18.
[19]
}}Hall, M. et al. (2009). The WEKA Data Mining Software: An Update. SIGKDD Explorations 09, 11(1), 10--18.
[20]
}}Herlocker, J., Konstan, J. & Riedl, J. (2000). Explaining collaborative filtering recommendations. CSCW 00, 241--250.
[21]
}}Kasteren, T. L. M. et al. (2008). Accurate Activity Recognition in a Home Setting. Ubicomp 08, 1--9.
[22]
}}Ko, A. J. & Myers, B. A. (2009). Finding causes of program output with the Java Whyline. CHI 09, 1569--1578.
[23]
}}Kofod-Petersen, A., & Mikalsen, M. (2005). Context: Representation and reasoning - Representing and reasoning about context in a mobile environment. Revue d'Intelligence Artificielle, 19, 479--498.
[24]
}}Kuleza, T. et al. (2009). Fixing the Program My Computer Learned: Barriers for End-users, Challenges for the Machine. IUI 09, 187--196.
[25]
}}Lim, B. Y., Dey, A. K. (2009). Assessing Demand for Intelligibility in Context-Aware Applications. Ubicomp 09, 195--204.
[26]
}}Lim, B. Y., Dey, A. K. & Avrahami, D. (2009). Why and why not explanations improve the intelligibility of context-aware intelligent systems. CHI 09, 2119--2128.
[27]
}}McGuinness, D. et al. (2007). A Categorization of Explanation Questions for Task Processing Systems. AAAI Workshop on Explanation-Aware Computing (ExaCt-07).
[28]
}}Mozina M. et al. (2004). Nomograms for Visualization of Naive Bayesian Classifier. PKDD 2004, 337--348.
[29]
}}Muir, B. (1994). Trust in automation: Part i. theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37(11): 1905--1922.
[30]
}}Myers, B. A. et al. (2006). Answering why and why not questions in user interfaces. CHI 06, 397--406.
[31]
}}Newcomb, E., Pashley, T., & Stasko, J. (2003). Mobile computing in the retail arena. CHI 03, 337--344.
[32]
}}Olsen, D. R. (2007). Evaluating user interface systems research. UIST 07, 251--258.
[33]
}}Patel, K. et al. (2008). Investigating Statistical Machine Learning as a Tool for Software Development. CHI 08, 667--676.
[34]
}}Poulin, B. et al. (2006). Visual explanation of evidence in additive classifiers. IAAI 06, 1822--1829.
[35]
}}Quinlan, J. R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers.
[36]
}}Rabiner L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77(2):257--286, 1989.
[37]
}}Robnik-'ikonja, M. & Kononenko, I. (2008). Explaining Classifications For Individual Instances. IEEE Transactions on Knowledge and Data Engineering, 20(5): 589--600.
[38]
}}Stumpf, S. et al. (2009). Interacting meaningfully with machine learning systems: Three experiments. International Journal of Human-Computer Studies, 67(8), 639--662.
[39]
}}Tapia, E. M., Intille, S. S., Larson, K. (2004). Activity Recognition in the Home Using Simple and Ubiquitous Sensors. Pervasive 04, 158--175.
[40]
}}Terada, T. et al. (2004). Ubiquitous Chip: A Rule-Based I/O Control Device for Ubiquitous Computing. Pervasive 04, 238--253.
[41]
}}Tsukada, K. & Yasumura, M. (2004). ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation. Ubicomp 04, 384--399.
[42]
}}Tullio, J. et al. (2007). How it works: A field study of non-technical users interacting with an intelligent system. CHI 07, 31--40.
[43]
}}Weiser, M. & Brown, J. S. (1997). The coming age of calm technology. Beyond Calculation: the Next Fifty Years, 75--85.
[44]
}}Welbourne, E., Balazinska, M., Borriello, G., Fogarty, J. (2010). Specification and Verification of Complex Location Events. Pervasive 10, 57--75.
[45]
}}Zheng, Y. et al. (2008). Understanding mobility based on GPS data. Ubicomp 08, 312--321.

Cited By

View all
  • (2024)A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?ACM Transactions on Autonomous and Adaptive Systems10.1145/370200419:4(1-40)Online publication date: 24-Nov-2024
  • (2024)Memolet: Reifying the Reuse of User-AI Conversational MemoriesProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676388(1-22)Online publication date: 13-Oct-2024
  • (2024)The AI-DEC: A Card-based Design Method for User-centered AI ExplanationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661576(1010-1028)Online publication date: 1-Jul-2024
  • Show More Cited By

Index Terms

  1. Toolkit to support intelligibility in context-aware applications

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UbiComp '10: Proceedings of the 12th ACM international conference on Ubiquitous computing
    September 2010
    366 pages
    ISBN:9781605588438
    DOI:10.1145/1864349
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    • University of Florida: University of Florida

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 September 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. context-awareness
    2. explanations
    3. intelligibility
    4. toolkits

    Qualifiers

    • Research-article

    Conference

    Ubicomp '10
    Ubicomp '10: The 2010 ACM Conference on Ubiquitous Computing
    September 26 - 29, 2010
    Copenhagen, Denmark

    Acceptance Rates

    UbiComp '10 Paper Acceptance Rate 39 of 202 submissions, 19%;
    Overall Acceptance Rate 764 of 2,912 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)70
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 14 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Roadmap of Explainable Artificial Intelligence: Explain to Whom, When, What and How?ACM Transactions on Autonomous and Adaptive Systems10.1145/370200419:4(1-40)Online publication date: 24-Nov-2024
    • (2024)Memolet: Reifying the Reuse of User-AI Conversational MemoriesProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676388(1-22)Online publication date: 13-Oct-2024
    • (2024)The AI-DEC: A Card-based Design Method for User-centered AI ExplanationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661576(1010-1028)Online publication date: 1-Jul-2024
    • (2024)FrameKit: A Tool for Authoring Adaptive UIs Using KeyframesProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645176(660-674)Online publication date: 18-Mar-2024
    • (2024)Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642158(1-17)Online publication date: 11-May-2024
    • (2024)IF-City: Intelligible Fair City Planning to Measure, Explain and Mitigate InequalityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323990930:7(3749-3766)Online publication date: Jul-2024
    • (2024)SmartEx: A Framework for Generating User-Centric Explanations in Smart Environments2024 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom59722.2024.10494449(106-113)Online publication date: 11-Mar-2024
    • (2023)Assessing Perceived Trust and Satisfaction with Multiple Explanation Techniques in XAI-Enhanced Learning AnalyticsElectronics10.3390/electronics1212259412:12(2594)Online publication date: 8-Jun-2023
    • (2023)Using Feedforward to Reveal Interaction Possibilities in Virtual RealityACM Transactions on Computer-Human Interaction10.1145/360362330:6(1-47)Online publication date: 25-Sep-2023
    • (2023)Identifying Explanation Needs of End-users: Applying and Extending the XAI Question BankProceedings of Mensch und Computer 202310.1145/3603555.3608551(492-497)Online publication date: 3-Sep-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media