Towards Graphical User Interface Redefinition without Source Code Access: System Design and Evaluation
Article No.: 51, Pages 1 - 6
Abstract
Nowadays several interactive computing systems (ICSs) still have Graphical User Interfaces (GUIs) that are inadequate in terms of usability and user experience. Numerous improvements were made in the development of better GUIs however, little has been done to improve existing ones. This might be explained by the fact that most ICSs do not provide source code access. In most cases, this means that only persons with source code access can (easily) enhance the respective GUI.
This paper presents a tool using computer vision (CV) algorithms to semi-automatically redefine existing GUIs without accessing their source code. The evaluation of a new GUI obtained from the redefinition of an existing GUI using the tool is described. Results show statistically significant improvements in usability (reduction of interaction mistakes), improved task completion success rate and improved user satisfaction.
References
[1]
Estelle de Kock, Judy van Biljon, and Marco Pretorius. 2009. Usability evaluation methods: mind the gaps. In Proc. of Research Conference of the South African Institute of Computer Scientists and Information Technologists. ACM, 122--131.
[2]
Ben Shneiderman. 2016. Designing the User Interface: Strategies for Effective HCI. Pearson.
[3]
FDIS, ISO: 9241-110: 2006. Ergonomics of human system interaction-Part 110: Dialogue principles. International Organization for Standardization.
[4]
ISO 9241-400: 2007. Ergonomics of Human-system Interaction: Principles and requirements for physical input devices. International Organisation for Standardisation.
[5]
Jenifer Tidwell. 2010. Designing Interfaces: Patterns for Effective Interaction Design 2nd Edition. O'Reilly Media. ISBN-13: 978-1449379704.
[6]
Morgan Dixon, Daniel Leventhal, and James Fogarty. 2011. Content and hierarchy in pixel-based methods for reverse engineering interface structure. In Proc. of the Conference on Human Factors in Computing Systems. ACM, 969--978.
[7]
Morgan Dixon, Alexander Nied, and James Fogarty. 2014. Prefab layers and prefab annotations: extensible pixel-based interpretation of graphical interfaces. In Proc. of the symposium on User interface software and technology. ACM, 221--230.
[8]
José Luís Silva, Jorge D. Ornelas, and João C. Silva. 2016. Make it ISI: interactive systems integration tool. In Proc. of the Symposium on Engineering Interactive Computing Systems. ACM, 245--250.
[9]
Gagan Singh, Sergi Badia, Rodrigo Ventura, José L. Silva. 2018. Physiologically attentive user interface for robot teleoperation - real time emotional state estimation and interface modification using physiology, facial expressions and eye movements. In Proc. of the Conf. on Biomedical Engineering Systems and Technologies, 294--302.
[10]
José Luís Silva, J.C. Silva. 2018. Graphical User Interface Redefinition Addressing Users' Diversity. In International Conference on Human-Centred Software Engineering, Springer, Cham, 319--326.
[11]
Krzysztof Z. Gajos, Daniel S. Weld, Jacob O. Wobbrock. 2010. Automatically generating personalized user interfaces with SUPPLE. Artificial Intelligence 174(12-13), 910--950.
[12]
Krzysztof Gajos, Jacob Wobbrock, and Daniel Weld. 2008.Improving the performance of motor impaired users with automatically-generated, ability-based interfaces. In Proc. of the Conf. on Human Factors in Computing Systems. ACM, 1257--1266.
[13]
Krzysztof Gajos and Daniel S. Weld. 2004. SUPPLE: automatically generating user interfaces. In Proc. of conf. on Intelligent user interfaces.ACM, 93--100.
[14]
Tom Yeh, Tsung-Hsiang Chang, and Robert Miller. 2009. Sikuli: using GUI screenshots for search and automation. In Proc. of the symposium on User interface software and technology. ACM, 183--192.
[15]
A. Dubrovina, K. Pavel, F. Daniel, S. Sagi and B. Ruth. 2012. Efficient and robust image descriptor for GUI object classification. In Proc. of Conference on Pattern Recognition. IEEE, 3594--3597.
[16]
A. M. Lund. 2001. Measuring Usability with the USE Questionnaire. Usability Interface, 8(2), 3--6.
Index Terms
- Towards Graphical User Interface Redefinition without Source Code Access: System Design and Evaluation
Recommendations
A Dialog-Oriented User Interface Generation Mechanism
APSEC '96: Proceedings of the Third Asia-Pacific Software Engineering ConferenceNowadays, for GUI application development, there are a number of interface builders, which make it possible for the user to create user interfaces easily, and UIMSs, which help to specify and design user interfaces. However, interface builders lack the ...
Towards virtualization of user interfaces based on UsiXML
Web3D '05: Proceedings of the tenth international conference on 3D Web technologyA model-based approach is presented for structuring a development process of virtual user interfaces based on UsiXML, a XML-compliant User Interface Description Language. UsiXML provides a Concrete User Interface description that remains independent ...
Usability-Focused Architectural Design for Graphical User Interface Components
CIMCA '08: Proceedings of the 2008 International Conference on Computational Intelligence for Modelling Control & AutomationAlthough in recent years some progress in software engineering (SE) and human-computer interaction (HCI) has been made, there is still a gap between the two research areas and their methodologies. Today, from the engineering point of view, the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2019
646 pages
ISBN:9781450368254
DOI:10.1145/3338286
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 October 2019
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Fundação para a Ciência e a Tecnologia
Conference
MobileHCI '19
Sponsor:
MobileHCI '19: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services
October 1 - 4, 2019
Taipei, Taiwan
Acceptance Rates
Overall Acceptance Rate 202 of 906 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 135Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in