Comparing the Effectiveness and Ergonomics of Smartphone-Based Gamepads
Pages 207 - 218
Abstract
Even though smartphones offer a broad design space for being used as input devices for video games, their form factor makes them less ergonomic than physical gamepads. Previous research suggests that customizable controller layouts and added haptic feedback can improve the quality of smartphone-based gamepads. However, there are no rigorous user studies comparing different types of smartphone controllers to each other. In this paper, we present results of a user study in which we compared three different smartphone-based gamepads: a smartphone controller with a standard layout, a customizable smartphone controller, and a smartphone controller with a haptic case. Additionally, we included a physical gamepad as a reference in our study. Participants used the different controllers to play a racing game and complete pointing tasks. We found that the physical gamepad outperforms smartphone-based controllers in terms of efficiency, but there was no significant difference in effectiveness. Furthermore, our qualitative findings open up design considerations for future improvements of smartphone-based game controllers.
References
[1]
Gabriel Ferreira Alves, Emerson Vitor Souza, Daniela Gorski Trevisan, Anselmo Antunes Montenegro, Luciana Cardoso de Castro Salgado, and Esteban Walter Gonzalez Clua. 2018. Applying Design Thinking for Prototyping a Game Controller. In Entertainment Computing – ICEC 2018(Lecture Notes in Computer Science), Esteban Clua, Licinio Roque, Artur Lugmayr, and Pauliina Tuomi (Eds.). Springer International Publishing, Cham, 16–27. https://doi.org/10.1007/978-3-319-99426-0_2
[2]
Tom Beigbeder, Rory Coughlan, Corey Lusher, John Plunkett, Emmanuel Agu, and Mark Claypool. 2004. The effects of loss and latency on user performance in unreal tournament 2003®. In Proceedings of 3rd ACM SIGCOMM workshop on Network and system support for games(NetGames ’04). Association for Computing Machinery, New York, NY, USA, 144–151. https://doi.org/10.1145/1016540.1016556
[3]
Jonathan Deber, Bruno Araujo, Ricardo Jota, Clifton Forlines, Darren Leigh, Steven Sanders, and Daniel Wigdor. 2016. Hammer Time! A Low-Cost, High Precision, High Accuracy Tool to Measure the Latency of Touchscreen Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). Association for Computing Machinery, New York, NY, USA, 2857–2868. https://doi.org/10.1145/2858036.2858394
[4]
Martin Dechant, Ian Stavness, Aristides Mairena, and Regan L. Mandryk. 2018. Empirical Evaluation of Hybrid Gaze-Controller Selection Techniques in a Gaming Context. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. ACM, Melbourne VIC Australia, 73–85. https://doi.org/10.1145/3242671.3242699
[5]
Ragnhild Eg, Kjetil Raaen, and Mark Claypool. 2018. Playing with Delay: With Poor Timing Comes Poor Performance, and Experience Follows Suit. In 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX). 1–6. https://doi.org/10.1109/QoMEX.2018.8463382 ISSN: 2472-7814.
[6]
Ahmed Farooq, Grigori Evreinov, Roope Raisamo, and Atif Abdul Majeed. 2014. Haptic user interface enhancement system for touchscreen based interaction. In 2014 International Conference on Open Source Systems & Technologies. IEEE, Lahore, Pakistan, 25–31. https://doi.org/10.1109/ICOSST.2014.7029316
[7]
Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381–391. https://doi.org/10.1037/h0055392
[8]
Guilherme Gonçalves, Érica Mourão, Leonardo Torok, Daniela Trevisan, Esteban Clua, and Anselmo Montenegro. 2017. Understanding User Experience with Game Controllers: A Case Study with an Adaptive Smart Controller and a Traditional Gamepad. In Entertainment Computing – ICEC 2017(Lecture Notes in Computer Science), Nagisa Munekata, Itsuki Kunita, and Junichi Hoshino (Eds.). Springer International Publishing, Cham, 59–71. https://doi.org/10.1007/978-3-319-66715-7_7
[9]
David Halbhuber. 2022. To Lag or Not to Lag: Understanding and Compensating Latency in Video Games. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA, 370–373. https://doi.org/10.1145/3505270.3558364
[10]
David Halbhuber, Valentin Schwind, and Niels Henze. 2022. Don’t Break my Flow: Effects of Switching Latency in Shooting Video Games. Proceedings of the ACM on Human-Computer Interaction 6, CHI PLAY (Oct. 2022), 229:1–229:20. https://doi.org/10.1145/3549492
[11]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Advances in Psychology. Vol. 52. Elsevier, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
[12]
International Organization for Standardization. 2012. Ergonomics of human-system interaction - Part 411: Evaluation methods for the design of physical input devices (ISO/TS 9241-411:2012). https://www.iso.org/standard/54106.html
[13]
Yvonne Jansen, Thorsten Karrer, and Jan Borchers. 2010. MudPad: tactile feedback and haptic texture overlay for touch surfaces. In ACM International Conference on Interactive Tabletops and Surfaces(ITS ’10). Association for Computing Machinery, New York, NY, USA, 11–14. https://doi.org/10.1145/1936652.1936655
[14]
Mark Joselli, José Ricardo da Silva, Marcelo Zamith, Esteban Clua, Mateus Pelegrino, Evandro Mendonça, and Eduardo Soluri. 2012. An architecture for game interaction using mobile. In 2012 IEEE International Games Innovation Conference. 1–5. https://doi.org/10.1109/IGIC.2012.6329846 ISSN: 2166-675X.
[15]
Shaun K. Kane, Meredith Ringel Morris, and Jacob O. Wobbrock. 2013. Touchplates: low-cost tactile overlays for visually impaired touch screen users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, Bellevue Washington, 1–8. https://doi.org/10.1145/2513383.2513442
[16]
Jenq-Shiou Leu and Nguyen Hai Tung. 2014. Design and Implementation of a Reconfigurable Mobile Game Controller on Smartphone. Wireless Personal Communications 74, 2 (Jan. 2014), 823–833. https://doi.org/10.1007/s11277-013-1323-5
[17]
Michael Long and Carl Gutwin. 2019. Effects of Local Latency on Game Pointing Devices and Game Pointing Tasks. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300438
[18]
Marcus Löwegren and Rikard Johansson. 2013. Using your Smartphone as a Game Controller to your PC. http://urn.kb.se/resolve?urn=urn:nbn:se:bth-4384
[19]
I. Scott MacKenzie. 1992. Fitts’ law as a research and design tool in human-computer interaction. Human-Computer Interaction 7 (1992), 91–139. https://doi.org/10.1207/s15327051hci0701_3
[20]
Jock Mackinlay, Stuart K. Card, and George G. Robertson. 1990. A Semantic Analysis of the Design Space of Input Devices. Human–Computer Interaction 5, 2-3 (June 1990), 145–190. https://doi.org/10.1080/07370024.1990.9667153 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/07370024.1990.9667153.
[21]
Philipp Mayring. 2015. Qualitative Content Analysis: Theoretical Background and Procedures. In Approaches to Qualitative Research in Mathematics Education: Examples of Methodology and Methods, Angelika Bikner-Ahsbahs, Christine Knipping, and Norma Presmeg (Eds.). Springer Netherlands, Dordrecht, 365–380. https://doi.org/10.1007/978-94-017-9181-6_13
[22]
Daniel Natapov and I. Scott MacKenzie. 2010. Gameplay evaluation of the trackball controller. In Proceedings of the International Academic Conference on the Future of Game Design and Technology(Futureplay ’10). Association for Computing Machinery, New York, NY, USA, 167–174. https://doi.org/10.1145/1920778.1920802
[23]
Daniel Natapov and I. Scott MacKenzie. 2010. The trackball controller: improving the analog stick. In Proceedings of the International Academic Conference on the Future of Game Design and Technology(Futureplay ’10). Association for Computing Machinery, New York, NY, USA, 175–182. https://doi.org/10.1145/1920778.1920803
[24]
Marta Nieznanska. 2014. Experimental evaluation of the smartphone as a remote game controller for PC racing games. http://urn.kb.se/resolve?urn=urn:nbn:se:bth-4000
[25]
Mateus Pelegrino, Leonardo Torok, Daniela Trevisan, and Esteban Clua. 2014. Creating and Designing Customized and Dynamic Game Interfaces Using Smartphones and Touchscreen. In 2014 Brazilian Symposium on Computer Games and Digital Entertainment. 133–139. https://doi.org/10.1109/SBGAMES.2014.21 ISSN: 2159-6662.
[26]
Adrian Ramcharitar and Robert J. Teather. 2017. A Fitts’ Law Evaluation of Video Game Controllers: Thumbstick, Touchpad and Gyrosensor. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, Denver Colorado USA, 2860–2866. https://doi.org/10.1145/3027063.3053213
[27]
Andreas Schmid, David Halbhuber, Thomas Fischer, Raphael Wimmer, and Niels Henze. 2023. Small Latency Variations Do Not Affect Player Performance in First-Person Shooters. Proceedings of the ACM on Human-Computer Interaction 7, CHI PLAY (Oct. 2023), 381:197–381:216. https://doi.org/10.1145/3611027
[28]
Andreas Schmid and Raphael Wimmer. 2021. Yet Another Latency Measuring Device. preprint. Open Science Framework. https://doi.org/10.31219/osf.io/tkghj
[29]
Andreas Schmid and Raphael Wimmer. 2023. Measuring the Latency of Graphics Frameworks on X11-Based Systems. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585779
[30]
Dao-Yuan Shan, Ze-Min Liu, Choon-Sung Nam, and Dong-Ryeol Shin. 2011. Research and implementation of a virtual joypad based on Android. In Proceedings of 2011 International Conference on Computer Science and Network Technology, Vol. 3. 1367–1370. https://doi.org/10.1109/ICCSNT.2011.6182219
[31]
Leonardo Torok, Mateus Pelegrino, Jefferson Lessa, Daniela Trevisan, and Esteban Clua. 2014. AdaptControl: an adaptive mobile touch control for games. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications. ACM, Shenzhen China, 1–1. https://doi.org/10.1145/2669062.2669081
[32]
Leonardo Torok, Mateus Pelegrino, Jefferson Lessa, Daniela Gorski Trevisan, Cristina N. Vasconcelos, Esteban Clua, and Anselmo Montenegro. 2015. Evaluating and Customizing User Interaction in an Adaptive Game Controller. In Design, User Experience, and Usability: Interactive Experience Design(Lecture Notes in Computer Science), Aaron Marcus (Ed.). Springer International Publishing, Cham, 315–326. https://doi.org/10.1007/978-3-319-20889-3_30
[33]
Leonardo Torok, Mateus Pelegrino, Daniela G. Trevisan, Esteban Clua, and Anselmo Montenegro. 2015. A Mobile Game Controller Adapted to the Gameplay and User’s Behavior Using Machine Learning. In Entertainment Computing - ICEC 2015(Lecture Notes in Computer Science), Konstantinos Chorianopoulos, Monica Divitini, Jannicke Baalsrud Hauge, Letizia Jaccheri, and Rainer Malaka (Eds.). Springer International Publishing, Cham, 3–16. https://doi.org/10.1007/978-3-319-24589-8_1
[34]
Raphael Wimmer, Andreas Schmid, and Florian Bockes. 2019. On the Latency of USB-Connected Input Devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300650
[35]
Loutfouz Zaman and I Scott MacKenzie. 2013. Evaluation of Nano-stick, Foam Buttons, and Other Input Methods for Gameplay on Touchscreen Phones. In roceedings of the International Conference on Multimedia and Human Computer Interaction. Toronto Ontario Canada.
[36]
Loutfouz Zaman, Daniel Natapov, and Robert J. Teather. 2010. Touchscreens vs. traditional controllers in handheld gaming. In Proceedings of the International Academic Conference on the Future of Game Design and Technology(Futureplay ’10). Association for Computing Machinery, New York, NY, USA, 183–190. https://doi.org/10.1145/1920778.1920804
[37]
Alexander Zaranek, Bryan Ramoul, Hua Fei Yu, Yiyu Yao, and Robert J. Teather. 2014. Performance of modern gaming input devices in first-person shooter target acquisition. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 1495–1500. https://doi.org/10.1145/2559206.2581291
[38]
Zhuoming Zhang, Jessalyn Alvina, Françoise Détienne, and Eric Lecolinet. 2022. Pulling, Pressing, and Sensing with In-Flat: Transparent Touch Overlay for Smartphones. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces. ACM, Frascati, Rome Italy, 1–9. https://doi.org/10.1145/3531073.3531111
Index Terms
- Comparing the Effectiveness and Ergonomics of Smartphone-Based Gamepads
Recommendations
Investigating On-Screen Gamepad Designs for Smartphone-Controlled Video Games
Special Issue on Smartphone-Based Interactive Technologies, Systems, and Applications and Special Issue on Extended Best Papers from ACM Multimedia 2014On-screen gamepads are increasingly used as controllers for video games on distant screens, yet lack the typical tactile feedback known from hardware controllers. We conducted a comparative lab study to investigate four smartphone gamepads inspired by ...
Understanding and Comparing Smartphone and Tablet Use: Insights from a Large-Scale Diary Study
OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human InteractionIn recent years, smartphone and tablet ownership has shown continued growth; however, there is a lack of research thoroughly investigating the use of these devices within the general public. This paper describes a large-scale diary study with U. S. ...
Design and Implementation of a Reconfigurable Mobile Game Controller on Smartphone
Expansion of games industry came in modern life, accompanied with innovative features in a game controller. Nowadays mobile industry is booming with the expansion of the variety of novel technologies, such as the use of 3D accelerometer sensors, high ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
719 pages
ISBN:9798400709982
DOI:10.1145/3670653
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 01 September 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
MuC '24
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 93Total Downloads
- Downloads (Last 12 months)93
- Downloads (Last 6 weeks)42
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in