More Web Proxy on the site http://driver.im/

research-article

Public Access

shapeCAD: An Accessible 3D Modelling Workflow for the Blind and Visually-Impaired Via 2.5D Shape Displays

Authors:

Joshua A. Miele,

Sean FollmerAuthors Info & Claims

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Pages 342 - 354

https://doi.org/10.1145/3308561.3353782

Published: 24 October 2019 Publication History

Abstract

Affordable rapid 3D printing technologies have become key enablers of the Maker Movement by giving individuals the ability to create physical finished products. However, existing computer-aided design (CAD) tools that allow authoring and editing of 3D models are mostly visually reliant and limit access to people with blindness and visual impairment (BVI). Through a series of co-design sessions with three blind users of mixed programming ability, we identify accessibility challenges in existing 3D modelling scripting tools and design interactions to support dynamic feedback of scripts using a 2.5D tactile shape display. With these insights, we implement shapeCAD. Interacting with shapeCAD, BVI users are able to leverage the low resolution output from a 2.5D shape display to complement programming of 3D models. shapeCAD allows users to haptically explore and modify existing models, and to author new models. We further validate usability and user experience through an evaluation with five BVI programmers. In a short period of time, novices were able to design a range of new objects. BVI users can bring a valuable perspective to design and it is imperative to increase accessibility in tools that enable this community to also participate as designers.

Supplementary Material

MP4 File (fp013vf.mp4)

Supplemental video

Download
29.74 MB

References

[1]

Peter Bennett, Mike Fraser, Duncan Boa, and Ben Hicks. 2017. InstructiBlocks: Designing with Ambiguous Physical-Digital Models. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 551--558.

Digital Library

[2]

Jeffrey P Bigham, Ryan S Kaminsky, Richard E Ladner, Oscar M Danielsson, and Gordon L Hempton. 2006. WebInSight:: making web images accessible. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility. ACM, 181--188.

Digital Library

[3]

Paulo Blikstein. 2013. Digital fabrication and 'making'in education: The democratization of invention. FabLabs: Of machines, makers and inventors 4 (2013), 1--21.

[4]

John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[5]

Craig Brown and Amy Hurst. 2012. VizTouch: automatically generated tactile visualizations of coordinate spaces. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction. ACM, 131--138.

Digital Library

[6]

Erin Buehler, William Easley, Samantha McDonald, Niara Comrie, and Amy Hurst. 2015. Inclusion and Education: 3D Printing for Integrated Classrooms. Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility -ASSETS '15 (2015).

Digital Library

[7]

JP Chin, VA Diehl, and KL Norman. 1988. Questionnaire for User Interaction Satisfaction (QUIS). Human-Computer Interaction Lab, University of Maryland at College Park (1988).

[8]

Jonathan Cohen, Jonathan Cohen, W. Monty Jones, Shaunna Smith, and Brendan Calandra. 2017. Makification: Towards a Framework for Leveraging the Maker Movement in Formal... Journal of Educational Multimedia and Hypermedia 26, 3 (2017), 217--229.

[9]

Damian Copeland and Janet Finlay. 2010. Identification of the optimum resolution specification for a haptic graphic display. Interacting with Computers 22, 2 (2010), 98--106.

Digital Library

[10]

Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz studies why and how. Knowledge-based systems 6, 4 (1993), 258--266.

[11]

Julie Ducasse, Anke M Brock, and Christophe Jouffrais. 2018. Accessible interactive maps for visually impaired users. In Mobility of Visually Impaired People. Springer, 537--584.

[12]

K Anders Ericsson and Herbert A Simon. 1984. Protocol analysis: Verbal reports as data. the MIT Press.

[13]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. UIST '13 Proceedings of the 26th annual ACM symposium on User interface software and technology 13 (2013), 417--426.

Digital Library

[14]

American Printing House for the Blind. 2018. Introducing Graphiti -A Revolution in Accessing Digital Tactile Graphics. (2018). https://www.aph.org/graphiti/

[15]

Denis Gillet, Anh Vu Nguyen Ngoc, and Yassin Rekik. 2005. Collaborative web-based experimentation in flexible engineering education. IEEE Transactions on Education 48, 4 (2005), 696--704.

Digital Library

[16]

T Götzelmann. 2018. Autonomous Selection and Printing of 3D Models for People Who Are Blind. ACM Transactions on Accessible Computing (TACCESS) 11, 3 (2018), 14.

[17]

Timo Götzelmann, Lisa Branz, Claudia Heidenreich, and Markus Otto. 2017. A Personal Computer-based Approach for 3D Printing Accessible to Blind People. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 1--4.

Digital Library

[18]

Darren Guinness, Edward Cutrell, and Meredith Ringel Morris. 2018. Caption crawler: Enabling reusable alternative text descriptions using reverse image search. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 518.

Digital Library

[19]

Erica Rosenfeld Halverson and Kimberly Sheridan. 2014. The Maker Movement in Education. Harvard Educational Review 84, 4 (Dec 2014), 495--504.

[20]

SG Hart and others. 1988. Development of NASA-TLX: Results of empirical and theoretical research I inP. A. Hancock and N. Meshkati (eds.), Human Mental Workload. (1988).

[21]

Leona Holloway, Kim Marriott, and Matthew Butler. 2018. Accessible Maps for the Blind: Comparing 3D Printed Models with Tactile Graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 198.

Digital Library

[22]

Amy Hurst and Shaun Kane. 2013. Making making accessible. In Proceedings of the 12th international conference on interaction design and children. ACM, 635--638.

Digital Library

[23]

Youssef Bou Issa, Mustapha Mojahid, Bernard Oriola, and Nadine Vigouroux. 2009. Accessibility for the blind: An automated audio/tactile description of pictures in digital documents. In 2009 International Conference on Advances in Computational Tools for Engineering Applications. IEEE, 591--594.

[24]

Shaun K Kane and Jeffrey P Bigham. 2014. Tracking@ stemxcomet: teaching programming to blind students via 3D printing, crisis management, and twitter. In Proceedings of the 45th ACM technical symposium on Computer science education. ACM, 247--252.

Digital Library

[25]

Jeeeun Kim, Abigale Stangl, and Tom Yeh. 2014. Using LEGO to model 3D tactile picture books by sighted children for blind children. In Proceedings of the 2nd ACM symposium on Spatial user interaction. ACM, 146--146.

Digital Library

[26]

Roberta L. Klatzky, Susan J. Lederman, and Victoria A. Metzger. 1985. Identifying objects by touch: An expert system. Perception & Psychophysics 37, 4 (01 Jul 1985), 299--302.

[27]

Richard E Ladner, Melody Y Ivory, Rajesh Rao, Sheryl Burgstahler, Dan Comden, Sangyun Hahn, Matthew Renzelmann, Satria Krisnandi, Mahalakshmi Ramasamy, Beverly Slabosky, and others. 2005. Automating tactile graphics translation. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility. ACM, 150--157.

Digital Library

[28]

David H Laidlaw, W Benjamin Trumbore, and John F Hughes. 1986. Constructive solid geometry for polyhedral objects. In ACM SIGGRAPH computer graphics, Vol. 20. ACM, 161--170.

[29]

Rebecca Lawson and Sarah Bracken. 2011. Haptic Object Recognition: How Important are Depth Cues and Plane Orientation? Perception 40, 5 (2011), 576--597. 21882721.

[30]

Susan J Lederman and Roberta L Klatzky. 1987. Hand movements: A window into haptic object recognition. Cognitive Psychology 19, 3 (1987), 342 -- 368. //doi.org/10.1016/0010-0285(87)90008--9

[31]

Ben Leduc-Mills and Michael Eisenberg. 2011. The UCube: a child-friendly device for introductory three-dimensional design. In proceedings of the 10th international conference on interaction design and children. ACM, 72--80.

Digital Library

[32]

Fabrizio Leo, Elena Cocchi, and Luca Brayda. 2017. The effect of programmable tactile displays on spatial learning skills in children and adolescents of different visual disability. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 7 (2017), 861--872.

[33]

Thomas H Massie, J Kenneth Salisbury, and others. 1994. The phantom haptic interface: A device for probing virtual objects. In Proceedings of the ASME winter annual meeting, symposium on haptic interfaces for virtual environment and teleoperator systems, Vol. 55. Citeseer, 295--300.

[34]

Joshua A Miele, Steven Landau, and Deborah Gilden. 2006. Talking TMAP: Automated generation of audio-tactile maps using Smith-Kettlewell's TMAP software. British Journal of Visual Impairment 24, 2 (2006), 93--100.

[35]

Kazunori Minatani. 2017. Finding 3D CAD Data Production Methods that Work for People with Visual Impairments. In HCI International 2017 -- Posters' Extended Abstracts, Constantine Stephanidis (Ed.). Springer International Publishing, Cham, 548--554.

[36]

Paolo Motto Ros, Vittorio Dante, Luca Mesin, Erminio Petetti, Paolo Del Giudice, and Eros Pasero. 2014. A new dynamic tactile display for reconfigurable braille: implementation and tests. Frontiers in neuroengineering 7 (2014), 6.

[37]

Stefanie Mueller, Anna Seufert, Huaishu Peng, Robert Kovacs, Kevin Reuss, François Guimbretière, and Patrick Baudisch. 2019. FormFab: Continuous Interactive Fabrication. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 315--323.

Digital Library

[38]

Yuenyong Nilsiam and Joshua M Pearce. 2017. Free and open source 3-D model customizer for websites to democratize design with OpenSCAD. Designs 1, 1 (2017), 5.

[39]

Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. (2010). http://www.brailleauthority.org/tg/

[40]

OpenSCAD. 2015. OpenSCAD -The Programmers Solid 3D CAD Modeller. https://www.openscad.org. (2015). Accessed: 2019-05-02.

[41]

Thomas Pietrzak, Andrew Crossan, Stephen A Brewster, Benoît Martin, and Isabelle Pecci. 2009. Exploring geometric shapes with touch. In IFIP Conference on Human-Computer Interaction. Springer, 145--148.

Digital Library

[42]

Denise Prescher. 2014. Redesigning input controls of a touch-sensitive pin-matrix device. In Proceedings of the international workshop on tactile/haptic user interfaces for tabletops and tablets. 19--24.

[43]

Denise Prescher and Gerhard Weber. 2017. Comparing Two Approaches of Tactile Zooming on a Large Pin-Matrix Device. In IFIP Conference on Human-Computer Interaction. Springer, 173--186.

[44]

Deepak Ramteke, Gayatri Kansal, and Benu Madhab. 2014. Accessible Engineering Drawings for Visually Impaired Machine Operators. Assistive Technology 26, 4 (2014), 196--201.

[45]

Ravi Rastogi, TV Dianne Pawluk, and Jessica Ketchum. 2013. Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. IEEE Transactions on Neural Systems and Rehabilitation Engineering 21, 4 (2013), 655--663.

[46]

Jeff Sauro and Joseph S Dumas. 2009. Comparison of three one-question, post-task usability questionnaires. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1599--1608.

Digital Library

[47]

Zachary Schmitt and Svetlana Yarosh. 2018. Participatory design of technologies to support recovery from substance use disorders. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 156.

Digital Library

[48]

Yutaka Shimizu, Shinya Saida, and Hiroshi Shimura. 1993. Tactile pattern recognition by graphic display: Importance of 3-D information for haptic perception of familiar objects. Perception & Psychophysics 53, 1 (1993), 43--48.

[49]

Masami Shinohara, Yutaka Shimizu, and Akira Mochizuki. 1998. Three-dimensional tactile display for the blind. IEEE Transactions on Rehabilitation Engineering 6, 3 (1998), 249--256.

[50]

Alexa F Siu, Eric J Gonzalez, Shenli Yuan, Jason B Ginsberg, and Sean Follmer. 2018a. shapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 291.

Digital Library

[51]

Alexa F. Siu, Joshua Miele, and Sean Follmer. 2018b. An Accessible CAD Workflow Using Programming of 3D Models and Preview Rendering in A 2.5D Shape Display. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '18). ACM, New York, NY, USA, 343--345.

Digital Library

[52]

Nancy Staggers and David Kobus. 2000. Comparing Response Time, Errors, and Satisfaction Between Text-based and Graphical User Interfaces During Nursing Order Tasks. Journal of the American Medical Informatics Association 7, 2 (2000), 164--176.

[53]

Katherine Steele, Brianna Blaser, and Maya Cakmak. 2018. Accessible Making: Designing Makerspaces for Accessibility. International Journal of Designs for Learning 9, 1 (2018), 114--121.

[54]

Saiganesh Swaminathan, Thijs Roumen, Robert Kovacs, David Stangl, Stefanie Mueller, and Patrick Baudisch. 2016. Linespace: A Sensemaking Platform for the Blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2175--2185.

Digital Library

[55]

Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring interactions with physically dynamic bar charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3237--3246.

Digital Library

[56]

Ruhan Ozkardes Tandogan and Akinoglu Orhan. 2007. The Effects of Problem-Based Active Learning in Science Education on Students' Academic Achievement, Attitude and Concept Learning. Online Submission 3, 1 (2007), 71--81.

[57]

Barker Temple. 1990. The benefits of the graphical user interface: A report on new primary research. The benefits of the graphical user interface: A report on new primary research. The benefits of the graphical user interface: A report on new primary research. (1990).

[58]

TinkerCAD. 2019. Direct Starters. https://www.tinkercad.com/learn/project-gallery; collectionId=OPC41AJJKIKDWDV. (2019). Accessed: 2019-05-02.

[59]

Thomas P Way and Kenneth E Barner. 1997. Automatic visual to tactile translation. II. Evaluation of the TACTile image creation system. IEEE Transactions on Rehabilitation Engineering 5, 1 (1997), 95--105.

[60]

Maryjane Wraga, Monique Swaby, and Catherine M Flynn. 2008. Passive tactile feedback facilitates mental rotation of handheld objects. Memory & cognition 36, 2 (2008), 271--281.

[61]

Tom Yeh and Jeeeun Kim. 2018. CraftML: 3D Modeling is Web Programming. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 527.

Digital Library

[62]

Kai Zhang and Sean Follmer. 2018. Electrostatic Adhesive Brakes for High Spatial Resolution Refreshable 2.5 D Tactile Shape Displays. In Haptics Symposium (HAPTICS), 2018 IEEE. IEEE, 319--326.

Cited By

Clasen DHassenzahl M(2024)Fostering people's autonomy by foregrounding and questioning daily choicesAdjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction10.1145/3677045.3685442(1-5)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3677045.3685442
Bennett CShelby RRostamzadeh NKane S(2024)Painting with Cameras and Drawing with Text: AI Use in Accessible CreativityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675644(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675644
Qian WGao CSathya ASuzuki RNakagaki K(2024)SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676348(1-29)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676348
Show More Cited By

Index Terms

shapeCAD: An Accessible 3D Modelling Workflow for the Blind and Visually-Impaired Via 2.5D Shape Displays
1. Human-centered computing
  1. Accessibility
    1. Accessibility systems and tools
  2. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

Advancing Accessible 3D Design for the Blind and Visually-Impaired via Tactile Shape Displays
UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Affordable rapid 3D printing technologies have become key enablers of the Maker Movement by giving individuals the ability to create physical finished products. However, existing computer-aided design (CAD) tools that allow authoring and editing of 3D ...
A multimodal, computer-based drawing system for persons who are blind and visually impaired
ASSETS '10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility

Many individuals who are blind or visually impaired are interested in drawing tactile pictures, and some have already done so with static raised-line drawing kits. However, static raised-line drawing kits are problematic as they are non-erasable. ...
Toward accessible 3D virtual environments for the blind and visually impaired
DIMEA '08: Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts

3D virtual environments are increasingly used for education, business and recreation but are often inaccessible to users who are visually impaired, effectively creating a digital divide. Interviews with 8 visually impaired expert users were conducted to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 2019

730 pages

ISBN:9781450366762

DOI:10.1145/3308561

General Chair:
Jeffrey P. Bigham
Carnegie Mellon University., USA
,
Program Chairs:
Shiri Azenkot
Cornell Tech, USA
,
Shaun K. Kane
University of Colorado Boulder, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

ASSETS '19

Sponsor:

SIGACCESS

ASSETS '19: The 21st International ACM SIGACCESS Conference on Computers and Accessibility

October 28 - 30, 2019

PA, Pittsburgh, USA

Acceptance Rates

ASSETS '19 Paper Acceptance Rate 41 of 158 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

57
Total Citations
View Citations
1,703
Total Downloads

Downloads (Last 12 months)427
Downloads (Last 6 weeks)45

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Clasen DHassenzahl M(2024)Fostering people's autonomy by foregrounding and questioning daily choicesAdjunct Proceedings of the 2024 Nordic Conference on Human-Computer Interaction10.1145/3677045.3685442(1-5)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3677045.3685442
Bennett CShelby RRostamzadeh NKane S(2024)Painting with Cameras and Drawing with Text: AI Use in Accessible CreativityProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675644(1-19)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675644
Qian WGao CSathya ASuzuki RNakagaki K(2024)SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676348(1-29)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676348
Lipkowitz GDesimone J(2024)Palette-PrintAR: augmented reality design and simulation for multicolor resin 3D printingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642909(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642909
Valdivia ARezqalla MSwann SBlumenschein L(2024)Soft Growing Pin for High-Extension Shape-Changing Displays2024 IEEE 7th International Conference on Soft Robotics (RoboSoft)10.1109/RoboSoft60065.2024.10522001(650-656)Online publication date: 14-Apr-2024
https://doi.org/10.1109/RoboSoft60065.2024.10522001
Law WToro Wyetzner SZhen RFollmer S(2024)A Multi-Stable Curved Line Shape Display2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610902(9696-9703)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610902
Lee MKim SIn H(2024)Archi-TangiBlock: A Modular Block Based Tangible Media as a CAD Tool for Visually Impaired PeopleIEEE Access10.1109/ACCESS.2024.338231112(46582-46595)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3382311
Gu QLi XCai QZhu KDai CZhang YSun LTao YWang G(2024)MyWay: a 3D and audio-enhanced transportation learning kit for the visually impaired teenagersCCF Transactions on Pervasive Computing and Interaction10.1007/s42486-024-00163-yOnline publication date: 23-Jul-2024
https://doi.org/10.1007/s42486-024-00163-y
Lukyanenko RSamuel BParsons JStorey VPastor OJabbari A(2024)Universal conceptual modeling: principles, benefits, and an agenda for conceptual modeling researchSoftware and Systems Modeling10.1007/s10270-024-01207-823:5(1077-1100)Online publication date: 3-Sep-2024
https://doi.org/10.1007/s10270-024-01207-8
Biggs BSiu AAziz NStockman T(2024)Remote Co-design in the Digital AgeHandbook of Disability10.1007/978-981-19-6056-7_47(951-971)Online publication date: 4-Apr-2024
https://doi.org/10.1007/978-981-19-6056-7_47
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents