More Web Proxy on the site http://driver.im/

research-article

Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving

Authors:

Robert Zeleznik,

Andrew Bragdon,

Ferdi Adeputra,

Hsu-Sheng KoAuthors Info & Claims

UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

Pages 17 - 26

https://doi.org/10.1145/1866029.1866035

Published: 03 October 2010 Publication History

Abstract

Students, scientists and engineers have to choose between the flexible, free-form input of pencil and paper and the computational power of Computer Algebra Systems (CAS) when solving mathematical problems. Hands-On Math is a multi-touch and pen-based system which attempts to unify these approaches by providing virtual paper that is enhanced to recognize mathematical notations as a means of providing in situ access to CAS functionality. Pages can be created and organized on a large pannable desktop, and mathematical expressions can be computed, graphed and manipulated using a set of uni- and bi-manual interactions which facilitate rapid exploration by eliminating tedious and error prone transcription tasks. Analysis of a qualitative pilot evaluation indicates the potential of our approach and highlights usability issues with the novel techniques used.

Supplementary Material

JPG File (335u-zeleznik.jpg)

Download
8.96 KB

WMV File (335u-zeleznik.wmv)

Download
43.39 MB

References

[1]

}}Anthony, L., Yang, J., and Koedinger, K. Adapting Handwriting Recognition for Applications in Algebra Learning. International Workshop on Educational Multimedia and Multimedia Education (2007).

Digital Library

[2]

}}Benko, H., Wilson, A., and Baudisch, P. Precise Selection Techniques for Multi-Touch Screens. UIST (2008), 77--86.

Digital Library

[3]

}}Bier, E., Stone, M., Pier, K., Buxton, W., and DeRose, T. Toolglass and magic lenses: The see-through interface. Siggraph (1993), 73--80.

Digital Library

[4]

}}Bragdon, A., Zeleznik, R., Reiss, S., et al. Code Bubbles: A Working Set-based Interface for Code Understanding and Maintenance. CHI (2010).

Digital Library

[5]

}}Bragdon, A., Zeleznik, R., Williamson, B., Miller, T., and LaViola, Jr., J. GestureBar: improving the approachability of gesture-based interfaces. CHI (2009), 2269--2278.

Digital Library

[6]

}}Brandl, P., Forlines, C., Wigdor, D., Haller, M., and Shen, C. Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces. AVI (2008), 154--161.

Digital Library

[7]

}}Bunt, A., Terry, M., and Lank, E. Friend or foe?: examining CAS use in mathematics research. In Proceedings of CHI'09 (), 229--238.

Digital Library

[8]

}}Davidson, P. and Han, J. Extending 2D Object Arrangement with Pressure-Sensitive Layering Cues. UIST (2008), 87--90.

Digital Library

[9]

}}Elmqvist, N., Henry, N., Riche, Y., and Fekete, J. Melange: space folding for multi-focus interaction. CHI (2008), 1333--1342.

Digital Library

[10]

}}Frisch, M., Heydekorn, J., and Dachselt, R. Investigating Multi-Touch and Pen Gestures for Diagram Editing on Interactive Surfaces. ITS (2009).

Digital Library

[11]

}}Guiard, Y. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. The Journal of Motor Behavior, 19, 4 (1987), 486--517.

[12]

}}Guimbretriere, F., Martin, A., and Winograd, T. Benefits of Merging Command Selection and Direct Manipulation. ACM Transactions on Computer-Human Interaction (2005), 460--476.

Digital Library

[13]

}}Hinckley, K., Pahud, M., and Buxton, B. Direct Display Interaction via Simultaneous Pen + Multi-touch Input. In Proceedings of SID'09 ().

[14]

}}Hinckley, K., Pahud, M., and Buxton, B. Direct Display Interaction via Simultaneous Pen + Multi-touch Input. Proceedings of Society for Information Display (2010).

[15]

}}Hinckley, K., Zhao, S., Sarin, R., Baudisch, P., Cutrell, E., Shilman, M., and Tan, D. InkSeine: In Situ Search for Active Note Taking. CHI (2007).

Digital Library

[16]

}}http://pen.cs.brown.edu/starpad.html.

[17]

}}Kurtenbach, G. and Buxton, W. The limits of expert performance using hierarchic marking menus. CHI (1993), 482--487.

Digital Library

[18]

}}Labahn, G., Lank, E., MacLean, S., Marzouk, M., and Tausky, D. MathBrush: A System for Doing Math on Pen-Based Devices. IAPR International Workshop on Document Analysis Systems (2008), 599--606.

Digital Library

[19]

}}LaViola, Jr., J. and Zeleznik, R. MathPad2: A System for the Creation and Exploration of Mathematical Sketches. SIGGRAPH (2004).

Digital Library

[20]

}}Li, Y., Hinckley, K., Guan, Z., and Landay, J. Experimental analysis of mode switching techniques in pen-based user interfaces. CHI (2005).

Digital Library

[21]

}}Malik, S., Ranjan, A., and Balakrishnan, R. Interacting with large displays from a distance with vision-tracked multi-finger gestural input. UIST (2005), 43--52.

Digital Library

[22]

}}Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. The Design and Evaluation of Multi-finger Mouse Emulation Techniques. CHI (2009).

Digital Library

[23]

}}Morris, M., Lombardo, J., and Wigdor, D. WeSearch: Supporting Collaborative Search and Sensemaking on a Tabletop Display. CSCW (2010), 401--410.

Digital Library

[24]

}}Moscovich, T. Contact Area Interaction with Sliding Widgets. UIST (2009), 13--22.

Digital Library

[25]

}}Odell, D., Davis, R., Smith, A., and Wright, P. Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques. Graphics Interface (2004).

Digital Library

[26]

}}Roth, V. and Turner, T. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. CHI (2009).

Digital Library

[27]

}}Terrenghi, L. Affordances for manipulation of physical versus digital media on interactive surfaces. CHI (2007).

Digital Library

[28]

}}Thimbleby, W. A novel pen-based calculator and its evaluation. NordiCHI (2004), 445--448.

Digital Library

[29]

}}Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. UIST (2009).

Digital Library

[30]

}}Zeleznik, R. and Miller, T. Fluid inking: augmenting the medium of free-form inking with gestures. Graphics Interface (2006), 155--162.

Digital Library

[31]

}}Zeleznik, R., Miller, T., Li, C., and Laviola, Jr., J. MathPaper: Mathematical Sketching with Fluid Support for Interactive Computation. Smart Graphics (2008), 20--32.

Digital Library

Cited By

Cavez VAppert CPietriga E(2023)Spreadsheets on Interactive Surfaces: Breaking through the Grid with the PenACM Transactions on Computer-Human Interaction10.1145/363009731:2(1-33)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3630097
Wu ZLi JMa KKambhamettu HHead A(2023)FFL: A Language and Live Runtime for Styling and Labeling Typeset Math FormulasProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606731(1-16)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606731
Head AXie AHearst M(2022)Math Augmentation: How Authors Enhance the Readability of Formulas using Novel Visual Design PracticesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501932(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501932
Show More Cited By

Index Terms

Hands-on math: a page-based multi-touch and pen desktop for technical work and problem solving
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Reflective haptics: enhancing stylus-based interactions on touch screens
EuroHaptics'10: Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I

In this paper, we introduce the prototype of a low cost haptically augmented stylus for pen computing on touch screens. The stylus supports human-computer interaction through a dynamic haptic feedback. This reflective feedback is generated by a ...
Towards a formalization of multi-touch gestures
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

Multi-touch is a technology which offers new styles of interaction compared to traditional input devices like keyboard and mouse. Users can quickly manipulate objects or execute commands by means of their fingers and hands. Current multi-touch ...
Hands, hover, and nibs: understanding stylus accuracy on tablets
GI '15: Proceedings of the 41st Graphics Interface Conference

Although tablets and styli have become pervasive, styli have not seen widespread adoption for precise input tasks such as annotation, note-taking, algebra, and so on. While many have identified that stylus accuracy is a problem, there is still much ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

October 2010

476 pages

ISBN:9781450302715

DOI:10.1145/1866029

General Chair:
Ken Perlin
New York University
,
Program Chairs:
Mary Czerwinski
Microsoft Research
,
Rob Miller
MIT CSAIL

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '10

Sponsor:

UIST '10: The 23nd Annual ACM Symposium on User Interface Software and Technology

October 3 - 6, 2010

New York, New York, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
2,038
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cavez VAppert CPietriga E(2023)Spreadsheets on Interactive Surfaces: Breaking through the Grid with the PenACM Transactions on Computer-Human Interaction10.1145/363009731:2(1-33)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3630097
Wu ZLi JMa KKambhamettu HHead A(2023)FFL: A Language and Live Runtime for Styling and Labeling Typeset Math FormulasProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606731(1-16)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606731
Head AXie AHearst M(2022)Math Augmentation: How Authors Enhance the Readability of Formulas using Novel Visual Design PracticesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501932(1-18)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501932
Matulic FVogel D(2022)Terrain Modelling with a Pen & Touch Tablet and Mid-Air Gestures in Virtual RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519867(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519867
Beaudouin-Lafon MXia H(2021)MathMap: Supporting Exploratory Problem Solving with AlgebraAdjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3474349.3480226(47-50)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3474349.3480226
Pfeuffer KDinc AObernolte JRivu RAbdrabou YShelter FAbdelrahman YAlt F(2021)Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on TabletsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474741(149-161)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474741
Sun JFoley MXu QLi CLi JIrani PLi W(2021)PenShaft: Enabling Pen Shaft Detection and Interaction for Touchscreens12th Augmented Human International Conference10.1145/3460881.3460934(1-9)Online publication date: 27-May-2021
https://dl.acm.org/doi/10.1145/3460881.3460934
Head ALo KKang DFok RSkjonsberg SWeld DHearst MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and SymbolsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445648(1-18)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445648
Saquib NKazi RWei LMark GRoy DKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Constructing Embodied Algebra by SketchingProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445460(1-16)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445460
Zhelezniakov DZaytsev VRadyvonenko O(2021)Online Handwritten Mathematical Expression Recognition and Applications: A SurveyIEEE Access10.1109/ACCESS.2021.30634139(38352-38373)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3063413
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents