More Web Proxy on the site http://driver.im/

research-article

Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets

Authors:

Abdullatif Dinc,

Yasmeen Abdrabou,

Franziska Shelter,

Yomna Abdelrahman,

Florian AltAuthors Info & Claims

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Pages 149 - 161

https://doi.org/10.1145/3472749.3474741

Published: 12 October 2021 Publication History

Abstract

Tablets are attractive for design work anywhere, but 3D manipulations are notoriously difficult. We explore how engaging the stylus and multi-touch in concert can render such tasks easier. We introduce Bi-3D, an interaction concept where touch gestures are combined with 2D pen commands for 3D manipulation. For example, for a fast and intuitive 3D drag & drop technique: the pen drags the object on-screen, and parallel pinch-to-zoom moves it in the third dimension. In this paper, we describe the Bi-3D design space, crossing two-handed input and the degrees-of-freedom (DOF) of 3D manipulation and navigation tasks. We demonstrate sketching and manipulation tools in a prototype 3D design application, where users can fluidly combine 3D operations through alternating and parallel use of the modalities. We evaluate the core technique, bi-manual 3DOF input, against widget and mid-air baselines in an object movement task. We find that Bi-3D is a fast and practical way for multi-dimensional manipulation of graphical objects, promising to facilitate 3D design on stylus and tablet devices.

Supplementary Material

MP4 File (p149-video_figure.mp4)

Video figure

Download
135.48 MB

MP4 File (p149-video_preview.mp4)

Video preview

Download
67.50 MB

References

[1]

Seok-Hyung Bae, Ravin Balakrishnan, and Karan Singh. 2008. ILoveSketch: As-natural-as-possible Sketching System for Creating 3D Curve Models. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (Monterey, CA, USA) (UIST ’08). ACM, New York, NY, USA, 151–160. https://doi.org/10.1145/1449715.1449740

Digital Library

[2]

Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and William Buxton. 1999. Digital Tape Drawing. In Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology (Asheville, North Carolina, USA) (UIST ’99). Association for Computing Machinery, New York, NY, USA, 161–169. https://doi.org/10.1145/320719.322598

Digital Library

[3]

Ravin Balakrishnan and Gordon Kurtenbach. 1999. Exploring Bimanual Camera Control and Object Manipulation in 3D Graphics Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Pittsburgh, Pennsylvania, USA) (CHI ’99). ACM, New York, NY, USA, 56–62. https://doi.org/10.1145/302979.302991

Digital Library

[4]

Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An In-air Pointing Technique to Manipulate Out-of-reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/2076354.2076357

Digital Library

[5]

Michel Beaudouin-Lafon and Henry Michael Lassen. 2000. The Architecture and Implementation of CPN2000, a Post-WIMP Graphical Application. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology(San Diego, California, USA) (UIST ’00). Association for Computing Machinery, New York, NY, USA, 181–190. https://doi.org/10.1145/354401.354761

[6]

Hrvoje Benko and Steven Feiner. 2007. Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. In 2007 IEEE symposium on 3D user interfaces(3D UI ’09). IEEE. https://doi.org/10.1109/3DUI.2007.340778

[7]

Peter Brandl, Clifton Forlines, Daniel Wigdor, Michael Haller, and Chia Shen. 2008. Combining and Measuring the Benefits of Bimanual Pen and Direct-touch Interaction on Horizontal Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (Napoli, Italy) (AVI ’08). ACM, New York, NY, USA, 154–161. https://doi.org/10.1145/1385569.1385595

Digital Library

[8]

Thomas Butkiewicz, Andrew H. Stevens, and Colin Ware. 2019. Multi-Touch 3D Positioning with the Pantograph Technique. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (Montreal, Quebec, Canada) (I3D ’19). Association for Computing Machinery, New York, NY, USA, Article 13, 9 pages. https://doi.org/10.1145/3306131.3317014

Digital Library

[9]

W. Buxton and B. Myers. 1986. A Study in Two-handed Input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’86). ACM, New York, NY, USA, 321–326. https://doi.org/10.1145/22627.22390

Digital Library

[10]

Drini Cami, Fabrice Matulic, Richard G. Calland, Brian Vogel, and Daniel Vogel. 2018. Unimanual Pen+Touch Input Using Variations of Precision Grip Postures. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 825–837. https://doi.org/10.1145/3242587.3242652

Digital Library

[11]

Xiang Cao and Ravin Balakrishnan. 2003. VisionWand: Interaction Techniques for Large Displays Using a Passive Wand Tracked in 3D. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada) (UIST ’03). Association for Computing Machinery, New York, NY, USA, 173–182. https://doi.org/10.1145/964696.964716

Digital Library

[12]

Jonathan M. Cohen, Lee Markosian, Robert C. Zeleznik, John F. Hughes, and Ronen Barzel. 1999. An Interface for Sketching 3D Curves. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D ’99). Association for Computing Machinery, New York, NY, USA, 17–21. https://doi.org/10.1145/300523.300655

Digital Library

[13]

Philip L. Davidson and Jefferson Y. Han. 2008. Extending 2D Object Arrangement with Pressure-Sensitive Layering Cues. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology(Monterey, CA, USA) (UIST ’08). Association for Computing Machinery, New York, NY, USA, 87–90. https://doi.org/10.1145/1449715.1449730

[14]

Bruno R. De Araùjo, Géry Casiez, and Joaquim A. Jorge. 2012. Mockup Builder: Direct 3D Modeling on and above the Surface in a Continuous Interaction Space. In Proceedings of Graphics Interface 2012 (Toronto, Ontario, Canada) (GI ’12). Canadian Information Processing Society, CAN, 173–180.

[15]

Julie Dorsey, Songhua Xu, Gabe Smedresman, Holly Rushmeier, and Leonard McMillan. 2007. The Mental Canvas: A Tool for Conceptual Architectural Design and Analysis. In Proceedings of the 15th Pacific Conference on Computer Graphics and Applications(PG ’07). IEEE Computer Society, Washington, DC, USA, 201–210. https://doi.org/10.1109/PG.2007.62

Digital Library

[16]

Tomas Dorta, Gokce Kinayoglu, and Michael Hoffmann. 2014. Hyve-3D: A New Embodied Interface for Immersive Collaborative 3D Sketching. In ACM SIGGRAPH 2014 Studio (Vancouver, Canada) (SIGGRAPH ’14). Association for Computing Machinery, New York, NY, USA, Article 37, 1 pages. https://doi.org/10.1145/2619195.2656325

Digital Library

[17]

Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Trans. Graph. 28, 5 (Dec. 2009), 1–9. https://doi.org/10.1145/1618452.1618494

Digital Library

[18]

Yves Guiard. 1987. Asymmetric Division of Labor in Human Skilled Bimanual Action: The Kinematic Chain as a Model. In Journal of Motor Behavior, Vol. 19. 486–517.

[19]

Mark Hancock, Sheelagh Carpendale, and Andy Cockburn. 2007. Shallow-Depth 3d Interaction: Design and Evaluation of One-, Two- and Three-Touch Techniques. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1147–1156. https://doi.org/10.1145/1240624.1240798

Digital Library

[20]

Mark Hancock, Thomas ten Cate, and Sheelagh Carpendale. 2009. Sticky Tools: Full 6DOF Force-Based Interaction for Multi-Touch Tables. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS ’09). Association for Computing Machinery, New York, NY, USA, 133–140. https://doi.org/10.1145/1731903.1731930

Digital Library

[21]

Rorik Henrikson, Bruno De Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016. Storeoboard: Sketching Stereoscopic Storyboards. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 4587–4598. https://doi.org/10.1145/2858036.2858079

Digital Library

[22]

Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + Touch = New Tools. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). ACM, New York, NY, USA, 27–36. https://doi.org/10.1145/1866029.1866036

Digital Library

[23]

Stephanie Houde. 1992. Iterative Design of an Interface for Easy 3-D Direct Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Monterey, California, USA) (CHI ’92). Association for Computing Machinery, New York, NY, USA, 135–142. https://doi.org/10.1145/142750.142772

Digital Library

[24]

Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques(SIGGRAPH ’99). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 409–416. https://doi.org/10.1145/311535.311602

Digital Library

[25]

Robert J. K. Jacob, Linda E. Sibert, Daniel C. McFarlane, and M. Preston Mullen, Jr.1994. Integrality and Separability of Input Devices. ACM Trans. Comput.-Hum. Interact. 1, 1 (March 1994), 3–26. https://doi.org/10.1145/174630.174631

Digital Library

[26]

Kiia Kallio. 2005. 3D6B Editor: Projective 3D Sketching with Line-Based Rendering. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, Joaquim Armando Pires Jorge and Takeo Igarashi (Eds.). The Eurographics Association. https://doi.org/10.2312/SBM/SBM05/073-079

[27]

Yongkwan Kim, Sang-Gyun An, Joon Hyub Lee, and Seok-Hyung Bae. 2018. Agile 3D Sketching with Air Scaffolding. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, New York, NY, USA, Article 238, 12 pages. https://doi.org/10.1145/3173574.3173812

Digital Library

[28]

Kenrick Kin, Maneesh Agrawala, and Tony DeRose. 2009. Determining the Benefits of Direct-Touch, Bimanual, and Multifinger Input on a Multitouch Workstation. In Proceedings of Graphics Interface 2009 (Kelowna, British Columbia, Canada) (GI ’09). Canadian Information Processing Society, CAN, 119–124.

Digital Library

[29]

Sebastian Knoedel and Martin Hachet. 2011. Multi-Touch RST in 2D and 3D Spaces: Studying the Impact of Directness on User Performance. In Proceedings of the 2011 IEEE Symposium on 3D User Interfaces(3DUI ’11). IEEE Computer Society, USA, 75–78.

[30]

P. Lapides, E. Sharlin, M. C. Sousa, and L. Streit. 2006. The 3D Tractus: a three-dimensional drawing board. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP ’06). 8 pp.–.

[31]

Celine Latulipe, Craig S. Kaplan, and Charles L. A. Clarke. 2005. Bimanual and Unimanual Image Alignment: An Evaluation of Mouse-Based Techniques. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, USA) (UIST ’05). Association for Computing Machinery, New York, NY, USA, 123–131. https://doi.org/10.1145/1095034.1095057

[32]

Celine Latulipe, Stephen Mann, Craig S. Kaplan, and Charlie L. A. Clarke. 2006. SymSpline: Symmetric Two-Handed Spline Manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). Association for Computing Machinery, New York, NY, USA, 349–358. https://doi.org/10.1145/1124772.1124825

[33]

Jinha Lee and Hiroshi Ishii. 2010. Beyond: Collapsible Tools and Gestures for Computational Design. In CHI ’10 Extended Abstracts on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI EA ’10). Association for Computing Machinery, New York, NY, USA, 3931–3936. https://doi.org/10.1145/1753846.1754081

[34]

Jingbo Liu, Oscar Kin-Chung Au, Hongbo Fu, and Chiew-Lan Tai. 2012. Two-Finger Gestures for 6DOF Manipulation of 3D Objects. Comput. Graph. Forum 31, 7pt1 (Sept. 2012), 2047–2055. https://doi.org/10.1111/j.1467-8659.2012.03197.x

Digital Library

[35]

Pedro Lopes, Daniel Mendes, Bruno Araújo, and Joaquim A. Jorge. 2011. Combining Bimanual Manipulation and Pen-based Input for 3D Modelling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling (Vancouver, British Columbia, Canada) (SBIM ’11). ACM, New York, NY, USA, 15–22. https://doi.org/10.1145/2021164.2021168

Digital Library

[36]

Sylvain Malacria, Eric Lecolinet, and Yves Guiard. 2010. Clutch-Free Panning and Integrated Pan-Zoom Control on Touch-Sensitive Surfaces: The Cyclostar Approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 2615–2624. https://doi.org/10.1145/1753326.1753724

Digital Library

[37]

Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2010. The design and evaluation of 3d positioning techniques for multi-touch displays. In 2010 IEEE symposium on 3D user interfaces (3DUI). IEEE, 115–118.

Digital Library

[38]

Anthony Martinet, Géry Casiez, and Laurent Grisoni. 2010. The Effect of DOF Separation in 3D Manipulation Tasks with Multi-Touch Displays. In Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology (Hong Kong) (VRST ’10). Association for Computing Machinery, New York, NY, USA, 111–118. https://doi.org/10.1145/1889863.1889888

Digital Library

[39]

Anthony Martinet, Gery Casiez, and Laurent Grisoni. 2012. Integrality and Separability of Multitouch Interaction Techniques in 3D Manipulation Tasks. IEEE Transactions on Visualization and Computer Graphics 18, 3 (March 2012), 369–380. https://doi.org/10.1109/TVCG.2011.129

Digital Library

[40]

Fabrice Matulic and Moira Norrie. 2012. Empirical Evaluation of Uni- and Bimodal Pen and Touch Interaction Properties on Digital Tabletops. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). ACM, New York, NY, USA, 143–152. https://doi.org/10.1145/2396636.2396659

Digital Library

[41]

Fabrice Matulic and Moira C. Norrie. 2013. Pen and Touch Gestural Environment for Document Editing on Interactive Tabletops. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). ACM, New York, NY, USA, 41–50. https://doi.org/10.1145/2512349.2512802

Digital Library

[42]

Daniel Mendes, Fabio Marco Caputo, Andrea Giachetti, Alfredo Ferreira, and J Jorge. 2019. A survey on 3d virtual object manipulation: From the desktop to immersive virtual environments. In Computer graphics forum, Vol. 38. Wiley Online Library, 21–45.

[43]

D. Mendes, F. Fonseca, B. Araùjo, A. Ferreira, and J. Jorge. 2014. Mid-air interactions above stereoscopic interactive tables. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). 3–10. https://doi.org/10.1109/3DUI.2014.6798833

[44]

M. Nebeling and M. Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 333–337. https://doi.org/10.1109/ISMAR-Adjunct.2018.00098

[45]

Dan R. Olsen and Travis Nielsen. 2001. Laser Pointer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’01). ACM, New York, NY, USA, 17–22. https://doi.org/10.1145/365024.365030

Digital Library

[46]

J. Karen Parker, Regan L. Mandryk, and Kori M. Inkpen. 2005. TractorBeam: Seamless Integration of Local and Remote Pointing for Tabletop Displays. In Proceedings of Graphics Interface 2005 (Victoria, British Columbia) (GI ’05). Canadian Human-Computer Communications Society, Waterloo, CAN, 33–40.

[47]

Ken Pfeuffer, Jason Alexander, Ming Ki Chong, and Hans Gellersen. 2014. Gaze-Touch: Combining Gaze with Multi-Touch for Interaction on the Same Surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 509–518. https://doi.org/10.1145/2642918.2647397

Digital Library

[48]

Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. Partially-indirect Bimanual Input with Gaze, Pen, and Touch for Pan, Zoom, and Ink Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, New York, NY, USA, 2845–2856. https://doi.org/10.1145/2858036.2858201

Digital Library

[49]

Ken Pfeuffer, Ken Hinckley, Michel Pahud, and Bill Buxton. 2017. Thumb + Pen Interaction on Tablets. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 3254–3266. https://doi.org/10.1145/3025453.3025567

Digital Library

[50]

Jason L. Reisman, Philip L. Davidson, and Jefferson Y. Han. 2009. A Screen-Space Formulation for 2D and 3D Direct Manipulation. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST ’09). Association for Computing Machinery, New York, NY, USA, 69–78. https://doi.org/10.1145/1622176.1622190

Digital Library

[51]

Hugo Romat, Emmanuel Pietriga, Nathalie Henry-Riche, Ken Hinckley, and Caroline Appert. 2019. SpaceInk: Making Space for In-Context Annotations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 871–882. https://doi.org/10.1145/3332165.3347934

Digital Library

[52]

Emanuel Sachs, Andrew Roberts, and David Stoops. 1991. 3-Draw: A Tool for Designing 3D Shapes. IEEE Comput. Graph. Appl. 11, 6 (Nov. 1991), 18–26. https://doi.org/10.1109/38.103389

Digital Library

[53]

Ken Shoemake. 1992. ARCBALL: A User Interface for Specifying Three-Dimensional Orientation Using a Mouse. In Proceedings of the Conference on Graphics Interface ’92 (Vancouver, British Columbia, Canada). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 151–156. https://doi.org/10.5555/155294.155312

Digital Library

[54]

Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376782

Digital Library

[55]

Sven Strothoff, Dimitar Valkov, and Klaus Hinrichs. 2011. Triangle Cursor: Interactions with Objects above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). Association for Computing Machinery, New York, NY, USA, 111–119. https://doi.org/10.1145/2076354.2076377

Digital Library

[56]

Mental Canvas Authoring System. Accessed 7 April, 2021. Mental Canvas Authoring System. http://www.mentalcanvas.com.

[57]

Robert Wang, Sylvain Paris, and Jovan Popović. 2011. 6D Hands: Markerless Hand-Tracking for Computer Aided Design. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). Association for Computing Machinery, New York, NY, USA, 549–558. https://doi.org/10.1145/2047196.2047269

Digital Library

[58]

Andrew M. Webb, Andruid Kerne, Zach Brown, Jun-Hyun Kim, and Elizabeth Kellogg. 2016. LayerFish: Bimanual Layering with a Fisheye In-Place. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS ’16). Association for Computing Machinery, New York, NY, USA, 189–198. https://doi.org/10.1145/2992154.2992171

Digital Library

[59]

Daniel Wigdor, Hrvoje Benko, John Pella, Jarrod Lombardo, and Sarah Williams. 2011. Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, New York, NY, USA, 1581–1590. https://doi.org/10.1145/1978942.1979173

Digital Library

[60]

Christian Winkler, Ken Pfeuffer, and Enrico Rukzio. 2012. Investigating Mid-air Pointing Interaction for Projector Phones. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (Cambridge, Massachusetts, USA) (ITS ’12). ACM, New York, NY, USA, 85–94. https://doi.org/10.1145/2396636.2396650

Digital Library

[61]

Anusha Withana, Makoto Kondo, Yasutoshi Makino, Gota Kakehi, Maki Sugimoto, and Masahiko Inami. 2011. ImpAct: Immersive Haptic Stylus to Enable Direct Touch and Manipulation for Surface Computing. Comput. Entertain. 8, 2, Article 9 (Dec. 2011), 16 pages. https://doi.org/10.1145/1899687.1899691

[62]

Siju Wu, Amine Chellali, Samir Otmane, and Guillaume Moreau. 2015. TouchSketch: A Touch-based Interface for 3D Object Manipulation and Editing. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (Beijing, China) (VRST ’15). ACM, New York, NY, USA, 59–68. https://doi.org/10.1145/2821592.2821606

Digital Library

[63]

Haijun Xia, Ken Hinckley, Michel Pahud, Xiao Tu, and Bill Buxton. 2017. WritLarge: Ink Unleashed by Unified Scope, Action, & Zoom. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). ACM, New York, NY, USA, 3227–3240. https://doi.org/10.1145/3025453.3025664

Digital Library

[64]

Min Xin, Ehud Sharlin, and Mario Costa Sousa. 2008. Napkin Sketch: Handheld Mixed Reality 3D Sketching. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 223–226. https://doi.org/10.1145/1450579.1450627

Digital Library

[65]

Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Trans. Graph. 33, 4, Article 131 (July 2014), 13 pages. https://doi.org/10.1145/2601097.2601128

Digital Library

[66]

Ka-Ping Yee. 2004. Two-Handed Interaction on a Tablet Display. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria) (CHI EA ’04). Association for Computing Machinery, New York, NY, USA, 1493–1496. https://doi.org/10.1145/985921.986098

[67]

Dongwook Yoon, Nicholas Chen, and François Guimbretière. 2013. TextTearing: Opening White Space for Digital Ink Annotation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). ACM, New York, NY, USA, 107–112. https://doi.org/10.1145/2501988.2502036

Digital Library

[68]

Dongwook Yoon, Nicholas Chen, François Guimbretière, and Abigail Sellen. 2014. RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document Review. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 481–490. https://doi.org/10.1145/2642918.2647390

Digital Library

[69]

Robert Zeleznik, Andrew Bragdon, Ferdi Adeputra, and Hsu-Sheng Ko. 2010. Hands-on Math: A Page-based Multi-touch and Pen Desktop for Technical Work and Problem Solving. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). ACM, New York, NY, USA, 17–26. https://doi.org/10.1145/1866029.1866035

Digital Library

Cited By

Shimada YHan CHautasaari ANaemura T(2024)A Plane-Assisted Method for Efficient 3D Arrangement of Computer-Generated ObjectsCGオブジェクトを効率的に3次元配置するための平面補助手法の研究The Journal of The Institute of Image Information and Television Engineers10.3169/itej.78.59278:5(592-597)Online publication date: 2024
https://doi.org/10.3169/itej.78.592
Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Lim CLee SLee G(2024)DualPad: Exploring Non-Dominant Hand Interaction on Dual-Screen Laptop TouchpadsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686751(1-4)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686751
Show More Cited By

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Video Interaction on Tablet Computers: Browsing with Pinch Gesture and Pen Tilt
MUM '22: Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia

Digital video technologies have been changing dramatically in the field of media production but reduced the tangibility of working with film. One interesting approach to get back such tangibility in digital systems is using pen and touch interactions. ...
Exploring and Understanding Unintended Touch during Direct Pen Interaction

The user experience on tablets that support both touch and styli is less than ideal, due in large part to the problem of unintended touch or palm rejection. Devices are often unable to distinguish between intended touch (i.e., interaction on the screen ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 2021

1357 pages

ISBN:9781450386357

DOI:10.1145/3472749

Editors:
Jeffrey Nichols
Apple, USA
,
Ranjitha Kumar
UIUC, USA
,
Michael Nebeling
University of Michigan, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

dtec.bw ? Digitalization and Technology Research Center of the Bundeswehr
German Research Foundation (DFG)

Conference

UIST '21

Sponsor:

UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

October 10 - 14, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
641
Total Downloads

Downloads (Last 12 months)107
Downloads (Last 6 weeks)5

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shimada YHan CHautasaari ANaemura T(2024)A Plane-Assisted Method for Efficient 3D Arrangement of Computer-Generated ObjectsCGオブジェクトを効率的に3次元配置するための平面補助手法の研究The Journal of The Institute of Image Information and Television Engineers10.3169/itej.78.59278:5(592-597)Online publication date: 2024
https://doi.org/10.3169/itej.78.592
Takeyama YNagayama KChoi MShizuki B(2024)PhoneCanvas: 3D Sketching System Using a Depth Camera-Equipped Smartphone as a CanvasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682078(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682078
Lim CLee SLee G(2024)DualPad: Exploring Non-Dominant Hand Interaction on Dual-Screen Laptop TouchpadsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686751(1-4)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686751
Fender AKari M(2024)OptiBasePen: Mobile Base+Pen Input on Passive Surfaces by Sensing Relative Base Motion Plus Close-Range Pen PositionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676467(1-9)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676467
Ma XYan ZMeng HCao ZJin YWang Z(2024)Get Your Hands Dirty? A Comparative Study of Tool Usage and Perceptual Engagement in Physical and Digital SculptingProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656188(358-373)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656188
Tan XHe ZLiu CFan MLuo TLiu ZTian MHan TTian F(2024)WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642047(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642047
Liu CDai CMa QMehra BCassinelli A(2022)AngleCAD: Surface-Based 3D Modelling Techniques on Foldable TouchscreensProceedings of the ACM on Human-Computer Interaction10.1145/35677356:ISS(592-616)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567735

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents