More Web Proxy on the site http://driver.im/

research-article

Multi-touch techniques for exploring large-scale 3D astrophysical simulations

Authors:

Junxiang Allen NgAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2213 - 2222

https://doi.org/10.1145/1753326.1753661

Published: 10 April 2010 Publication History

Abstract

Enabling efficient exploration of large-scale virtual environments such as those simulating astrophysical environments is highly challenging. Astrophysical virtual worlds span exceptionally large spatial scales occupied mostly by empty space, and this makes it difficult for the user to comprehend the spatial context during exploratory navigation. Public exhibits, where novice users have little experience using complicated virtual navigation interfaces, pose additional challenges.

To address these issues, we propose multi-touch techniques to deliver an effective interface to navigate the unique features of large-scale 3D environments such as astrophysical simulations. In this work, we carefully study conventional multi-touch methods and adapt them to the practical requirements of this application. A novel technique called the powers-of-ten ladder is introduced to support efficient movement across huge spatial scales using multi-touch interactions. We also investigate user experiences with various multi-touch finger gestures on our prototype digital planetarium.

Supplementary Material

JPG File (p2213.jpg)

Download
15.79 KB

WMV File (p2213.wmv)

Download
19.63 MB

References

[1]

Apple's iPhone, 2007. http://www.apple.com/iphone

[2]

Microsoft Surface, 2007. SIGGRAPH 2007 Emerging Technologies.

[3]

G. Bell, R. Carey, and C. Marrin. The Virtual Reality Modeling Language (VRML), version 2.0, 1996.

[4]

H. Benko, A. D. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. CHI '06: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1263--1272, 2006.

Digital Library

[5]

G. Blasko and S. Feiner. Single-handed interaction techniques for multiple pressure-sensitive strips. CHI '04 extended abstracts on Human factors in computing systems, pages 1461--1464, 2004.

Digital Library

[6]

B. Buxton. Multitouch systems that I have known and loved, 2008. http://www.billbuxton.com/multitouchOverview.html.

[7]

W. Buxton, R. Hill, and P. Rowley. Issues and techniques in touch-sensitive tablet input. Proceedings of SIGGRAPH 85, pages 215--224, 1985.

Digital Library

[8]

C. and R. Eames. Powers of Ten, 1977. 9 1/2 minute film, made for IBM.

[9]

S.H.-H. Chang, L. Stuart, B. Plimmer, and B. Wunsche. Origami simulator: a multi-touch experience. CHI extended abstracts 2009, pages 3889--3894, 2009.

Digital Library

[10]

R.P. Darken. Wayfinding in large-scale virtual worlds. CHI '95: Conference companion on Human factors in computing systems, pages 45--46, 1995.

Digital Library

[11]

J.-B. de la Riviere, C. Kervegant, E. Orvain, and N. Dittlo. CubTile: a multi-touch cubic interface. Proceedings of the 2008 ACM symposium on Virtual Reality Software and Technology, pages 69--72, 2008.

Digital Library

[12]

P. Dietz and D. Leigh. DiamondTouch: A multi-user touch technology. UIST '01: ACM symposium on User Interface Software and Technology, pages 219--226, 2001.

Digital Library

[13]

J. Edelmann, A. Schilling, and S. Fleck. The DabR -- a multitouch system for intuitive 3D scene navigation. 3DTV Conference: The True Vision -- Capture, Transmission and Display of 3D Video, pages 1--4, 2009.

[14]

J. Eden. Designing for multi-touch, multi-user and gesture-based systems, 2009. http://www.ddj.com/architect/216402697.

[15]

A. Esenther, C. Forlines, K. Ryall, and S. Shipman. DiamondTouch SDK: Support for multi-user, multi-touch applications, 2002. http://www.merl.com/projects/dtsdk/.

[16]

A. Esenther and K. Wittenburg. Multi-user multi-touch games on DiamondTouch with the DTFlash toolkit. Intelligent Technologies for Interactive Entertainment (INTETAIN), Nov 2005. MERL Report: TR2005-105.

Digital Library

[17]

European Space Agency. The Hipparcos and Tycho Catalogues, ESA SP-1200, 1997. Available at http://www.rssd.esa.int/Hipparcos/catalog.html.

[18]

G.W. Fitzmaurice, H. Ishii, and W. Buxton. Bricks: Laying the foundations for graspable user interfaces. CHI '95: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 442--449, 1995.

Digital Library

[19]

C. Forlines and C. Shen. DTLens: multi-user tabletop spatial data exploration. UIST '05: ACM symposium on User Interface Software and Technology, pages 119--122, 2005.

Digital Library

[20]

C.-W. Fu and A.J. Hanson. A transparently scalable visualization architecture for exploring the universe. IEEE Transactions on Visualization and Computer Graphics, 13(1):108--121, 2007.

Digital Library

[21]

T. Grossman, D. Wigdor, and R. Balakrishnan. Multi-finger gestural interaction with 3D volumetric displays. UIST '04: ACM symposium on User Interface Software and Technology, pages 61--70, 2004.

Digital Library

[22]

J.Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. UIST '05: ACM symposium on User Interface Software and Technology, pages 115--118, 2005.

Digital Library

[23]

A.J. Hanson. The rolling ball. In D. Kirk, editor, Graphics Gems III, pages 51--60. Academic Press, Cambridge, MA, 1992.

Digital Library

[24]

T. Igarashi, T. Moscovich, and J.F. Hughes. As-rigid-as-possible shape manipulation. ACM Transactions on Computer Graphics, 24(3):1134--1141, 2005. ACM SIGGRAPH 2005.

Digital Library

[25]

Jet Propulsion Laboratory, NASA. Planetary data system, 2003. Website: http://pds.jpl.nasa.gov.

[26]

Y. Jung, J. Keil, J. Behr, S. Webel, M. Zollner, T. Engelke, H. Wuest, and M. Becker. Adapting X3D for multi-touch environments. Web3D '08: Proceedings of the 13th international symposium on 3D web technology, pages 27--30, 2008.

Digital Library

[27]

J.-S. Kim, D. Gracanin, K. Matkovic, and F. Quek. iPhone/iPod touch as input devices for navigation in immersive virtual environments. IEEE Virtual Reality 2009, pages 261--262, 2009.

Digital Library

[28]

S. Lee, W. Buxton, and K.C. Smith. A multi-touch three dimensional touch-sensitive tablet. SIGCHI Bulletin, 16(4):21--25, 1985.

Digital Library

[29]

A. Leganchuk, S. Zhai, and W. Buxton. Manual and cognitive benefits of two-handed input: an experimental study. ACM Transactions on Human-Computer Interaction, 5(4):326--359, 1998.

Digital Library

[30]

Y. Li, C.-W. Fu, and A.J. Hanson. Scalable WIM: Effective exploration in large-scale astrophysical environments. IEEE Transactions on Visualization and Computer Graphics, 12(5):1005--1012, 2006.

Digital Library

[31]

N. Mehta. A flexible machine interface. Master's thesis, Dept. of Electrical Eng., University of Toronto, 1982.

[32]

T. Moscovich. Multi-touch interaction. CHI '06 extended abstracts on Human factors in computing systems, pages 1775--1778, 2006.

Digital Library

[33]

NUI Group Community. Community Core Vision (CCV) software, 2008. Website: http://ccv.nuigroup.com/.

[34]

R. Pausch, T. Burnette, D. Brockway, and M.E. Weiblen. Navigation and locomotion in virtual worlds via flight into hand-held miniatures. SIGGRAPH '95 Proceedings, pages 399--400, 1995.

Digital Library

[35]

P. Peltonen, E. Kurvinen, A. Salovaara, G. Jacucci, T. Ilmonen, J. Evans, A. Oulasvirta, and P. Saarikko. It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre. CHI '08: Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pages 1285--1294, 2008.

Digital Library

[36]

M.A.C. Perryman et al (editor). The Hipparcos and Tycho Catalogues. ESA Publications Division, The Netherlands, 1997.

[37]

J.S. Pierce and R. Pausch. Navigation with place representations and visible landmarks. IEEE Virtual Reality '04, pages 173--180, 2004.

Digital Library

[38]

J.L. Reisman, P.L. Davidson, and J.Y. Han. A screen-space formulation for 2D and 3D direct manipulation. UIST '09: ACM symposium on User Interface Software and Technology, pages 69--78, 2009.

Digital Library

[39]

J. Rekimoto. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 113--120, 2002.

Digital Library

[40]

F. Steinicke, K.H. Hinrichs, J. Schoning, and A. Kruger. Multi-touching 3D data: Towards direct interaction in stereoscopic display environments coupled with mobile devices. Advanced Visual Interfaces (AVI) Workshop on Designing Multi-Touch Interaction Techniques for Coupled Public and Private Displays, pages 46--49, 2008.

[41]

R. Stoakley, M.J. Conway, and R. Pausch. Virtual reality on a WIM: interactive worlds in miniature. CHI 95': Proceedings of the SIGCHI conference on Human factors in computing systems, pages 265--272, 1995.

Digital Library

[42]

F. Wang, X. Cao, X. Ren, and P. Irani. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. UIST 09': ACM symposium on User Interface Software and Technology, pages 23--32, 2009.

Digital Library

[43]

F. Wang and X. Ren. Empirical evaluation for finger input properties in multi-touch interaction. CHI '09: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1063--1072, 2009.

Digital Library

[44]

P. Wellner. The DigitalDesk Calculator: Tangile manipulation on a desk top display. UIST '91: ACM symposium on User Interface Software and Technology, pages 27--33, 1991.

Digital Library

[45]

W. Westerman, J.G. Elias, and A. Hedge. Multi-touch: A new tactile 2-D gesture interface for human-computer interaction. Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, pages 632--636, 2001.

[46]

M. Wu and R. Balakrishnan. Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. UIST 03': ACM symposium on User Interface Software and Technology, pages 193--202, 2003.

Digital Library

[47]

W. Yee. Potential limitations of multi-touch gesture vocabulary: Differentiation, adoption, fatigue. HCI (2), Lecture Notes in Computer Science, pages 291--300. Springer, 2009.

Digital Library

Cited By

Yeo AKwok BJoshna AChen KLee J(2024)Entering the Next Dimension: A Review of 3D User Interfaces for Virtual RealityElectronics10.3390/electronics1303060013:3(600)Online publication date: 1-Feb-2024
https://doi.org/10.3390/electronics13030600
Konopatzki GGuerino GValentim N(2023)Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation TechnologyProceedings of the XIX Brazilian Symposium on Information Systems10.1145/3592813.3592920(317-324)Online publication date: 29-May-2023
https://dl.acm.org/doi/10.1145/3592813.3592920
Brossier MSkånberg RBesançon LLinares MIsenberg TYnnerman ABock A(2023)MoliverseComputers and Graphics10.1016/j.cag.2023.02.006112:C(22-30)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.02.006
Show More Cited By

Index Terms

Multi-touch techniques for exploring large-scale 3D astrophysical simulations
1. Applied computing
  1. Physical sciences and engineering
    1. Astronomy
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Multi-touch interaction for tasking robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction

The objective is to develop a mobile human-robot interface that is optimized for multi-touch input. Our existing interface was designed for mouse and keyboard input and was later adopted for voice and touch interaction. A new multi-touch interface ...
Bimanual Interaction with Interscopic Multi-Touch Surfaces
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Multi-touch interaction has received considerable attention in the last few years, in particular for natural two-dimensional (2D) interaction. However, many application areas deal with three-dimensional (3D) data and require intuitive 3D interaction ...
Combining bimanual interaction and teleportation for 3D manipulation on multi-touch wall-sized displays
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

While multi-touch devices are well established in our everyday life, they are currently becoming larger and larger. Large screens such as wall-sized displays are now equipped with multi-touch capabilities. Multi-touch wall-sized displays will become ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
2,322
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yeo AKwok BJoshna AChen KLee J(2024)Entering the Next Dimension: A Review of 3D User Interfaces for Virtual RealityElectronics10.3390/electronics1303060013:3(600)Online publication date: 1-Feb-2024
https://doi.org/10.3390/electronics13030600
Konopatzki GGuerino GValentim N(2023)Proposal and Preliminary Evaluation of a Usability and UX Multi-Touch Evaluation TechnologyProceedings of the XIX Brazilian Symposium on Information Systems10.1145/3592813.3592920(317-324)Online publication date: 29-May-2023
https://dl.acm.org/doi/10.1145/3592813.3592920
Brossier MSkånberg RBesançon LLinares MIsenberg TYnnerman ABock A(2023)MoliverseComputers and Graphics10.1016/j.cag.2023.02.006112:C(22-30)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.cag.2023.02.006
Filho GGuerino GValentim NSantos CBento Villela MRios da Hora Rodrigues Kde Gois Ribeiro Darin T(2022)A systematic mapping study on usability and user eXperience evaluation of multi-touch systemsProceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems10.1145/3554364.3559131(1-12)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3554364.3559131
Sereno MBesançon LIsenberg T(2022)Point specification in collaborative visualization for 3D scalar fields using augmented realityVirtual Reality10.1007/s10055-021-00614-226:4(1317-1334)Online publication date: 18-Feb-2022
https://doi.org/10.1007/s10055-021-00614-2
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Yu LOuwerling JSvetachov Pvan Hoesel Fvan Ooijen PKosinka J(2021)VeLight: A 3D virtual reality tool for CT-based anatomy teaching and trainingJournal of Visualization10.1007/s12650-021-00790-y25:2(293-306)Online publication date: 7-Oct-2021
https://doi.org/10.1007/s12650-021-00790-y
Wang XBesançon LRousseau DSereno MAmmi MIsenberg TBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis ToolsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376657(1-13)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376657
Ricca AChellali AOtmane S(2020)Comparing touch-based and head-tracking navigation techniques in a virtual reality biopsy simulatorVirtual Reality10.1007/s10055-020-00445-7Online publication date: 7-Jun-2020
https://doi.org/10.1007/s10055-020-00445-7
Butkiewicz TStevens AWare CAndrews STatarchuk N(2019)Multi-touch 3D positioning with the pantograph techniqueProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/3306131.3317014(1-9)Online publication date: 21-May-2019
https://dl.acm.org/doi/10.1145/3306131.3317014
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten