demonstration

Beyond: collapsible input device for direct 3D manipulation beyond the screen

Authors:

Jinha Lee,

Surat Teerapittayanon,

Hiroshi IshiiAuthors Info & Claims

UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

Pages 393 - 394

https://doi.org/10.1145/1866218.1866236

Published: 03 October 2010 Publication History

Get Access

Abstract

What would it be like to reach into a screen and manipulate or design virtual objects as in real world? We present Beyond, a collapsible input device for direct 3D manipulation. When pressed against a screen, Beyond collapses in the physical world and extends into the digital space of the screen, such that users can perceive that they are inserting the tool into the virtual space. Beyond allows users to directly interact with 3D media, avoiding separation between the users' input and the displayed 3D graphics without requiring special glasses or wearables, thereby enabling users to select, draw, and sculpt in 3D virtual space unfettered. We describe detailed interaction techniques, implementation and application scenarios focused on 3D geometric design and prototyping.

Supplementary Material

JPG File (de159-lee.jpg)

Download
7.38 KB

MP4 File (de159-lee.mp4)

Download
37.43 MB

References

[1]

}}Reisman, J. L., Davidson, P. L., and Han, J. Y. 2009. A screen-space formulation for 2D and 3D direct manipulation. In ACM UIST '09. 69--78.

Digital Library

Google Scholar

[2]

}}Hancock, M., Hilliges, O., Collins, C., Baur, D., and Carpendale, S. 2009. Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table. In ACM ITS 09. 77--84.

Digital Library

Google Scholar

[3]

}}Grossman, T. and Balakrishnan, R. 2006. The design and evaluation of selection techniques for 3D volumetric displays. In ACM UIST '06. 3--12.

Digital Library

Google Scholar

[4]

}}Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. 2009. Interactions in the air: adding further depth to interactive tabletops. In ACM UIST '09. 139--148.

Digital Library

Google Scholar

[5]

}}Yokokohji, Y., Hollis, R. L., and Kanade, T. 1999. WYSIWYF Display: A Visual/Haptic Interface to Virtual Environment. Presence: Teleoper. Virtual Environ. 412--434.

Digital Library

Google Scholar

[6]

}}Lee, J. and Ishii, H. 2010. Beyond: collapsible tools and gestures for computational design. In ACM CHI EA '10. 3931--3936.

Digital Library

Google Scholar

[7]

}}Johnny Lee, http://johnnylee.net/projects/wi.

Google Scholar

[8]

}}Oblong, http://oblong.com.

Google Scholar

Cited By

View all

Chen ZHealey CAmant REisemann EBateman S(2017)Performance Characteristics of a Camera-Based Tangible Input Device for Manipulation of 3D InformationProceedings of the 43rd Graphics Interface Conference10.5555/3141475.3141492(74-81)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.5555/3141475.3141492
Lee DSon KLee JBae SMiller RBenko HLatulipe C(2012)PhantomPenProceedings of the 25th annual ACM symposium on User interface software and technology10.1145/2380116.2380159(331-340)Online publication date: 7-Oct-2012
https://dl.acm.org/doi/10.1145/2380116.2380159

Index Terms

Beyond: collapsible input device for direct 3D manipulation beyond the screen
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

TractorBeam: seamless integration of local and remote pointing for tabletop displays
GI '05: Proceedings of Graphics Interface 2005

This paper presents a novel interaction technique for tabletop computer displays. When using a direct input device such as a stylus, reaching objects on the far side of a table is difficult. While remote pointing has been investigated for large wall ...
Head-mounted display with mid-air tactile feedback
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

Virtual and physical worlds are merging. Currently users of head-mounted displays cannot have unobtrusive tactile feedback while touching virtual objects. We present a mid-air tactile feedback system for head-mounted displays. Our prototype uses the ...
Beyond: collapsible tools and gestures for computational design
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Since the invention of the personal computer, digital media has remained separate from the physical world, blocked by a rigid screen. In this paper, we present Beyond, an interface for 3-D design where users can directly manipulate digital media with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

October 2010

126 pages

ISBN:9781450304627

DOI:10.1145/1866218

General Chair:
Ken Perlin
New York University
,
Program Chairs:
Mary Czerwinski
Microsoft Research
,
Rob Miller
MIT CSAIL

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

UIST '10

Sponsor:

UIST '10: The 23nd Annual ACM Symposium on User Interface Software and Technology

October 3 - 6, 2010

New York, New York, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
686
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chen ZHealey CAmant REisemann EBateman S(2017)Performance Characteristics of a Camera-Based Tangible Input Device for Manipulation of 3D InformationProceedings of the 43rd Graphics Interface Conference10.5555/3141475.3141492(74-81)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.5555/3141475.3141492
Lee DSon KLee JBae SMiller RBenko HLatulipe C(2012)PhantomPenProceedings of the 25th annual ACM symposium on User interface software and technology10.1145/2380116.2380159(331-340)Online publication date: 7-Oct-2012
https://dl.acm.org/doi/10.1145/2380116.2380159

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

TractorBeam: seamless integration of local and remote pointing for tabletop displays

Head-mounted display with mid-air tactile feedback

Beyond: collapsible tools and gestures for computational design