Work in Progress

A Tabletop Projector-camera System for Remote and Nearby Pointing Operation

Authors:

Shun Sekiguchi,

Takashi KomuroAuthors Info & Claims

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Pages 1621 - 1626

https://doi.org/10.1145/2702613.2732731

Published: 18 April 2015 Publication History

Get Access

Abstract

In this paper, we propose a pointing interface that can be easily installed and that enables remote and nearby operations with high recognition accuracy. We use a system put on a table consisting of multiple projectors and depth cameras. The system projects a shared screen and a personal screen per each user on a projection screen and on a table respectively and enables interaction according to the user's hand motion. A personal screen can be operated by touch operations and a shared screen can be operated by pointing with fingers. Touch and pointing direction are recognized from the depth image and the confidence map obtained by a depth camera. We developed an early prototype system for verification and implemented a presentation application that supports collaborative work to the system. This application allows a user to move a window between the shared screen and the personal screen and to perform various operations on the slides.

References

[1]

Banerjee, A., Burstyn, J., Girouard, A., and Vertegaal, R. Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (2011), 11--20.

Digital Library

Google Scholar

[2]

Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: wearable multitouch interaction everywhere. In Proceedings of the 24th annual ACM symposium on User interface software and technology (2011), 441--450.

Digital Library

Google Scholar

[3]

Isenberg, P., Fisher, D., Paul, S. A., Morris, M. R., Inkpen, K., and Czerwinski, M. Co-located collaborative visual analytics around a tabletop display. Visualization and Computer Graphics, IEEE Transactions on 18, 5 (2012), 689--702.

Digital Library

Google Scholar

[4]

Morris, M. R., Lombardo, J., and Wigdor, D. Wesearch: supporting collaborative search and sensemaking on a tabletop display. In Proceedings of the 2010 ACM conference on Computer supported cooperative work (2010), 401--410.

Digital Library

Google Scholar

[5]

Robinson, S., Jones, M., Vartiainen, E., and Marsden, G. Picotales: collaborative authoring of animated stories using handheld projectors. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (2012), 671--680.

Digital Library

Google Scholar

[6]

Wilson, A. D. Playanywhere: a compact interactive tabletop projection-vision system. In Proceedings of the 18th annual ACM symposium on User interface software and technology (2005), 83--92.

Digital Library

Google Scholar

[7]

Wilson, A. D. Using a depth camera as a touch sensor. In International Conference on Interactive Tabletops and Surfaces (2010), 69--72.

Digital Library

Google Scholar

[8]

Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (2010), 273--282.

Digital Library

Google Scholar

Cited By

View all

Das S(2021)A data-set and a method for pointing direction estimation from depth images for human-robot interaction and VR applications2021 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48506.2021.9561143(11485-11491)Online publication date: 30-May-2021
https://dl.acm.org/doi/10.1109/ICRA48506.2021.9561143
Das SMakedon F(2020)Real time direction estimation for pointing interactions using a depth sensor and a nine axis inertial motion unitProceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3389189.3392618(1-10)Online publication date: 30-Jun-2020
https://dl.acm.org/doi/10.1145/3389189.3392618
Das S(2018)Precise Pointing Direction Estimation using Depth Data2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2018.8525712(202-207)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1109/ROMAN.2018.8525712

Index Terms

A Tabletop Projector-camera System for Remote and Nearby Pointing Operation
1. Human-centered computing

Recommendations

Vision-enhanced Immersive Interaction and Remote Collaboration with Large Touch Displays
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

Large displays are becoming commodity, and more and more, they are touch-enabled. In this keynote, we describe a system called ViiBoard (Vision-enhanced Immersive Interaction with touch Board) that enables natural interaction and immersive remote ...
Mediating Group Dynamics through Tabletop Interface Design

A Stanford University research group explores how design alternatives for tabletop interfaces can impact group dynamics to promote effective teamwork. They built and evaluated a series of novel prototypes that explore Multi-User Coordination Policies ...
A Tabletop System Using an OmniDirectional Projector-Camera
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

We propose an omnidirectional projection system embedding a projector with an ultra wide-angle lens in the table. AR markers are attached on the target surfaces so that the system can track them with an omnidirectional camera. Finally, we developed a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

April 2015

2546 pages

ISBN:9781450331463

DOI:10.1145/2702613

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI EA '15 Paper Acceptance Rate 379 of 1,520 submissions, 25%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Das S(2021)A data-set and a method for pointing direction estimation from depth images for human-robot interaction and VR applications2021 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA48506.2021.9561143(11485-11491)Online publication date: 30-May-2021
https://dl.acm.org/doi/10.1109/ICRA48506.2021.9561143
Das SMakedon F(2020)Real time direction estimation for pointing interactions using a depth sensor and a nine axis inertial motion unitProceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3389189.3392618(1-10)Online publication date: 30-Jun-2020
https://dl.acm.org/doi/10.1145/3389189.3392618
Das S(2018)Precise Pointing Direction Estimation using Depth Data2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)10.1109/ROMAN.2018.8525712(202-207)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1109/ROMAN.2018.8525712

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Vision-enhanced Immersive Interaction and Remote Collaboration with Large Touch Displays

Mediating Group Dynamics through Tabletop Interface Design

A Tabletop System Using an OmniDirectional Projector-Camera