More Web Proxy on the site http://driver.im/

research-article

Open access

OptiSpace: Automated Placement of Interactive 3D Projection Mapping Content

Authors:

Andreas Fender,

Philipp Herholz,

Jörg MüllerAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 269, Pages 1 - 11

https://doi.org/10.1145/3173574.3173843

Published: 21 April 2018 Publication History

Abstract

We present OptiSpace, a system for the automated placement of perspectively corrected projection mapping content. We analyze the geometry of physical surfaces and the viewing behavior of users over time using depth cameras. Our system measures user view behavior and simulates a virtual projection mapping scene users would see if content were placed in a particular way. OptiSpace evaluates the simulated scene according to perceptual criteria, including visibility and visual quality of virtual content. Finally, based on these evaluations, it optimizes content placement, using a two-phase procedure involving adaptive sampling and the covariance matrix adaptation algorithm. With our proposed architecture, projection mapping applications are developed without any knowledge of the physical layouts of the target environments. Applications can be deployed in different uncontrolled environments, such as living rooms and office spaces.

Supplementary Material

suppl.mov (pn2637-file3.mp4)

Supplemental video

Download
31.37 MB

suppl.mov (pn2637-file5.mp4)

Supplemental video

Download
15.69 MB

References

[1]

2014. The other resident. https://www.youtube.com/watch?v=NXxVXQYlSXc. (2014). Accessed: 2018-01-08.

[2]

Blaine Bell, Steven Feiner, and Tobias Höllerer. 2001. View Management for Virtual and Augmented Reality. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST '01). ACM, 101--110.

Digital Library

[3]

Emmanuel Benazera. 2015. libcmaes. (2015). https://github.com/beniz/libcmaes Accessed: 2017-09--19.

[4]

Oliver Bimber, Andreas Emmerling, and Thomas Klemmer. 2005. Embedded entertainment with smart projectors. Computer 38, 1 (2005), 48--55.

Digital Library

[5]

Oliver Bimber, Daisuke Iwai, Gordon Wetzstein, and Anselm Grundhöfer. 2008. The Visual Computing of Projector-Camera Systems. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 2219--2245.

Digital Library

[6]

Oliver Bimber and Ramesh Raskar. 2005. Spatial augmented reality: merging real and virtual worlds. CRC press.

[7]

Daniel Cotting and Markus Gross. 2006. Interactive environment-aware display bubbles. In Proceedings of the 19th annual ACM symposium on User interface software and technology. ACM, 245--254.

Digital Library

[8]

Andreas Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 611--621.

Digital Library

[9]

Markus Funk, Thomas Kosch, Katrin Wolf, Pascal Knierim, Sven Mayer, and Albrecht Schmidt. 2016. Automatic Projection Positioning Based on Surface Suitability. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16). ACM, 75--79.

Digital Library

[10]

Anselm Grundhofer and Oliver Bimber. 2008. Real-time adaptive radiometric compensation. IEEE transactions on visualization and computer graphics 14, 1 (2008), 97--108.

Digital Library

[11]

Nikolaus Hansen. 2006. An analysis of mutative σ-self-adaptation on linear fitness functions. Evolutionary Computation 14, 3 (2006), 255--275.

Digital Library

[12]

Nikolaus Hansen, Anne Auger, Raymond Ros, Steffen Finck, and Petr Pošík. 2010. Comparing Results of 31 Algorithms from the Black-box Optimization Benchmarking BBOB-2009. In Proceedings of the 12th Annual Conference Companion on Genetic and Evolutionary Computation (GECCO '10). ACM, 1689--1696.

Digital Library

[13]

Nikolaus Hansen and Stefan Kern. 2004. Evaluating the CMA Evolution Strategy on Multimodal Test Functions. In Parallel Problem Solving from Nature PPSN VIII (LNCS), X. Yao et al. (Eds.), Vol. 3242. Springer, 282--291.

[14]

Nikolaus Hansen and Andreas Ostermeier. 2001. Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation 9, 2 (2001), 159--195.

Digital Library

[15]

John Hardy, Carl Ellis, Jason Alexander, and Nigel Davies. 2013. Ubi displays: A toolkit for the rapid creation of interactive projected displays. In The International Symposium on Pervasive Displays.

[16]

Stephen S Intille. 2002. Change blind information display for ubiquitous computing environments. In UbiComp 2002: Ubiquitous Computing. Springer, 91--106.

Digital Library

[17]

Brett Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 637--644.

Digital Library

[18]

Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Hong-Chang Shin, and Jong-Il Park. 2006. Radiometrically-compensated projection onto non-lambertian surface using multiple overlapping projectors. Advances in Image and Video Technology (2006), 534--544.

Digital Library

[19]

Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling life-size telepresence in a projected augmented reality environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1716--1725.

Digital Library

[20]

Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998. The office of the future: A unified approach to image-based modeling and spatially immersive displays. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. ACM, 179--188.

Digital Library

[21]

Jan Riemann, Mohammadreza Khalilbeigi, Martin Schmitz, Sebastian Döweling, Florian Müller, and Max Mühlhäuser. 2016. FreeTop: Finding Free Spots for Projective Augmentation. In Proceedings of the 34rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA'16). ACM.

Digital Library

[22]

Makoto Sato and Kaori Fujinami. 2014. Nonoverlapped view management for augmented reality by tabletop projection. Journal of Visual Languages & Computing 25, 6 (2014), 891--902.

Digital Library

[23]

Maurício Sousa, Daniel Mendes, Rafael Kuffner Dos Anjos, Daniel Medeiros, Alfredo Ferreira, Alberto Raposo, João Madeiras Pereira, and Joaquim Jorge. 2017. Creepy Tracker Toolkit for Context-aware Interfaces. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, 191--200.

Digital Library

[24]

Jeroen Van Baar, Thomas Willwacher, Srinivas Rao, and Ramesh Raskar. 2003. Seamless multi-projector display on curved screens. In Proceedings of the workshop on Virtual environments 2003. ACM, 281--286.

Digital Library

[25]

John Vilk, David Molnar, Eyal Ofek, Chris Rossbach, Ben Livshits, Alex Moshchuk, Helen Wang, and Ran Gal. 2014. SurroundWeb: Least Privilege for Immersive "Web Rooms". Technical Report.

[26]

Gordon Wetzstein and Oliver Bimber. 2007. Radiometric Compensation through Inverse Light Transport. Technical Report. Juniorprofessur Augmented Reality. http: //nbn-resolving.de/urn:nbn:de:gbv:wim2--20111215--8126

[27]

Andrew D Wilson. 2017. Fast Lossless Depth Image Compression. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces. ACM, 100--105.

Digital Library

[28]

Andrew D Wilson and Hrvoje Benko. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 273--282.

Digital Library

Cited By

IWAI D(2024)Projection mapping technologies: A review of current trends and future directionsProceedings of the Japan Academy, Series B10.2183/pjab.100.012100:3(234-251)Online publication date: 11-Mar-2024
https://doi.org/10.2183/pjab.100.012
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Chang YWang YChang CTan WHsu YChen YChen M(2024)Experience from Designing Augmented Reality Browsing Interfaces for Real-world Walking ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/36765008:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676500
Show More Cited By

Index Terms

OptiSpace: Automated Placement of Interactive 3D Projection Mapping Content
1. Human-centered computing

Recommendations

Network delay guarantee for differentiated services in content-centric networking

The newly adopted built-in caching mechanism guarantees efficient content delivery for content-centric networking (CCN) as compared to the existing IP-based networks such as the Internet. However, it is a challenge at the same time for CCN to meet QoS ...
On the potential of recommendation technologies for efficient content delivery networks

During the last decade, we have witnessed a substantial change in content delivery networks (CDNs) and user access paradigms. If previously, users consumed content from a central server through their personal computers, nowadays they can reach a wide ...
Cache-at-relay: energy-efficient content placement for next-generation wireless relays

Uploading and downloading content have recently become one of the major reasons for the growth of Internet traffic volume. With the increasing popularity of social networking tools and their video upload/download applications, as well as the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Danish Innovation Fund

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
1,786
Total Downloads

Downloads (Last 12 months)293
Downloads (Last 6 weeks)48

Reflects downloads up to 04 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

IWAI D(2024)Projection mapping technologies: A review of current trends and future directionsProceedings of the Japan Academy, Series B10.2183/pjab.100.012100:3(234-251)Online publication date: 11-Mar-2024
https://doi.org/10.2183/pjab.100.012
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Chang YWang YChang CTan WHsu YChen YChen M(2024)Experience from Designing Augmented Reality Browsing Interfaces for Real-world Walking ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/36765008:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676500
Li ZGebhardt CInglin YSteck NStreli PHolz C(2024)SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM ReasoningProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676470(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676470
Liao JVan KXia ZSuzuki R(2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661631
Cho HYan YTodi KParent MSmith MJonker TBenko HLindlbauer D(2024)MineXR: Mining Personalized Extended Reality InterfacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642394(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642394
Chen ZChiappalupi DLin TYang YBeyer JPfister H(2024)RL-L: A Deep Reinforcement Learning Approach Intended for AR Label Placement in Dynamic ScenariosIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332656830:1(1347-1357)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3326568
Lu FChen MHsu HDeshpande PWang CMacIntyre B(2024)Adaptive Content Placement in Mixed Reality Through Empirical User Behavioral Patterns2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00049(199-204)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00049
Johns CEvangelista Belo JFeit AKlokmose CPfeuffer K(2023)Towards Flexible and Robust User Interface Adaptations With Multiple ObjectivesProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606799(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606799
Cheng YGebhardt CHolz C(2023)InteractionAdapt: Interaction-driven Workspace Adaptation for Situated Virtual Reality EnvironmentsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606717(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606717
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents