Viewpoint-dependent appearance-manipulation with multiple projector-camera systems
Abstract
This paper proposes a novel projection display technique that realizes viewing-direction-dependent appearance-manipulation. The proposed method employs a multiple projector-camera feedback system, and each projector-camera system simultaneously manipulates the apparent color or contrast from the different viewing directions. Since we assume the mirror reflection is a dominant component, we placed the camera on the counter side of the projector for the system. We confirmed that our multiple projector-camera system enables viewpoint-dependent appearance-manipulation on an anisotropic reflection surface by the experimental results. Interestingly, the application target is not limited to a metallic surface, and we have confirmed that it can be applied to matte paper media for glossy ink reflection.
References
[1]
{AKS*12} Amano T., Komura K., Sasabuchi T., Nakano S., Yamashita S.: Appearance control for human material perception manipulation. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012) (Nov 2012), pp. 13--16. 2
[2]
{ALY08} Aliaga D. G., Law A. J., Yeung Y. H.: A virtual restoration stage for real-world objects. ACM Transactions on Graphics 27, 5 (Dec. 2008), 1. 2
[3]
{AM10} Alexa M., Matusik W.: Reliefs as images. ACM Trans. Graph. 29, 4 (July 2010), 60:1--60:7. 2
[4]
{AM15} Amano T., Minami K.: Structural color display on retro-reflective objects. In Proceedings of the 25th International Conference on Artificial Reality and Telexistence and 20th Eurographics Symposium on Virtual Environments (Aire-la-Ville, Switzerland, Switzerland, 2015), ICAT - EGVE '15, Eurographics Association, pp. 37--44. 2
[5]
{Ama13} Amano T.: Projection based real-time material appearance manipulation. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2013 IEEE Conference on (June 2013), pp. 918--923. 2, 3
[6]
{ÄSUK14} Amano T., Shimana I., Ushida S., Kono K.: Successive wide viewing angle appearance manipulation with dual projector camera systems. In Proceedings of the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual Environments (Aire-la-Ville, Switzerland, Switzerland, 2014), ICAT - EGVE '14, Eurographics Association, pp. 49--54. 3
[7]
{BBG*13} Bermano A., Brüschweiler P., Grundhöfer A., Iwai D., Bickel B., Gross M.: Augmenting physical avatars using projector-based illumination. ACM Trans. Graph. 32, 6 (Nov. 2013), 189:1--189:10. 2
[8]
{BI08} Bimber O., Iwai D.: Superimposing dynamic range. ACM Transactions on Graphics 27, 5 (Dec. 2008), 1. 2
[9]
{GPNB04} Grossberg M. D., Peri H., Nayar S. K., Belhumeur P. N.: Making one object look like another: controlling appearance using a projector-camera system. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. (June 2004), vol. 1, pp. I-452--I-459 Vol.1. 2
[10]
{JUN*15} Jones A., Unger J., Nagano K., Busch J., Yu X., Peng H.-Y., Alexander O., Bolas M., Debevec P.: An automultiscopic projector array for interactive digital humans. In ACM SIGGRAPH 2015 Emerging Technologies (New York, NY, USA, 2015), SIGGRAPH '15, ACM, pp. 6:1--6:1. 2
[11]
{KFSN16} Kawabe T., Fukiage T., Sawayama M., Nishida S.: Deformation lamps: A projection technique to make static objects perceptually dynamic. ACM Trans. Appl. Percept. 13, 2 (Mar. 2016), 10:1--10:17. 2
[12]
{LAS*11} Law A. J., Aliaga D. G., Sajadi B., Majumder A., Pizlo Z.: Perceptually Based Appearance Modification for Compliant Appearance Editing. Computer Graphics Forum 30, 8 (Dec. 2011), 2288--2300. 2
[13]
{MNS04} Mukaigawa Y., Nishiyama M., Shakunaga T.: Virtual photometric environment using projector. In Proceedings of the International Conference on Virtual Systems and Multimedia (2004), pp. 544--553. 1
[14]
{MP04} Matusik W., Pfister H.: 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. International Conference on Computer Graphics and Interactive Techniques 23, 3 (2004), 814. 2
[15]
{NJL*13} Nagano K., Jones A., Liu J., Busch J., Yu X., Bolas M., Debevec P.: An autostereoscopic projector array optimized for 3D facial display. ACM SIGGRAPH 2013 Emerging Technologies on - SIGGRAPH '13 28 (2013), 1--1. 2
[16]
{ONH17} Ogawa N., Narumi T., Hirose M.: Swinging 3d lamps: A projection technique to convert a static 2d picture to 3d using wiggle stereoscopy. In ACM SIGGRAPH 2017 Posters (New York, NY, USA, 2017), SIGGRAPH '17, ACM, pp. 29:1--29:2. 2
[17]
{OOD10} Okazaki T., Okatani T., Deguchi K.: A Projector-Camera System for High-Quality Synthesis of Virtual Reflectance on Real Object Surfaces. IPSJ Transactions on Computer Vision and Applications 2 (2010), 71--83. 2
[18]
{RKK15} Resch C., Keitler P., Klinker G.: Sticky Projections - A Model-Based Approach to Interactive Shader Lamps Tracking. IEEE Transactions on Visualization and Computer Graphics 2626, c (2015), 1--1. 1
[19]
{RWLB01} Raskar R., Welch G., Low K.-l., Bandyopadhyay D.: Shader lamps: Animating real objects with image-based illumination. Proceedings of the 12th Eurographics Workshop on Rendering Techniques (2001), 89--102. 1
[20]
{SCT*15} Siegl C., Colaianni M., Thies L., Thies J., Zollhöfer M., Izadi S., Stamminger M., Bauer F.: Real-time pixel luminance optimization for dynamic multi-projection mapping. ACM Transactions on Graphics 34, 6 (2015), 1--11. 1
[21]
{SIS11} Shimazu S., Iwai D., Sato K.: 3D high dynamic range display system. 2011 10th IEEE International Symposium on Mixed and Augmented Reality (oct. 2011), 235--236. 2
[22]
{YHLJ08} Yang R., Huang X., Li S., Jaynes C.: Toward the light field display: Autostereoscopic rendering via a cluster of projectors. IEEE Transactions on Visualization and Computer Graphics 14, 1 (2008), 84--96. 2
[23]
{YHS03} Yoshida T., Horii C., Sato K.: A virtual color reconstruction system for real heritage with light projection. In Proceedings of the International Conference on Virtual Systems and Multimedia 2003 (2003), pp. 161--168. 2
Index Terms
- Viewpoint-dependent appearance-manipulation with multiple projector-camera systems
Recommendations
Multiple View Geometry of Projector-Camera Systems from Virtual Mutual Projection
PSIVT '09: Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video TechnologyRecently, projector camera systems have been used actively for image synthesis and for 3D reconstruction. For using the projector camera systems in these applications, it is very important to compute the geometry between projectors and cameras ...
Successive wide viewing angle appearance manipulation with dual projector camera systems
ICAT - EGVE '14: Proceedings of the 24th International Conference on Artificial Reality and Telexistence and the 19th Eurographics Symposium on Virtual EnvironmentsIn this study, we investigated the use of successive omnidirectional appearance manipulation for the cooperative control of multiple projector camera systems. This type of system comprises several surrounding projector camera units, where each unit ...
Autocalibration of a Projector-Camera System
This paper presents a method for calibrating a projector-camera system that consists of multiple projectors (or multiple poses of a single projector), a camera, and a planar screen. We consider the problem of estimating the homography between the screen ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2017
243 pages
- Conference Chairs:
- Mark Billinghurst,
- Ross T. Smith,
- Program Chairs:
- Robert W. Lindeman,
- Gerd Bruder,
- Daisuke Iwai
Publisher
Eurographics Association
Goslar, Germany
Publication History
Published: 22 November 2017
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 22 Dec 2024