short-paper

"WaterTouch": an aquatic interactive multimedia sensory table based on total internal reflection in water

Authors:

Steve Mann,

Ryan Janzen,

Jason HuangAuthors Info & Claims

MM '11: Proceedings of the 19th ACM international conference on Multimedia

Pages 925 - 928

https://doi.org/10.1145/2072298.2071904

Published: 28 November 2011 Publication History

Get Access

Abstract

We propose a water-based multitouch multimedia user-interface based on total-internal reflection as viewed by an underwater camera. The underwater camera is arranged so that nothing above the water surface is visible until a user touches the water, at which time anything that penetrates the water's surface becomes clearly visible. Our contribution is twofold: (1) computer vision using underwater cameras aided by total internal reflection; (2) hyperacoustic signal processing (frequency shifting) to capture the natural, acoustically-originating sounds of water rather than using synthetic sounds.

Using water itself as a touch screen creates a fun and playful user interface medium that captures the fluidity of the water's ebb and flow. In one application, a musical instrument is created in which acoustic disturbances in the water (received by underwater microphones or hydrophones) are frequency-shifted to musical notes corresponding to the location in which the water is touched, as determined by the underwater computer vision system.

References

[1]

M. B. Alonso and D. V. Keyson. MusicCube: making digital music tangible. ACM CHI, 2005.

Digital Library

Google Scholar

[2]

K. Devereux et al. Effects of a water-based program on women 65 years and over: a randomised controlled trial. Australian Journal of Physiotherapy, 52(2):102--8, 2005.

Crossref

Google Scholar

[3]

H. Ishii. Bottles: A transparent interface as a tribute to mark weiser. IEICE Trans. on Info. and Systems, pages Vol. E87--D, No. 6, pp. 1299--1311, June 2004.

Google Scholar

[4]

R. Janzen and S. Mann. Arrays of water jets as user interfaces: Detection and estimation of flow by listening to turbulence signatures using hydrophones. In Proc. ACM MM '07, September 24--29, Augsburg, Germany, pages 505--8, 2007.

Digital Library

Google Scholar

[5]

T. Machover. Hyperinstruments: A composer's approach to the evolution of intelligent musical instruments. In W. Freeman, editor, Cyberarts. Spartan Books, San Francisco, 1991.

Google Scholar

[6]

S. Mann, R. Janzen, and R. Lo. Hyperacoustic instruments: Computer-controlled instruments that are not electrophones. In Proc. ICME2008, pages 89--92, 2008.

Crossref

Google Scholar

[7]

S. Mann, R. Janzen, R. Lo, and C. Aimone. Inventing...to make a badly tuned...instrument play in perfect harmony. In Proc. ICMC '07, Aug. 27--31, volume 1, pages 105--112, 2007.

Google Scholar

[8]

S. Mann, R. Janzen, and M. Post. Hydraulophone design considerations: Absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet. In Proc. ACM MM '06, October 23--27, Santa Barbara, pages 519--528, 2006.

Digital Library

Google Scholar

[9]

P. Richards. The Wave Organ. Exploratorium (acc. 2005--8), http://www.exploratorium.edu/visit/wave\_organ.html.

Google Scholar

[10]

H. Seichter et al. Multitouch interaction for tangible user interfaces. IEEE International Symposium on Mixed and Augmented Reality, pages 213--214, 2009.

Digital Library

Google Scholar

[11]

K. van Mensvoort. Datafountain: Money translated to water. Online documentation by the inventor, http://www.koert.com/work/datafountain/, 2005.

Google Scholar

[12]

D. Yeliussizov et al. Multi-touch sensing using frustrated total internal reflection. Proc. App. Inf. and Comm. Tech. (AICT), pages 1--4, 2009.

Crossref

Google Scholar

Cited By

View all

Radeta MRibeiro MVasconcelos DLopes JSousa MMonteiro JNunes N(2019)SeaMote - Interactive Remotely Operated Apparatus for Aquatic ExpeditionsHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29387-1_14(237-248)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29387-1_14
Hu AJanzen RLu MMann SWu WYang JTian QZimmermann R(2017)Liquid Jets as Logic-Computing Fluid-User-InterfacesProceedings of the on Thematic Workshops of ACM Multimedia 201710.1145/3126686.3126765(469-476)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3126686.3126765
Dietz PReyes GKim DWakkary RHarrison SNeustaedter CBardzell SPaulos E(2014)The PumpSpark fountain development kitProceedings of the 2014 conference on Designing interactive systems10.1145/2598510.2598599(259-266)Online publication date: 21-Jun-2014
https://dl.acm.org/doi/10.1145/2598510.2598599
Show More Cited By

Index Terms

"WaterTouch": an aquatic interactive multimedia sensory table based on total internal reflection in water
1. Applied computing
  1. Physical sciences and engineering
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

User-interfaces based on the water-hammer effect: water-hammer piano as an interactive percussion surface
TEI '11: Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction

Water hammer, a well known phenomenon occurring in water pipes and plumbing fixtures, is generally considered destructive and undesirable. We propose the use of water hammer for a musical instrument akin to hammered percussion instruments like hammered ...
Hydraulophone design considerations: absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet
MM '06: Proceedings of the 14th ACM international conference on Multimedia

We present a musical keyboard that is not only velocity-sensitive, but in fact responds to absement (presement), displacement (placement), velocity, acceleration, jerk, jounce, etc. (i.e. to all the derivatives, as well as the integral, of displacement)...
Natural interfaces for musical expression: physiphones and a physics-based organology
NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

This paper presents two main ideas:

(1) Various newly invented liquid-based or underwater musical instruments are proposed that function like woodwind instruments but use water instead of air. These "woodwater" instruments expand the space of known ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '11: Proceedings of the 19th ACM international conference on Multimedia

November 2011

944 pages

ISBN:9781450306164

DOI:10.1145/2072298

General Chairs:
K. Selçuk Candan
Arizona State University, USA
,
Sethuraman Panchanathan
Arizona State University, USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Hari Sundaram
Arizona State University, USA
,
Wu-Chi Feng
Portland State University, USA
,
Nicu Sebe
University of Trento, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '11

Sponsor:

SIGMM

MM '11: ACM Multimedia Conference

November 28 - December 1, 2011

Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
282
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)2

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Radeta MRibeiro MVasconcelos DLopes JSousa MMonteiro JNunes N(2019)SeaMote - Interactive Remotely Operated Apparatus for Aquatic ExpeditionsHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29387-1_14(237-248)Online publication date: 2-Sep-2019
https://dl.acm.org/doi/10.1007/978-3-030-29387-1_14
Hu AJanzen RLu MMann SWu WYang JTian QZimmermann R(2017)Liquid Jets as Logic-Computing Fluid-User-InterfacesProceedings of the on Thematic Workshops of ACM Multimedia 201710.1145/3126686.3126765(469-476)Online publication date: 23-Oct-2017
https://dl.acm.org/doi/10.1145/3126686.3126765
Dietz PReyes GKim DWakkary RHarrison SNeustaedter CBardzell SPaulos E(2014)The PumpSpark fountain development kitProceedings of the 2014 conference on Designing interactive systems10.1145/2598510.2598599(259-266)Online publication date: 21-Jun-2014
https://dl.acm.org/doi/10.1145/2598510.2598599
Mann S(2014)“SELF-HII”: Strength + endurance + longevity through gameplay with humanistic intelligence by Fieldary Human Information Interaction2014 IEEE Games Media Entertainment10.1109/GEM.2014.7047970(1-8)Online publication date: Oct-2014
https://doi.org/10.1109/GEM.2014.7047970
Hirakawa M(2013)Multimodal + multimedia + sensors = pleasant interfaces2013 International Conference on Advances in ICT for Emerging Regions (ICTer)10.1109/ICTer.2013.6761190(272-276)Online publication date: Dec-2013
https://doi.org/10.1109/ICTer.2013.6761190
Kimura KGunawardena KHirakawa M(2013)A framework for detecting positions of objects in water2013 International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013)10.1109/ICAwST.2013.6765524(679-685)Online publication date: Nov-2013
https://doi.org/10.1109/ICAwST.2013.6765524
Hughes RGarner C(1968)Aquation kinetics of the green-blue isomer of dibromodiaquoethylenediaminechromium(III) cation and of the magenta isomer of bromotriaquoethylenediaminechromium(III) cationInorganic Chemistry10.1021/ic50068a0067:10(1988-1993)Online publication date: Oct-1968
https://doi.org/10.1021/ic50068a006

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

User-interfaces based on the water-hammer effect: water-hammer piano as an interactive percussion surface

Hydraulophone design considerations: absement, displacement, and velocity-sensitive music keyboard in which each key is a water jet

Natural interfaces for musical expression: physiphones and a physics-based organology