Article

HandSketch bi-manual controller: investigation on expressive control issues of an augmented tablet

Authors:

Nicolas D'Alessandro,

Thierry DutoitAuthors Info & Claims

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

Pages 78 - 81

https://doi.org/10.1145/1279740.1279753

Published: 06 June 2007 Publication History

Get Access

Abstract

In this paper, we present a new bi-manual gestural controller, called HandSketch, composed of purchasable devices: pen tablet and pressure-sensing surfaces. It aims at achieving real-time manipulation of several continuous and articulated aspects of pitched sounds synthesis, with a focus on expressive voice. Both prefered and non-prefered hand issues are discussed. Concrete playing diagrams and mapping strategies are described. These results are integrated and a compact controller is proposed.

References

[1]

http://www.dalessandro.be/files/nime06.mov.

Google Scholar

[2]

http://www.symbolicsound.com.

Google Scholar

[3]

N. D'Alessandro, C. d'Alessandro, S. Le Beux, and B. Doval. Realtime calm synthesizer, new approaches in hands-controlled voice synthesis. In Proceedings of NIME'06, pages 266--271, 2006.

Digital Library

Google Scholar

[4]

N. D'Alessandro, B. Doval, S. L. Beux, P. Woodruff, and Y. Fabre. Ramcess: Realtime and accurate musical control of expression in singing synthesis. In eNTERFACE'06 : 2nd SIMILAR Summer Workshop on Multimodal Interfaces, pages 81--90, 2006.

Google Scholar

[5]

A. Hunt and R. Kirk. Mapping strategies for musical performance - trends in gestural control of music. Trends in Gestural Control of Music, pages 231--258, 2000.

Google Scholar

[6]

L. Kessous. Bi-manual mapping experimentation, with angular fundamental frequency control and sound color navigation. In Proceedings of NIME'02, 2002

Digital Library

Google Scholar

[7]

B. Pritchard and S. Fels. Grassp: Gesturally-realized audio, speech and song performance. In Proceedings of NIME'06, pages 272--276, 2006.

Digital Library

Google Scholar

[8]

R. B. Sexton and D. Haussner. Method for the Theremin Bk. I. 1996.

Google Scholar

[9]

R. N. Shepard. Circularity in judgements of relative pitch. Journal of Acoustical Society of America, 36(12):2346--2353, 1964.

Crossref

Google Scholar

[10]

V. Verfaille, C. Guastavino, and P. Depalle. Perceptual evaluation of vibrato models. In Proceedings of Conference on Interdisciplinary Musicology, 2005.

Google Scholar

[11]

M. Wanderly and P. Depalle. Gestural control of sound synthesis. Proceedings of the IEEE: Special Issue on Engineering and Music - Supervisory Control and Auditory Communication, 92(4):632--644, 2004.

Google Scholar

[12]

R. Woof. Technique and Interpretation in Violin-Playing. 2006.

Google Scholar

Cited By

View all

d'Alessandro NTilmanne JMoreau APuleo ABerdahl EAllison J(2015)AirPiano: A Multi-Touch Keyboard with Hovering ControlProceedings of the international conference on New Interfaces for Musical Expression10.5555/2993778.2993843(255-258)Online publication date: 30-May-2015
https://dl.acm.org/doi/10.5555/2993778.2993843
d’Alessandro NAstrinaki MDutoit T(2013)MAGEFACE: Performative Conversion of Facial Characteristics into Speech Synthesis ParametersIntelligent Technologies for Interactive Entertainment10.1007/978-3-319-03892-6_21(179-182)Online publication date: 2013
https://doi.org/10.1007/978-3-319-03892-6_21
d'Alessandro NPritchard RWang JFels STan DBegole BKellogg W(2011)Ubiquitous voice synthesisCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979700(335-340)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979700
Show More Cited By

HandSketch bi-manual controller: investigation on expressive control issues of an augmented tablet
1. Applied computing
  1. Arts and humanities

Recommendations

A Small Virtual Keyboard is Better for Intermittent Text Entry on a Pen-Equipped Tablet
ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Tap-typing with a pen on a virtual keyboard is often used for intermittent text entry on a pen-equipped tablet; however, this has usability issues owing to the large size of the virtual keyboard. We speculated that tap-typing with a pen on a tablet may ...
Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Tablets are attractive for design work anywhere, but 3D manipulations are notoriously difficult. We explore how engaging the stylus and multi-touch in concert can render such tasks easier. We introduce Bi-3D, an interaction concept where touch gestures ...
The UnMousePad: an interpolating multi-touch force-sensing input pad
SIGGRAPH '09: ACM SIGGRAPH 2009 papers

Recently, there has been great interest in multi-touch interfaces. Such devices have taken the form of camera-based systems such as Microsoft Surface [de los Reyes et al. 2007] and Perceptive Pixel's FTIR Display [Han 2005] as well as hand-held devices ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

NIME '07: Proceedings of the 7th international conference on New interfaces for musical expression

June 2007

484 pages

ISBN:9781450378376

DOI:10.1145/1279740

Conference Chairs:
Carol Parkinson
Harvestworks Digital Media Arts Center
,
Eric Singer
LEMUR: League of Electronic Musical Urban Robots

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
167
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

d'Alessandro NTilmanne JMoreau APuleo ABerdahl EAllison J(2015)AirPiano: A Multi-Touch Keyboard with Hovering ControlProceedings of the international conference on New Interfaces for Musical Expression10.5555/2993778.2993843(255-258)Online publication date: 30-May-2015
https://dl.acm.org/doi/10.5555/2993778.2993843
d’Alessandro NAstrinaki MDutoit T(2013)MAGEFACE: Performative Conversion of Facial Characteristics into Speech Synthesis ParametersIntelligent Technologies for Interactive Entertainment10.1007/978-3-319-03892-6_21(179-182)Online publication date: 2013
https://doi.org/10.1007/978-3-319-03892-6_21
d'Alessandro NPritchard RWang JFels STan DBegole BKellogg W(2011)Ubiquitous voice synthesisCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979700(335-340)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979700
Andresen MBach MKristensen K(2010)The LapSlapperProceedings of the 5th international conference on Haptic and audio interaction design10.5555/1887984.1888005(160-168)Online publication date: 16-Sep-2010
https://dl.acm.org/doi/10.5555/1887984.1888005
Andresen MBach MKristensen K(2010)The LapSlapper - Feel the BeatHaptic and Audio Interaction Design10.1007/978-3-642-15841-4_17(160-168)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15841-4_17
d‘Alessandro NBabacan OBozkurt BDubuisson THolzapfel AKessous LMoinet AVlieghe M(2008)RAMCESS 2.X framework—expressive voice analysis for realtime and accurate synthesis of singingJournal on Multimodal User Interfaces10.1007/s12193-008-0010-42:2(133-144)Online publication date: 5-Jun-2008
https://doi.org/10.1007/s12193-008-0010-4

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Recommendations

A Small Virtual Keyboard is Better for Intermittent Text Entry on a Pen-Equipped Tablet

Bi-3D: Bi-Manual Pen-and-Touch Interaction for 3D Manipulation on Tablets

The UnMousePad: an interpolating multi-touch force-sensing input pad

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations