Abstract
This exploratory research has taken a set of theoretical concepts as the basis for testing a visualisation of body-centric gesture space: 1). Kendon’s transactional segments, 2). the manubrium as a central anatomical marker for bodily movement, and 3). physical reach space. Using these, a 3D model of gesture space has been designed in order to be applied to empirical data from architects design meetings, articulating the role of gesture space overlaps within the interaction.
Multi-dimensional drawing techniques have resulted in detailed visualisations of these overlaps. Illustrations show that the dialogue contributions can be mapped to distinct locations in the changing shared spaces, creating a spatial framework for the analysis and visualisation of the multi-dimensional topology of the interaction. This paper discusses a Case Study where this type of modelling can be applied empirically, indexing speech and gesture to the drawing subspaces of a group of architects.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Battersby, S.A.: Moving Together: The organisation of non-verbal cues during multiparty conversation. PhD Thesis, Queen Mary, London (2011)
Battersby, S.A., Healey, P.G.T.: Inhabiting 3D Interaction Spaces, at Language Communication and Cognition, Brighton (2008)
Healey, P.G.T., Peters, C.R.: The Conversational Organisation of Drawing. In: First International Workshop on Pen-Based Learning Technologies - Enabling Advanced Graphical, Multimodal and Mobile Learning Interactions (PLT 2007). IEEE, Italy (2007)
Healey, P.G.T., Battersby, S.A.: The Interactional Geometry of a Three-way Conversation. In: Proceedings of the 31st Annual Conference of the Cognitive Science Society, pp. 785–790 (2009)
Clark, H.H., Krych, M.A.: Speaking while monitoring addressees for understanding. Journal of Memory and Language 50(1), 62–81 (2004)
Goodwin, C.: The interactive construction of a sentence in natural conversation. In: Psathas, G. (ed.) Everyday language: Studies in Ethnomethodology, pp. 97–121. Irvington Publishers (1979)
Heath, C., Luff, P.: Collaboration and control: crisis management and multimedia technology in London Underground control room. Computer Supported Cooperative Work 1, 69–94 (1992)
Kendon, A.: Movement coordination in social interaction: Some examples described. Acta Psychologica 32, 100–125 (1970)
Murphy, K.M.: Collaborative Imagining: the interactive use of gestures, talk, and graphical representation in architectural practice. Semiotica 2005, 113–145 (2005)
McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press (1992)
McNeill, D., Pedelty, L.L.: Right brain and gesture. Language, gesture, and space (1995)
McNeill, D.: Language and Gesture. Cambridge University Press (2000)
Haviland, J.B.: Pointing, gesture spaces, and mental maps. In: McNeill, D. (ed.) Language and Gesture, p. 13. Cambridge University Press, Cambridge (2000)
Haviland, J.B.: How to point in Zinacantan, in Pointing: Where language, cognition and culture meet. Lawrence Erlbaum Associates (2003)
Klima, E.S., Bellugi, U.: From gesture to sign: deixis in a visual-gestural language. John Wiley and Sons, Ltd. (1982)
Pfeiffer, T.: Understanding Multimodal Deixis with Gaze and Gesture in Conversational Interfaces. PhD Thesis, Bielefeld University (2010)
Pfeiffer, T., Mattar, N.: Benefits of Locating Overt Visual Attention in Space Using Binocular Eye Tracking for Mixed Reality Applications. In: Virtual Reality Conference, VR 2008, Logos Berlin, pp. 1–3. IEEE (2009)
Streeck, J.: Gesturecraft: The manufacture of meaning. The University of Texas, Austin [Gesture Studies, 2] (2009)
Bressem, J., Ladewig, S.H.: Rethinking gesture phases: Articulatory features of gestural movement? Semiotic 184(1/4), 53–91 (2011)
Ladewig, S.H.: Putting the cyclic gesture on a cognitive basis. Accessed 27-6-2011, at cognitextes.revues.org (2011)
Bressem, J.: Notating gestures: Proposal for a form based notation system of coverbal gestures (2008) (unpublished manuscript), http://www.janabressem.de (August 23, 2011)
Narasimhan, K.P.: Towards modelling spatial cognition for intelligent agents. In: ECCE 2011 Proceedings of the 29th Annual European Conference on Cognitive Ergonomics (2011)
Nguyen, N., Wachsmuth, I.: From Body Space to Interaction Space-Modeling Spatial Cooperation for Virtual Humans. In: Tumer, Yolum, Sonenberg, Stone (eds.) Proc. of 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011), Taipei, Taiwan, May 2-6, pp. 1047–1054. Nhung Nguyen and Ipke Wachsmuth (2011)
Berti, A., Frassinetti, F.: When far becomes near: remapping of space by tool use. Journal of Cognitive Neuroscience 12(3), 415–420 (2000)
Holmes, N.P., Spence, C.: The body schema and the multisensory representation(s) of peripersonal space. Cognitive Processes 5(2), 94–105 (2004)
Cortlett, E.N., Clark, T.S.: The Ergonomics of Workspaces and Machines: A Design Manual. CRC Press, Florida (1995)
Efron, D.: Gesture, Race, and Culture. King’s Crown Press, New York (1941)
Murphy, K.M.: Building Meaning in Interaction: Rethinking Gesture Classifications. Crossroads of Language, Interaction, and Culture 5, 29–47 (2003)
Fricke, E.: Origo, pointing, and conceptualization: what gestures reveal about the nature of the origo in face-to-face interaction. In: Lenz, F. (ed.) Deictic Conceptualisation of Space, Time, and Person (2003)
Kendon, A.: Gesture: Visible Actions as Utterance. Cambridge University Press (2004)
Goodwin, C.: Gesture, aphasia, and interaction. In: McNeill, D. (ed.) Language and Gesture, pp. 84–98. Cambridge University Press (2000)
Goodwin, C., et al.: Pointing: where language, culture, and cognition meet, Mahwah, New Jersey (2003)
Murphy, K.M.: Building Meaning in Interaction: Rethinking Gesture Classifications. Crossroads of Language, Interaction, and Culture 5, 29–47 (2003)
Gill, S.P.: Engagement Space: The Body in Parallel and Sequential Time and Space. Submitted to the website of, Gesture the Living Medium, Austin, Texas (undated)
Ozyurek, A.: The influence of addressee location on spatial language and representational gestures of direction. In: Language and Gesture. Cambridge University Press (2000)
Ozyurek, A.: Do Speakers Design Their Co-speech Gestures for Their Addressees? The Effects of Addressee Location on Representational Gestures. Journal of Memory and Language 46, 688–704 (2002)
Furuyama, N.: Gestural interaction between the instructor and the learner in origami instruction. In: McNeill, D. (ed.) Language and Gesture, pp. 99–117. Cambridge University Press, Cambridge (2000)
Furuyama, N.: The Semiotic Making of Speech and Gesture and How It Contributes to the Structuring of Discourse. Cognitive Studies 7(1), 71–77 (2000)
Furuyama, N.: Prolegomena of a theory of between-person coordination of speech and gesture. International Journal of Human-Computer Studies 57, 347–374 (2002)
Latour, B.: Visualisation and Cognition: Drawing things together (1983), http://www.bruno-latour.fr (retrieved July 30, 2010)
Heath C.P.R.: 3D Paper. In: Explorations in Spatiality: Spatiality in Design, University of Leeds, Department of Computing (2006)
Willis, K.D.D., Lin, J., Mitani, J., Igarashi, T.: Spatial Sketch: Bridging Between Movement & Fabrication. In: TEI 2010, Cambridge, Massachusetts, January 24-27 (2010)
Duncan, S.: Annotative Practice (Under Perpetual Revision) Due to Susan Duncan (Revision of D. McNeill, Gesture & Thought, Appendix) (2005)
Duncan, S.: Coding Manual: McNeill Lab coding methods, mcneilllab.uchicago.edu (accessed August 6, 2011)
Kendon, A.: Spatial organisation of social encounters: the F-formation system. In: Conducting Interaction; Patterns of Behaviour in Focussed Encounters, CUP (1990)
McNeill, D.: Growth Points and Modeling, University of Chicago (powerpoint, undated, post 2005)
Healey, P.G.T., Heath, C.P.R.: Arranging Conversations in Space: Topologies for Interaction. IPrA, Birmingham (2011)
Rodrigues, I.G.: Gesture Space and Gesture Choreography in European Portuguese and African Portuguese Interactions: A Pilot Study of Two Cases. In: Kopp, S., Wachsmuth, I. (eds.) GW 2009. LNCS, vol. 5934, pp. 23–33. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heath, C.P.R., Healey, P.G.T. (2012). Making Space for Interaction: Architects Design Dialogues. In: Efthimiou, E., Kouroupetroglou, G., Fotinea, SE. (eds) Gesture and Sign Language in Human-Computer Interaction and Embodied Communication. GW 2011. Lecture Notes in Computer Science(), vol 7206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34182-3_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-34182-3_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34181-6
Online ISBN: 978-3-642-34182-3
eBook Packages: Computer ScienceComputer Science (R0)