More Web Proxy on the site http://driver.im/

research-article

Open access

Physigrams: modelling devices for natural interaction

Authors:

Masitah Ghazali,

Devina Ramduny-EllisAuthors Info & Claims

Formal Aspects of Computing, Volume 21, Issue 6

https://doi.org/10.1007/s00165-008-0099-y

Published: 01 December 2009 Publication History

Abstract

This paper explores the formal specification of the physical behaviour of devices ‘unplugged’ from their digital effects. By doing this we seek to better understand the nature of physical interaction and the way this can be exploited to improve the design of hybrid devices with both physical and digital features. We use modified state transition networks of the physical behaviour, which we call physiograms, and link these to parallel diagrams of the digital state. These are used to describe a number of features of physical interaction exposed by previous work and relevant properties expressed using a formal semantics of the diagrams. As well as being an analytic tool, the physigrams have been used in a case study where product designers used and adapted them as part of the design process.

References

References

[1]

Anson E The device model of interaction SIGGRAPH Comput Graph 1992 16 3 107-114

Digital Library

[2]

Avrahami D, Hudson S (2002) Forming interactivity: a tool for rapid prototyping of physical interactive products. In: Proc. of the 4th Conf. on Designing interactive Systems: Processes, Practices, Methods, and Techniques (DIS ’02). ACM, New York, pp 141–146. http://doi.acm.org/10.1145/778712.778735

[3]

Benford S, Schnadelbach H, Koleva B, Gaver B, Schmidt A, Boucher A, Steed A, Anastasi R, Greenhalgh C, Rodden T, Gellersen H (2003) Sensible, sensable and desirable: a framework for designing physical interfaces, Technical Report Equator-03-003, Equator, 2003. http://www.equator.ac.uk/

[4]

booker S and Vertelney L Laural B Designing the whole-product user interface The art of computer interface design 1990 Reading Addison-Wesley 57-63

[5]

Buxton W Norman D and Draper S There’s more to interaction than meets the eye: some issues in manual input User centered system design: new perspectives on human–computer interaction 1986 Hillsdale Lawrence Erlbaum Associates 319-337

Digital Library

[6]

Buxton W (1990) A three-state model of graphical input. In: Proc. of human–computer interaction—INTERACT ’90. Elsevier, Amsterdam, pp 449–456

[7]

Card S, Mackinlay J, Robertson G (1990) The design space of input devices. In: Proc. of CHI’90. ACM Press, New York, pp 117–124

[8]

Card S, Mackinlay J, and Robertson G A morphological analysis of the design space of input devices ACM Trans Inf Syst 1991 9 2 99-122

Digital Library

[9]

Carr D (1994) Specification of interface interaction objects. In: Proc. of CHI ’94. ACM, New York, pp 372–378

[10]

Coutrix C, Nigay L (2006) Mixed reality: a model of mixed interaction. In: Proc. of AVI’06. ACM Press, New York, pp 43–50

[11]

Coutrix C, Nigay L (2008) Balancing physical and digital properties in mixed objects. In: Proc. of AVI’08, the Working Conf. on Advanced Visual interfaces. ACM Press, New York, pp 305–308

[12]

Curzon P, Rukšėnas R, and Blandford A An approach to formal verification of human-computer interaction Formal Aspects Comput 2007 19 4 513-550

Digital Library

[13]

Degani A Taming HAL: designing interfaces beyond 2001 2004 New York Palgrave Macmillan

[14]

Dix A and Runciman C Abstract models of interactive systems. People and computers: designing the interface 1985 Cambridge Cambridge University Press 13-22

[15]

Dix A (1991) Formal methods for interactive systems. Academic Press, New York. http://www.hiraeth.com/books/formal/

[16]

Dix A (1991) Status and events: static and dynamic properties of interactive systems. In: Proc. of the Eurographics Seminar: Formal Methods in Computer Graphics. http://www.hcibook.com/alan/papers/euro91/

[17]

Dix A, Abowd G (1996) Modelling status and event behaviour of interactive systems. Softw Eng J 11(6):334–346 (1996). http://www.hcibook.com/alan/papers/SEJ96-s+e/

[18]

Dix A and Abowd G Delays and temporal incoherence due to the mediated status–status mappings SIGCHI Bull 1996 28 2 47-49

Digital Library

[19]

Dix A (2003) Getting physical, keynote at: OZCHI 2003, Brisbane, Australia. http://www.hcibook.com/alan/talks/ozchi2003-keynote/

[20]

Dix A, Finlay J, Abowd G, Beale R (2004) Human–computer interaction, 3rd edn. Prentice Hall, Englewood Cliffs. http://www.hcibook.com/e3/

[21]

Dix A (2007) Designing for appropriation. In: Procedings of BCS HCI 2007, People and Computers XXI, vol 2, BCS eWiC. http://www.bcs.org/server.php?show=ConWebDoc.13347

[22]

Dix A, Ghazali M, Ramduny-Ellis D (2007) Modelling devices for natural interaction. In: Proc. of Second Intnl. Workshop on Formal Methods for Interactive Systems, FMIS2007, ENTCS. Elsevier, Amsterdam

[23]

Dix A, Leite J, Friday A (2008) XSED—XML-based description of status–event components and systems. In: Proc. of Engineering Interactive Systems 2007 (EIS 2007). Lecture notes in computer science, vol 4940. Springer, Berlin

[24]

Dubois E, Silva P, Gray P (2002) Notational support for the design of augmented reality systems. In: Proc. of the 9th International Workshop on interactive Systems. Design, Specification, and Verification, DSVIS2002. Lecture notes in computer science, vol 2545. Springer, Berlin, pp 74–88

[25]

Dubois E, Gray P (2008) A design-oriented information-flow refinement of the ASUR interaction model. In: Engineering interactive systems (incorporating EHCI, HCSE, DSV-IS). Lecture notes in computer science, vol 4940. Springer, Berlin

[26]

Dubois E, Gray P, Ramsay A (2007) A model-based approach to describing and reasoning about the physicality of interaction. In: Proc. of Physicality 2007. UWIC Press, Cardiff, pp 77–82

[27]

Eslambolchilar P (2006) Making sense of interaction using a model-based approach. Ph D thesis, Hamilton Institute, National University of Ireland, NUIM, Ireland

[28]

Evans M, Gill S (2006) Rapid development of information appliances. In: Proc. of International Design Conf. Design 2006, (Croatia, 15–18 May 2006)

[29]

Gaver W (1991) Technology affordances. In: Proc. of CHI ’91. ACM Press, New York, pp 79–84

[30]

Ghazali M, Dix A (2003) Aladdin’s lamp: understanding new from old. In: Proc. of 1st UK-UbiNet Workshop, Imperial College London. http://www.hcibook.com/alan/papers/ubinet-2003/

[31]

Ghazali M, Dix A (2005) Visceral interaction. In: Proc. of the 10th British HCI Conf., vol 2, pp 68–72. http://www.hcibook.com/alan/papers/visceral-2005/

[32]

Ghazali M, Dix A (2006) Natural inverse: physicality, interaction & meaning. In: Let’s Get Physical: Tangible Interaction and Rapid Prototyping in, for, and about Design Workshop at 2nd International Conf. on Design Computing & Cognition 2006

[33]

Gibson J The ecological approach to visual perception 1986 USA Houghton Mifflin

[34]

Gill S, Loudon G, Hewett B, Barham G (2005) How to design and prototype an information appliance in 24 hours—integrating product & interface design processes. In: Proc. of the 6th International Conf. on Computer Aided Industrial Design and Concept Design, University of Delft, The Netherlands

[35]

Green T and Petri M Usability analysis of visual programming environments: a ‘cognitive dimensions’ framework J Vis Languages Comput 1996 7 131-174

[36]

Greenberg S, Fitchett C (2001) Phidgets: easy development of physical interfaces through physical widgets. In: Proc. of the 14th Annual ACM Symposium on User interface Software and Technology (UIST ’01), pp 209–218. http://doi.acm.org/10.1145/502348.502388

[37]

Harel D Statecharts: a visual formalism for complex systems Sci Comput Program 1987 8 3 231-274

Digital Library

[38]

Harrison M, Kray C, Campos J (2007/2008) Exploring an option space to engineer a ubiquitous computing system. In: 2nd International Workshop on Formal Methods for Interactive Systems (FMIS 2007), Electronic Notes in Theorectical Computer Science, vol 208. Elsevier, Amsterdam, pp 41–55

[39]

Hartman B, Klemmer S, Bernstein M, Mehta N (2005) d.tools: Visually Prototyping Physical UIs through Statecharts. In: Extended Abstracts of UIST 2005. ACM, New York

[40]

Hartson H Cognitive, physical, sensory, and functional affordances in interaction design Behav Inform Technol 2003 22 5 315-338

[41]

Ishii H Sears A and Jacko J Tangible user interfaces The human–computer interaction handbook fundamentals, evolving technologies, and emerging applications, Chapter 24 2008 2 London Laurence Earlbaum 469-487

[42]

Jacob J, Deligiannidis L, and Morrison S A software model and specification language for non-WIMP user interfaces ACM Trans Comput Hum Interact 1999 6 1 1-46

Digital Library

[43]

Johnson C (1996) The evaluation of user interface design notations. In: Proc. of Design, Specification and Verification of Interactive Systems ’96. Springer, Berlin, pp 188–206. http://www.dcs.gla.ac.uk/~johnson/papers/chris_jarle/

[44]

Landay J, Myers B (1995) Interactive sketching for the early stages of user interface design. In: Proc. of CHI’95. ACM Press/Addison-Wesley, New York, pp 43–50. http://doi.acm.org/10.1145/223904.223910

[45]

Loer K, Harrison M (2002) Towards usable and relevant model checking techniques for the analysis of dependable interactive systems. In: Proc. 17th International Conf. on Automated Software Engineering. IEEE Computer Society, New York, pp 223–226

[46]

Massink M, Duke D, Smith S (1999) Towards hybrid interface specification for virtual environments. In: DSV-IS 1999 Design, Specification and Verification of Interactive Systems. Springer, Berlin, pp 30–51

[47]

Milner N (1988) A review of human performance and preferences with different input devices to computer systems. In: Proc. of HCI88, People and Computers IV. Cambridge University Press, Cambridge, pp 341–362

[48]

Moher T, Dirda V, Bastide R, Palanque P (1996) Monolingual, articulated modelling of users, devices and interfaces. In: 3rd EUROGRAPHICS workshop on design, specification and verification of Interactive systems. Springer, Berlin, pp 312–329

[49]

Monk A Mode errors: a user-centered analysis and some preventative measures using keying-contingent sound Int J Man Mach Stud 1986 24 4 313-327

Digital Library

[50]

Nielsen J and Mack R Usability inspection methods 1994 New York Wiley

Digital Library

[51]

Nigay L, Coutaz J (1991) Building user interfaces: organizing software agents. In: ESPRIT ‘91 Conf., pp 707–719

[52]

Nigay L, Coutaz J (1995) A generic platform for addressing the multimodal challenge. In: Proc. of CHI’95. ACM, New York, pp 98–105

[53]

Norman D Affordance, conventions, and design Interactions 1999 6 3 38-43

Digital Library

[54]

Palanque P, Paterno F (1997) (eds) Formal methods in human–computer interaction. Springer, Berlin

[55]

Parnas D (1969) On the use of transition diagrams in the design of a user interface for an interactive computer system. In: Proc. of the 1969 24th National Conf. ACM, New York, pp 379–385

[56]

Payne S and Green T Task–action grammars: a model of mental representation of task languages. Hum Comput Interact 1986 2 2 93-133

Digital Library

[57]

Pfaff G, Hagen P (1985) (eds) Seeheim workshop on user interface management systems. Springer, Berlin

[58]

Phidgets Inc., 2008. http://www.phidgets.com/

[59]

Pierce J, Stearns B, Pausch R (1999) Voodoo dolls: seamless interaction at multiple scales in virtual environments. In: Proc. of the 1999 Symposium on Interactive 3D Graphics, pp 141–145

[60]

Ramduny-Ellis D, Dix A, Rayson P, Onditi V, Sommerville I, and Ransom J Artefacts as designed, Artefacts as used: resources for uncovering activity dynamics Cogn Technol Work 2005 7 2 76-87

Digital Library

[61]

Reisner P Formal grammar and human factors design of an interactive graphics system IEEE Trans Softw Eng SE 1981 -7 2 229-240

[62]

Shneiderman B Direct manipulation: a step beyond programming languages IEEE Comput 1983 16 8 57-69

Digital Library

[63]

Shneiderman B Response time and display rate in human performance with computers ACM Comput Surv 1984 16 3 265-285

Digital Library

[64]

Smith S (2007) Exploring the specification of haptic interaction. In: Interactive systems: design, specification and verification (DSVIS 2006). Lecture notes in computer science, vol 4323. Springer, Berlin, pp 171–184

[65]

Sufrin B Formal specification of a display editor Sci Comput Program 1982 1 157-202

[66]

Thimbleby H and Harrison M Formal methods in human–computer interaction 1990 Cambridge Cambridge University Press

[67]

Thimbleby H Press On: principles of interaction programming 2007 Cambridge MIT Press

Digital Library

[68]

Thimbleby H (2007) Using the Fitts law with state transition systems to find optimal task timings. In: Pre-Proc. of Second Intnl. Workshop on Formal Methods for Interactive Systems, FMIS2007. http://www.dcs.qmul.ac.uk/research/imc/hum/fmis2007/preproceedings/FMIS2007preproceedings.pdf

[69]

UIMS A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop SIGCHI Bull 1992 24 1 32-37

Digital Library

[70]

Ullmer B, Ishii H, and Jacob R Token+constraint systems for tangible interaction with digital information ACM Trans Comput Hum Interact 2005 12 1 81-118

Digital Library

[71]

Wensveen S, Djajadiningrat J, Overbeeke C (2004) Interaction frogger: a design framework to couple action and function. In: Proc. of the DIS’04. ACM, New York, pp 177–184

[72]

Willans J and Harrison M Palanque P and Paternó F Verifying the behaviour of virtual world objects Proc. of DSV-IS’2000 2001 Berlin Springer 65-77

[73]

Wüthrich C (1999) An analysis and model of 3D interaction methods and devices for virtual reality. In: Proc. of DSV-IS’99. Springer, Berlin, pp 18–29

[74]

Young R, Green T, Simon T (1989) Programmable user models for predictive evaluation of interface design. In: Proc. of CHI’89: Human Factors in Computing Systems. ACM Press, New York

Cited By

Liu LWang X(2023)Research on Elements of Physical Interaction Design and the Information ChannelHuman-Computer Interaction10.1007/978-3-031-35596-7_11(148-162)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35596-7_11
Askarpour MMandrioli DRossi MVicentini F(2019)Formal model of human erroneous behavior for safety analysis in collaborative roboticsRobotics and Computer-Integrated Manufacturing10.1016/j.rcim.2019.01.00157:C(465-476)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1016/j.rcim.2019.01.001
Ashraf MGhazali M(2013)Physicality quantitative evaluation methodProceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration10.1145/2541016.2541047(315-324)Online publication date: 25-Nov-2013
https://dl.acm.org/doi/10.1145/2541016.2541047
Show More Cited By

Index Terms

Physigrams: modelling devices for natural interaction

Index terms have been assigned to the content through auto-classification.

Recommendations

Modelling Devices for Natural Interaction

We do not interact with systems without first performing some physical action on a physical device. This paper shows how formal notations and formal models can be developed to account for the relationship between the physical devices that we actually ...
Natural interaction on tabletops

We present two different Computer Vision based systems that enable multiple users to concurrently manipulate graphic objects presented over tabletop displays. The two solutions have different hardware layouts and use two different algorithms for gesture ...
A physical approach to tangible interaction design
TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction

The field of tangible interaction is growing in rich and diverse directions calling for new forms of understanding. In this paper I will present a view on tangible interaction that has a strong focus on movement and interaction qualities. I will ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Formal Aspects of Computing

Formal Aspects of Computing Volume 21, Issue 6

Dec 2009

129 pages

ISSN:0934-5043

EISSN:1433-299X

Issue’s Table of Contents

© British Computer Society 2008.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2009

Accepted: 30 October 2008

Received: 13 March 2008

Published in FAC Volume 21, Issue 6

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
61
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)5

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu LWang X(2023)Research on Elements of Physical Interaction Design and the Information ChannelHuman-Computer Interaction10.1007/978-3-031-35596-7_11(148-162)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-35596-7_11
Askarpour MMandrioli DRossi MVicentini F(2019)Formal model of human erroneous behavior for safety analysis in collaborative roboticsRobotics and Computer-Integrated Manufacturing10.1016/j.rcim.2019.01.00157:C(465-476)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.1016/j.rcim.2019.01.001
Ashraf MGhazali M(2013)Physicality quantitative evaluation methodProceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration10.1145/2541016.2541047(315-324)Online publication date: 25-Nov-2013
https://dl.acm.org/doi/10.1145/2541016.2541047
Ashraf MGhazali M(2013)Cataloguing Physicality Values Using Physical Quantitative Evaluation MethodComputer-Human Interaction. Cognitive Effects of Spatial Interaction, Learning, and Ability10.1007/978-3-319-16940-8_10(197-214)Online publication date: 25-Nov-2013
https://dl.acm.org/doi/10.1007/978-3-319-16940-8_10

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents