More Web Proxy on the site http://driver.im/

research-article

A Survey of Natural Design for Interaction

Authors:

Andreas ButzAuthors Info & Claims

MuC '22: Proceedings of Mensch und Computer 2022

Pages 240 - 254

https://doi.org/10.1145/3543758.3543773

Published: 15 September 2022 Publication History

Abstract

The term “Natural Design” has various meanings and applications within and beyond the human-computer interaction community. Yet, there is no consensus on whether it is a relevant design approach or only a descriptive term without profound meaning. We investigated the current understanding and design potential of “Natural Design” for interaction in a systematic literature review. By analyzing and rating 113 papers, we identified 47 relevant papers that applied Natural Design in different contexts. The understanding of the approach changes from nature-related inspirations to context-dependent naturalness based on increasing familiarity or expectations. We present a structured overview of these relevant papers, contribute a systematic Natural Design model for interaction and add 20 implications for applying Natural Design to natural user interfaces, natural interaction, or computation. We identified “Natural Design” as a relevant design approach to create intuitive and embedded interfaces that can profit from related concepts outside human-computer interaction.

References

[1]

George Abraham and Michael E. Atwood. 2009. Patterns or Claims: Do They Help in Communicating Design Advice?. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (Melbourne, Australia) (OZCHI ’09). Association for Computing Machinery, New York, NY, USA, 25–32. https://doi.org/10.1145/1738826.1738831

Digital Library

[2]

Ramesh C. Agarwal, Charu C. Aggarwal, and V. V. V. Prasad. 2000. Depth First Generation of Long Patterns. In Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Boston, Massachusetts, USA) (KDD ’00). Association for Computing Machinery, New York, NY, USA, 108–118. https://doi.org/10.1145/347090.347114

Digital Library

[3]

Don Alexander and Bronwyn Wydeman. 2020. The Intersection and Divergence of New Urbanism and Environmental Psychology: An Exploration. Frontiers in Built Environment 6 (2020), 61. https://doi.org/10.3389/fbuil.2020.00061

[4]

Thomas Matteo Alisi, Gianpaolo D’Amico, Andrea Ferracani, Lea Landucci, and Nicola Torpei. 2010. Natural Interaction for Cultural Heritage: The Archaeological Site of Shawbak. In Proceedings of the 18th ACM International Conference on Multimedia (Firenze, Italy) (MM ’10). Association for Computing Machinery, New York, NY, USA, 1449–1452. https://doi.org/10.1145/1873951.1874241

Digital Library

[5]

Jaime Alvarez Perez, Hideki Garcia Goo, Ana Sánchez Ramos, Virginia Contreras, and Megan Strait. 2020. The Uncanny Valley Manifests Even with Exposure to Robots. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 101–103. https://doi.org/10.1145/3371382.3378312

Digital Library

[6]

Michael Barz, Sven Stauden, and Daniel Sonntag. 2020. Visual Search Target Inference in Natural Interaction Settings with Machine Learning. In ACM Symposium on Eye Tracking Research and Applications (Stuttgart, Germany) (ETRA ’20 Full Papers). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages. https://doi.org/10.1145/3379155.3391314

Digital Library

[7]

Mehmet Aydin Baytas, Damla Çay, Yuchong Zhang, Mohammad Obaid, Asim Evren Yantaç, and Morten Fjeld. 2019. The Design of Social Drones: A Review of Studies on Autonomous Flyers in Inhabited Environments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300480

Digital Library

[8]

Janine M Benyus. 1997. Biomimicry: Innovation inspired by nature. Morrow New York.

[9]

Bharat Bhushan. 2009. Biomimetics: lessons from nature–an overview. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 367, 1893 (2009), 1445–1486.

[10]

Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning Naturalism in 3D User Interfaces. Commun. ACM 55, 9 (Sept. 2012), 78–88. https://doi.org/10.1145/2330667.2330687

Digital Library

[11]

John L Campbell, Charles Quincy, Jordan Osserman, and Ove K Pedersen. 2013. Coding in-depth semistructured interviews: Problems of unitization and intercoder reliability and agreement. Sociological Methods & Research 42, 3 (2013), 294–320. https://doi.org/10.1177/0049124113500475

[12]

David V Canter and Kenneth H Craik. 1981. Environmental psychology. Journal of Environmental Psychology 1, 1 (1981), 1–11.

[13]

George Caridakis, Konstantinos Moutselos, and Ilias Maglogiannis. 2013. Natural Interaction Expressivity Modeling and Analysis. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments(Rhodes, Greece) (PETRA ’13). Association for Computing Machinery, New York, NY, USA, Article 40, 6 pages. https://doi.org/10.1145/2504335.2504378

Digital Library

[14]

Bernard Carré and Jean-Marc Geib. 1990. The Point of View Notion for Multiple Inheritance. In Proceedings of the European Conference on Object-Oriented Programming on Object-Oriented Programming Systems, Languages, and Applications (Ottawa, Canada) (OOPSLA/ECOOP ’90). Association for Computing Machinery, New York, NY, USA, 312–321. https://doi.org/10.1145/97945.97983

Digital Library

[15]

Frank Dachille, Hong Qin, Arie Kaufman, and Jihad El-Sana. 1999. Haptic Sculpting of Dynamic Surfaces. In Proceedings of the 1999 Symposium on Interactive 3D Graphics (Atlanta, Georgia, USA) (I3D ’99). Association for Computing Machinery, New York, NY, USA, 103–110. https://doi.org/10.1145/300523.300535

Digital Library

[16]

Alan Lopes de Sousa Freitas, Vinícius Paes de Camargo, Heloise Manica Paris Teixeira, Renato Balancieri, and Thelma Elita Colanzi. 2017. Gesture and Voice-Based Natural User Interface for Electronic Whiteboard System in a Medical Emergency Department. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems (Joinville, Brazil) (IHC 2017). Association for Computing Machinery, New York, NY, USA, Article 27, 10 pages. https://doi.org/10.1145/3160504.3160534

Digital Library

[17]

Denis Delimarschi, George Swartzendruber, and Huzefa Kagdi. 2014. Enabling Integrated Development Environments with Natural User Interface Interactions. In Proceedings of the 22nd International Conference on Program Comprehension (Hyderabad, India) (ICPC 2014). Association for Computing Machinery, New York, NY, USA, 126–129. https://doi.org/10.1145/2597008.2597791

Digital Library

[18]

Zachary Dodds. 2008. Leveraging Laptops for Low-Cost, Full-Fledged Outdoor Robotics. J. Comput. Sci. Coll. 24, 1 (oct 2008), 158–166.

[19]

Gavin J. Dollman, Lizette De Wet, and Tanya R. Beelders. 2015. Commercial Brain Computer Interface: Potential as a Natural User Interface. In Proceedings of the 2015 Annual Research Conference on South African Institute of Computer Scientists and Information Technologists (Stellenbosch, South Africa) (SAICSIT ’15). Association for Computing Machinery, New York, NY, USA, Article 13, 8 pages. https://doi.org/10.1145/2815782.2815797

Digital Library

[20]

Steven E. Domino, Yolanda R. Smith, and Timothy R.B. Johnson. 1988. Organizing knowledge syntheses: A taxonomy of literature reviews. Knowledge in Society 1 104 (1988). https://doi.org/10.1007/BF03177550

[21]

Steven E. Domino, Yolanda R. Smith, and Timothy R.B. Johnson. 2007. Opportunities and challenges of interdisciplinary research career development: implementation of a women’s health research training program. Journal of women’s health 16 (2007). Issue 2. https://doi.org/10.1089/jwh.2006.0129

[22]

Haixia Du. 2003. Interactive Shape Design Using Volumetric Implicit PDEs. In Proceedings of the Eighth ACM Symposium on Solid Modeling and Applications (Seattle, Washington, USA) (SM ’03). Association for Computing Machinery, New York, NY, USA, 235–246. https://doi.org/10.1145/781606.781642

Digital Library

[23]

Haixia Du and Hong Qin. 2005. A Shape Design System Using Volumetric Implicit PDEs. In ACM SIGGRAPH 2005 Courses (Los Angeles, California) (SIGGRAPH ’05). Association for Computing Machinery, New York, NY, USA, 116–es. https://doi.org/10.1145/1198555.1198647

Digital Library

[24]

Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI ’16). Association for Computing Machinery, New York, NY, USA, 99–102. https://doi.org/10.1145/2983310.2985757

Digital Library

[25]

Vered Gafni. 1999. Robots: A Real-Time Systems Architectural Style. In Proceedings of the 7th European Software Engineering Conference Held Jointly with the 7th ACM SIGSOFT International Symposium on Foundations of Software Engineering (Toulouse, France) (ESEC/FSE-7). Springer-Verlag, Berlin, Heidelberg, 57–74.

Digital Library

[26]

Daniel D. Gajski. 2005. System Design Extreme Makeover. In Proceedings of the 2nd ACM/IEEE International Conference on Formal Methods and Models for Co-Design(MEMOCODE ’05). IEEE Computer Society, USA, 71–75. https://doi.org/10.1109/MEMCOD.2005.1487895

Digital Library

[27]

Thomas Galais, Alexandra Delmas, and Rémy Alonso. 2019. Natural Interaction in Virtual Reality: Impact on the Cognitive Load. In Proceedings of the 31st Conference on l’Interaction Homme-Machine: Adjunct (Grenoble, France) (IHM ’19). Association for Computing Machinery, New York, NY, USA, Article 3, 9 pages. https://doi.org/10.1145/3366551.3370342

Digital Library

[28]

Stefan Geirhofer, John Z. Sun, Lang Tong, and Brian M. Sadler. 2009. Cognitive Frequency Hopping Based on Interference Prediction: Theory and Experimental Results. SIGMOBILE Mob. Comput. Commun. Rev. 13, 2 (sep 2009), 49–61. https://doi.org/10.1145/1621076.1621082

Digital Library

[29]

Ioannis Giannopoulos, Andreas Komninos, and John Garofalakis. 2017. Natural Interaction with Large Map Interfaces in VR. In Proceedings of the 21st Pan-Hellenic Conference on Informatics (Larissa, Greece) (PCI 2017). Association for Computing Machinery, New York, NY, USA, Article 56, 6 pages. https://doi.org/10.1145/3139367.3139424

Digital Library

[30]

Mark S. Gockenbach, Matthew J. Petro, and William W. Symes. 1999. C++ Classes for Linking Optimization with Complex Simulations. ACM Trans. Math. Softw. 25, 2 (June 1999), 191–212. https://doi.org/10.1145/317275.317280

Digital Library

[31]

Nick Gravin, Yaonan Jin, Pinyan Lu, and Chenhao Zhang. 2019. Optimal Budget-Feasible Mechanisms for Additive Valuations. In Proceedings of the 2019 ACM Conference on Economics and Computation (Phoenix, AZ, USA) (EC ’19). Association for Computing Machinery, New York, NY, USA, 887–900. https://doi.org/10.1145/3328526.3329586

Digital Library

[32]

Nick Gravin, Yaonan Jin, Pinyan Lu, and Chenhao Zhang. 2020. Optimal Budget-Feasible Mechanisms for Additive Valuations. ACM Trans. Econ. Comput. 8, 4, Article 21 (Oct. 2020), 15 pages. https://doi.org/10.1145/3417746

Digital Library

[33]

Ramazan Gündogdu, Alexander Bejan, Christophe Kunze, and Matthias Wölfel. 2017. Activating People with Dementia Using Natural User Interface Interaction on a Surface Computer. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (Barcelona, Spain) (PervasiveHealth ’17). Association for Computing Machinery, New York, NY, USA, 386–394. https://doi.org/10.1145/3154862.3154929

Digital Library

[34]

Mikael Hammar, Robin Karlsson, and Bengt J. Nilsson. 2013. Using Maximum Coverage to Optimize Recommendation Systems in E-Commerce. In Proceedings of the 7th ACM Conference on Recommender Systems (Hong Kong, China) (RecSys ’13). Association for Computing Machinery, New York, NY, USA, 265–272. https://doi.org/10.1145/2507157.2507169

Digital Library

[35]

Michael Hammer and Dennis Mc Leod. 1981. Database Description with SDM: A Semantic Database Model. ACM Trans. Database Syst. 6, 3 (sep 1981), 351–386. https://doi.org/10.1145/319587.319588

Digital Library

[36]

Lone Koefoed Hansen and Peter Dalsgaard. 2015. Note to Self: Stop Calling Interfaces ”Natural”. In Proceedings of The Fifth Decennial Aarhus Conference on Critical Alternatives (Aarhus, Denmark) (CA ’15). Aarhus University Press, Aarhus N, 65–68. https://doi.org/10.7146/aahcc.v1i1.21316

Digital Library

[37]

Caroline Clarke Hayes and Farnaz Akhavi. 2008. Creating Effective Decision Aids for Complex Tasks. J. Usability Studies 3, 4 (Aug. 2008), 152–172.

[38]

Koen V. Hindriks and Catholijn M. Jonker. 2008. Creating Human-Machine Synergy in Negotiation Support Systems: Towards the Pocket Negotiator. In Proceedings of the 1st International Working Conference on Human Factors and Computational Models in Negotiation (Delft, The Netherlands) (HuCom ’08). Association for Computing Machinery, New York, NY, USA, 47–54. https://doi.org/10.1145/1609170.1609176

Digital Library

[39]

Linda Hirsch and Andreas Butz. 2021. Blend in or Pop Out? Designing an Embedded Interface for a Historical Cemetery. In Human-Computer Interaction – INTERACT 2021. Springer International Publishing, Cham, 635–645. https://doi.org/10.1007/978-3-030-85613-7_40

Digital Library

[40]

Linda Hirsch, Beat Rossmy, and Andreas Butz. 2021. Shaping Concrete for Interaction. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 6, 11 pages. https://doi.org/10.1145/3430524.3440625

Digital Library

[41]

David Holman and Roel Vertegaal. 2008. Organic User Interfaces: Designing Computers in Any Way, Shape, or Form. Commun. ACM 51, 6 (June 2008), 48–55. https://doi.org/10.1145/1349026.1349037

Digital Library

[42]

Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 201–210. https://doi.org/10.1145/1357054.1357089

Digital Library

[43]

Myounghoon Jeon and Bruce N. Walker. 2011. Spindex (Speech Index) Improves Auditory Menu Acceptance and Navigation Performance. ACM Trans. Access. Comput. 3, 3, Article 10 (April 2011), 26 pages. https://doi.org/10.1145/1952383.1952385

Digital Library

[44]

Myounghoon Jeon, Bruce N. Walker, and Abhishek Srivastava. 2012. “Spindex” (Speech Index) Enhances Menus on Touch Screen Devices with Tapping, Wheeling, and Flicking. ACM Trans. Comput.-Hum. Interact. 19, 2, Article 14 (July 2012), 27 pages. https://doi.org/10.1145/2240156.2240162

Digital Library

[45]

Stephen Kellert and Elizabeth Calabrese. 2015. The practice of biophilic design. London: Terrapin Bright LLC(2015).

[46]

Andruid Kerne, William A. Hamilton, and Zachary O. Toups. 2012. Culturally Based Design: Embodying Trans-Surface Interaction in Rummy. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’12). Association for Computing Machinery, New York, NY, USA, 509–518. https://doi.org/10.1145/2145204.2145284

Digital Library

[47]

Unseok Lee and Jiro Tanaka. 2013. Finger Identification and Hand Gesture Recognition Techniques for Natural User Interface. In Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction (Bangalore, India) (APCHI ’13). Association for Computing Machinery, New York, NY, USA, 274–279. https://doi.org/10.1145/2525194.2525296

Digital Library

[48]

Shuang Liang, Rong-Hua Li, George Baciu, Eddie C. L. Chan, and Dejun Zheng. 2010. Partial Matching of Garment Panel Shapes with Dynamic Sketching Design. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 16, 6 pages. https://doi.org/10.1145/1785455.1785471

Digital Library

[49]

Alessandro Liberati, Douglas G Altman, Jennifer Tetzlaff, Cynthia Mulrow, Peter C Gøtzsche, John P A Ioannidis, Mike Clarke, P J Devereaux, Jos Kleijnen, and David Moher. 2009. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339(2009). https://doi.org/10.1136/bmj.b2700 arXiv:https://www.bmj.com/content/339/bmj.b2700.full.pdf

[50]

Youn-kyung Lim. 2012. Disappearing Interfaces. Interactions 19, 5 (Sept. 2012), 36–39. https://doi.org/10.1145/2334184.2334194

Digital Library

[51]

Jock D. Mackinlay, George G. Robertson, and Robert DeLine. 1994. Developing Calendar Visualizers for the Information Visualizer(UIST ’94). Association for Computing Machinery, New York, NY, USA, 109–118. https://doi.org/10.1145/192426.192470

Digital Library

[52]

Allan MacLean, Victoria Bellotti, Richard Young, and Thomas Moran. 1991. Reaching through Analogy: A Design Rationale Perspective on Roles of Analogy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New Orleans, Louisiana, USA) (CHI ’91). Association for Computing Machinery, New York, NY, USA, 167–172. https://doi.org/10.1145/108844.108869

Digital Library

[53]

Mani S. Manivannan, Eric Miller, Mark Brazier, H. Donald Ratliff, and John S. Carson. 1997. Panel on Transportation and Logistics Modeling. In Proceedings of the 29th Conference on Winter Simulation (Atlanta, Georgia, USA) (WSC ’97). IEEE Computer Society, USA, 1244–1250. https://doi.org/10.1145/268437.268767

Digital Library

[54]

Abraham Marmur. 2004. The lotus effect: superhydrophobicity and metastability. Langmuir 20, 9 (2004), 3517–3519.

[55]

Terrence R. Mckelvey and Dharma P. Agrawal. 1982. Design of Software for Distributed/Multiprocessor Systems. In Proceedings of the June 7-10, 1982, National Computer Conference (Houston, Texas) (AFIPS ’82). Association for Computing Machinery, New York, NY, USA, 239–249. https://doi.org/10.1145/1500774.1500803

Digital Library

[56]

Elisa Mena-Maldonado, Rocío Cañamares, Pablo Castells, Yongli Ren, and Mark Sanderson. 2020. Agreement and Disagreement between True and False-Positive Metrics in Recommender Systems Evaluation. Association for Computing Machinery, New York, NY, USA, 841–850.

[57]

Elisa Mena-Maldonado, Rocío Cañamares, Pablo Castells, Yongli Ren, and Mark Sanderson. 2021. Popularity Bias in False-Positive Metrics for Recommender Systems Evaluation. ACM Trans. Inf. Syst. 39, 3, Article 36 (May 2021), 43 pages. https://doi.org/10.1145/3452740

Digital Library

[58]

Roi Méndez, Julián Flores, and Rubén Arenas. 2015. Real Time Exploration of the Human Head in Real Time through Natural Interaction for Educational Purposes(Interacción ’15). Association for Computing Machinery, New York, NY, USA, Article 4, 2 pages. https://doi.org/10.1145/2829875.2829909

Digital Library

[59]

Masahiro Mori, Karl F MacDorman, and Norri Kageki. 2012. The uncanny valley [from the field]. IEEE Robotics & Automation Magazine 19, 2 (2012), 98–100.

[60]

Gianfranco Nencioni, Nishanth Sastry, Gareth Tyson, Vijay Badrinarayanan, Dmytro Karamshuk, Jigna Chandaria, and Jon Crowcroft. 2016. SCORE: Exploiting Global Broadcasts to Create Offline Personal Channels for On-Demand Access. IEEE/ACM Transactions on Networking 24, 4 (2016), 2429–2442.

Digital Library

[61]

Jakob Nielsen. 1990. Traditional Dialogue Design Applied to Modern User Interfaces. Commun. ACM 33, 10 (Oct. 1990), 109–118. https://doi.org/10.1145/84537.84559

Digital Library

[62]

Donald A. Norman. 2010. Natural User Interfaces Are Not Natural. Interactions 17, 3 (May 2010), 6–10. https://doi.org/10.1145/1744161.1744163

Digital Library

[63]

Ryuichi Ogawa, Eiichiro Tanaka, Daigo Taguchi, and Komei Harada. 1993. Design Strategies for Scenario-Based Hypermedia: Description of Its Structure, Dynamics, and Style. In Proceedings of the ACM Conference on Hypertext(Milan, Italy) (ECHT ’92). Association for Computing Machinery, New York, NY, USA, 71–80. https://doi.org/10.1145/168466.168494

Digital Library

[64]

Andrea Omicini and Franco Zambonelli. 1999. Tuple Centres for the Coordination of Internet Agents. In Proceedings of the 1999 ACM Symposium on Applied Computing (San Antonio, Texas, USA) (SAC ’99). Association for Computing Machinery, New York, NY, USA, 183–190. https://doi.org/10.1145/298151.298231

Digital Library

[65]

Ayako Ono and Irene Lia Schlacht. 2011. Space art: aesthetics design as psychological support. Personal and Ubiquitous Computing 15, 5 (2011), 511–518. https://doi.org/10.1007/s00779-010-0325-5

Digital Library

[66]

James O’Toole and Liuba Shrira. 1994. An Opportunistic Installation Service: Economy of Scale for Asynchronous Reads. In Proceedings of the 6th Workshop on ACM SIGOPS European Workshop: Matching Operating Systems to Application Needs (Wadern, Germany) (EW 6). Association for Computing Machinery, New York, NY, USA, 147–150. https://doi.org/10.1145/504390.504430

Digital Library

[67]

Maike Paetzel, Giulia Perugia, and Ginevra Castellano. 2020. The Persistence of First Impressions: The Effect of Repeated Interactions on the Perception of a Social Robot. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge, United Kingdom) (HRI ’20). Association for Computing Machinery, New York, NY, USA, 73–82. https://doi.org/10.1145/3319502.3374786

Digital Library

[68]

Andrea Passarella, Marco Conti, Chiara Boldrini, and Robin I.M. Dunbar. 2011. Modelling Inter-Contact Times in Social Pervasive Networks. In Proceedings of the 14th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (Miami, Florida, USA) (MSWiM ’11). Association for Computing Machinery, New York, NY, USA, 333–340. https://doi.org/10.1145/2068897.2068955

Digital Library

[69]

Vít Rusnák, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing Coherent Gesture Sets for Multi-Scale Navigation on Tabletops. Association for Computing Machinery, New York, NY, USA, 1–12.

[70]

Catherine O Ryan, William D Browning, Joseph O Clancy, Scott L Andrews, and Namita B Kallianpurkar. 2014. Biophilic design patterns: emerging nature-based parameters for health and well-being in the built environment. ArchNet-IJAR: International Journal of Architectural Research 8, 2(2014), 62.

[71]

Harry J. Saal and Zvi Weiss. 1979. A Software High Performance APL Interpreter. SIGAPL APL Quote Quad 9, 4-P1 (May 1979), 74–81. https://doi.org/10.1145/390009.804441

Digital Library

[72]

Hugo Santana, Geber Ramalho, Vincent Corruble, and Bohdana Ratitch. 2004. Multi-Agent Patrolling with Reinforcement Learning. In Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3 (New York, New York) (AAMAS ’04). IEEE Computer Society, USA, 1122–1129.

[73]

Markus Sareika and Dieter Schmalstieg. 2010. Bimanual Handheld Mixed Reality Interfaces for Urban Planning. In Proceedings of the International Conference on Advanced Visual Interfaces (Roma, Italy) (AVI ’10). Association for Computing Machinery, New York, NY, USA, 189–196. https://doi.org/10.1145/1842993.1843027

Digital Library

[74]

Kurt Schelfthout, Danny Weyns, and Tom Holvoet. 2005. Middleware for Protocol-Based Coordination in Dynamic Networks. In Proceedings of the 3rd International Workshop on Middleware for Pervasive and Ad-Hoc Computing(Grenoble, France) (MPAC ’05). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/1101480.1101488

Digital Library

[75]

Irene Lia Schlacht and Henrik Birke. 2011. Space design. Personal and Ubiquitous Computing 15, 5 (2011), 497–509. https://doi.org/10.1007/s00779-010-0326-4

Digital Library

[76]

Magdalena Schmid, Sonja Rümelin, and Hendrik Richter. 2013. Empowering Materiality: Inspiring the Design of Tangible Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction(Barcelona, Spain) (TEI ’13). Association for Computing Machinery, New York, NY, USA, 91–98. https://doi.org/10.1145/2460625.2460639

Digital Library

[77]

Valentin Schwind, Katrin Wolf, and Niels Henze. 2018. Avoiding the Uncanny Valley in Virtual Character Design. Interactions 25, 5 (aug 2018), 45–49. https://doi.org/10.1145/3236673

Digital Library

[78]

Tim M. Simon, Ross T. Smith, Bruce Thomas, Stewart Von Itzstein, Mark Smith, Joonsuk Park, and Jun Park. 2012. Merging Tangible Buttons and Spatial Augmented Reality to Support Ubiquitous Prototype Designs. In Proceedings of the Thirteenth Australasian User Interface Conference - Volume 126 (Melbourne, Australia) (AUIC ’12). Australian Computer Society, Inc., AUS, 29–38.

Digital Library

[79]

Timothy Lee Son, Janet Wesson, and Dieter Vogts. 2016. A Natural User Interface to Facilitate Information Sharing Among Mobile Devices in a Co-Located Environment. In Proceedings of the Annual Conference of the South African Institute of Computer Scientists and Information Technologists(Johannesburg, South Africa) (SAICSIT ’16). Association for Computing Machinery, New York, NY, USA, Article 20, 9 pages. https://doi.org/10.1145/2987491.2987533

Digital Library

[80]

Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin’ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz, Wentao Wang, Sakae Yamamoto, Panayiotis Zaphiris, and Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human–Computer Interaction 35, 14(2019), 1229–1269. https://doi.org/10.1080/10447318.2019.1619259

[81]

Feng Su and Chris Joslin. 2019. Toward Generating Realistic Sounds for Soft Bodies: A Review. In Proceedings of the 14th International Audio Mostly Conference: A Journey in Sound (Nottingham, United Kingdom) (AM’19). Association for Computing Machinery, New York, NY, USA, 199–206. https://doi.org/10.1145/3356590.3356620

Digital Library

[82]

Nidhi Subbaraman. 2013. Artificial Connections. Commun. ACM 56, 4 (April 2013), 15–17. https://doi.org/10.1145/2436256.2436261

Digital Library

[83]

Nadja Terzimehić, Renate Häuslschmid, Heinrich Hussmann, and m.c. Schraefel. 2019. A Review & Analysis of Mindfulness Research in HCI: Framing Current Lines of Research and Future Opportunities. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300687

Digital Library

[84]

Nicholas Thompson. 1987. Natural Design and the Future of Comparative Psychology. Faculty Works 61(1987).

[85]

Nicholas Thompson. 1997. Communication and Natural Design. (01 1997). https://doi.org/10.1007/978-1-4899-1745-4_13

[86]

Nicholas Thompson. 2018. Signs and Designs. Behavior and Philosophy 46 (01 2018), 25–46.

[87]

Christopher Tweed and Margaret Sutherland. 2007. Built cultural heritage and sustainable urban development. Landscape and Urban Planning 83, 1 (2007), 62 – 69. https://doi.org/10.1016/j.landurbplan.2007.05.008 Cities and Sustainability.

[88]

Nobuyuki Umetani, Danny M. Kaufman, Takeo Igarashi, and Eitan Grinspun. 2011. Sensitive Couture for Interactive Garment Modeling and Editing. ACM Trans. Graph. 30, 4, Article 90 (July 2011), 12 pages. https://doi.org/10.1145/2010324.1964985

Digital Library

[89]

Julian FV Vincent, Olga A Bogatyreva, Nikolaj R Bogatyrev, Adrian Bowyer, and Anja-Karina Pahl. 2006. Biomimetics: its practice and theory. Journal of the Royal Society Interface 3, 9 (2006), 471–482.

[90]

Christina Volioti, Sotiris Manitsaris, Edgar Hemery, Stelios Hadjidimitriou, Vasileios Charisis, Leontios Hadjileontiadis, Eleni Katsouli, Fabien Moutarde, and Athanasios Manitsaris. 2018. A Natural User Interface for Gestural Expression and Emotional Elicitation to Access the Musical Intangible Cultural Heritage. J. Comput. Cult. Herit. 11, 2, Article 10 (April 2018), 20 pages. https://doi.org/10.1145/3127324

Digital Library

[91]

Daniel Christian Wahl. 2009. Beyond sustainability: Natural design and resilience. In 8th European Academy of Design Conference (Aberdeen, Scottland). 470 – 475.

[92]

Weiyi Wang, Valentin Enescu, and Hichem Sahli. 2015. Adaptive Real-Time Emotion Recognition from Body Movements. ACM Trans. Interact. Intell. Syst. 5, 4, Article 18 (Dec. 2015), 21 pages. https://doi.org/10.1145/2738221

Digital Library

[93]

Nadir Weibel, Beat Signer, Moira C. Norrie, Hermann Hofstetter, Hans-Christian Jetter, and Harald Reiterer. 2011. PaperSketch: A Paper-Digital Collaborative Remote Sketching Tool. In Proceedings of the 16th International Conference on Intelligent User Interfaces (Palo Alto, CA, USA) (IUI ’11). Association for Computing Machinery, New York, NY, USA, 155–164. https://doi.org/10.1145/1943403.1943428

Digital Library

[94]

Daniel Wigdor and Dennis Wixon. 2011. Chapter 2 - The Natural User Interface. In Brave NUI World, Daniel Wigdor and Dennis Wixon (Eds.). Morgan Kaufmann, Boston, 9–14. https://doi.org/10.1016/B978-0-12-382231-4.00002-2

[95]

Thomas Dyrmann Winkel, Thessa Jensen, and Søren Bolvig Poulsen. 2016. Who is to Change? Nudging and Provocative Communication Discussed through LøGstrup’s Ontological Ethics. SIGCAS Comput. Soc. 45, 3 (Jan. 2016), 337–343. https://doi.org/10.1145/2874239.2874289

Digital Library

[96]

Min Xin, Ehud Sharlin, and Mario Costa Sousa. 2008. Napkin Sketch: Handheld Mixed Reality 3D Sketching. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 223–226. https://doi.org/10.1145/1450579.1450627

Digital Library

[97]

Lianghong Xu, Andrew Pavlo, Sudipta Sengupta, and Gregory R. Ganger. 2017. Online Deduplication for Databases. In Proceedings of the 2017 ACM International Conference on Management of Data (Chicago, Illinois, USA) (SIGMOD ’17). Association for Computing Machinery, New York, NY, USA, 1355–1368. https://doi.org/10.1145/3035918.3035938

Digital Library

[98]

Shanchieh Jay Yang and Gustavo de Veciana. 2004. Enhancing Both Network and User Performance for Networks Supporting Best Effort Traffic. IEEE/ACM Trans. Netw. 12, 2 (April 2004), 349–360. https://doi.org/10.1109/TNET.2004.826280

Digital Library

[99]

Ying Yin and Randall Davis. 2010. Toward Natural Interaction in the Real World: Real-Time Gesture Recognition. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction (Beijing, China) (ICMI-MLMI ’10). Association for Computing Machinery, New York, NY, USA, Article 15, 8 pages. https://doi.org/10.1145/1891903.1891924

Digital Library

[100]

Chenjie Yu and Peter Peter Petrov. 2007. Aggressive Snoop Reduction for Synchronized Producer-Consumer Communication in Energy-Efficient Embedded Multi-Processors. In Proceedings of the 5th IEEE/ACM International Conference on Hardware/Software Codesign and System Synthesis (Salzburg, Austria) (CODES+ISSS ’07). Association for Computing Machinery, New York, NY, USA, 245–250. https://doi.org/10.1145/1289816.1289876

Digital Library

Cited By

Vanderdonckt JVatavu RManon JSaint-Guillain MLefevre PMarquez J(2024)Might as Well Be on Mars: Insights on the Extraterrestrial Applicability of Interaction Design Frameworks from EarthExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650807(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650807
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Vatavu R(2023)From Natural to Non-Natural Interaction: Embracing Interaction Design Beyond the Accepted Convention of NaturalProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616122(684-688)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616122

Index Terms

A Survey of Natural Design for Interaction
1. Human-centered computing
  1. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

From Natural to Non-Natural Interaction: Embracing Interaction Design Beyond the Accepted Convention of Natural
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Natural interactions feel intuitive, familiar, and a good match to the task, user’s abilities, and context. Consequently, a wealth of scientific research has been conducted on natural interaction with computer systems. Contrary to conventional ...
Embracing Non-Natural Design in Human-Computer Interaction
AVI '24: Proceedings of the 2024 International Conference on Advanced Visual Interfaces

Decades ago, the natural interaction design paradigm has brought about a revolutionary shift in perspective regarding how interactions with computer systems could and should take place. By promoting intuition, familiarity, and context matching, natural ...
Natural Interaction to Support Teaching Activities in Health
ISDEA '14: Proceedings of the 2014 Fifth International Conference on Intelligent Systems Design and Engineering Applications

In the field of human-computer interaction, Natural Interaction methods has been gaining importance because they provide communication between user and machine through an easy and intuitive way, by interpreting the natural actions of persons. In the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '22: Proceedings of Mensch und Computer 2022

September 2022

624 pages

ISBN:9781450396905

DOI:10.1145/3543758

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MuC '22

MuC '22: Mensch und Computer 2022

September 4 - 7, 2022

Darmstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
178
Total Downloads

Downloads (Last 12 months)78
Downloads (Last 6 weeks)9

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vanderdonckt JVatavu RManon JSaint-Guillain MLefevre PMarquez J(2024)Might as Well Be on Mars: Insights on the Extraterrestrial Applicability of Interaction Design Frameworks from EarthExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650807(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650807
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Vatavu R(2023)From Natural to Non-Natural Interaction: Embracing Interaction Design Beyond the Accepted Convention of NaturalProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3616122(684-688)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3616122

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents