Abstract
Olfaction—or smell—is one of the last challenges which multimedia and multimodal applications have to conquer. Enhancing such applications with olfactory stimuli has the potential to create a more complex—and richer—user multimedia experience, by heightening the sense of reality and diversifying user interaction modalities. Nonetheless, olfaction-enhanced multimedia still remains a challenging research area. More recently, however, there have been initial signs of olfactory-enhanced applications in multimedia, with olfaction being used towards a variety of goals, including notification alerts, enhancing the sense of reality in immersive applications, and branding, to name but a few. However, as the goal of a multimedia application is to inform and/or entertain users, achieving quality olfaction-enhanced multimedia applications from the users’ perspective is vital to the success and continuity of these applications. Accordingly, in this paper we have focused on investigating the user perceived experience of olfaction-enhanced multimedia applications, with the aim of discovering the quality evaluation factors that are important from a user’s perspective of these applications, and consequently ensure the continued advancement and success of olfaction-enhanced multimedia applications.
Similar content being viewed by others
Notes
Olfactory data as used here refers to data collected from experiments involving the olfactory sense, such as those compiled from human psychophysical studies. However, all other uses of the term, olfactory data, in this work refer to computer generated smell, i.e. smell output via devices controlled by computers.
References
Ademoye OA, Ghinea G (2007) "Olfactory enhanced multimedia applications: perspectives from an empirical study". MMCN’07—Fourteenth Annual Multimedia Computing and Networking Conference, 6504:65040A-65040A-9, San Jose, California
Ademoye OA, Ghinea G (2008) "Synchronisation of olfactory-enhanced multimedia: Perspectives from an empirical study". ICME 2008—IEEE International Conference on Multimedia and Expo pp 1425–1428, Hannover, Germany
Ayabe-Kanamura S, Saito S, Distel H, Martiénez-Gómez M, Hudson R (1998) Differences and similarities in the perception of everyday odors. A Japanese-German cross-cultural study. Ann NY Acad Sci 855:694–700
Berglund B, Berglund U, Lindvall T (1986) Theory and methods for odor evaluation. Experientia 42(3):280–287
Blackwell L (1995) Visual cues and their effects on odour assessment. Nutr Food Sci 95(5):24–28
Bodnar A, Corbett R, Nekrasovski D (2004) "AROMA: Ambient awareness through olfaction in a messaging application: Does olfactory notification make ‘scents'?”, ICMI’04—Sixth International Conference on Multimodal Interfaces, pp 183
Boyd Davis S, Davies G, Haddad R, Lai M (2006) “Smell Me: Engaging with an Interactive Olfactory Game”. Proceedings of the Human Factors and Ergonomics Society 25th Annual Meeting, pp 25–40, UK
Brewster SA, McGookin DK, Miller CA (2006) “Olfoto: Designing a smell-based interaction”. CHI 2006: Conference on Human Factors in Computing Systems, pp 653
Cain WS, Polak EH (1992) Olfactory adaptation as an aspect of odor similarity. Chem Senses 17(5):481–491
Callegari P, Rouault J, Laffort P (1997) Olfactory quality: From descriptor profiles to similarities. Chem Senses 22(1):1–8
Chastrette M (2002) Classification of Odors and Structure–Odor Relationships. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 100–116
Chrea C, Valentin D, Sulmont-Rossé C, Nguyen DH, Abdi H (2005) Semantic, typicality and odor representation: A cross-cultural study. Chem Senses 30(1):37–49
Chrea C, Valentin D, Sulmont-Rossé C, Ly Mai H, Hoang Nguyen D (2004) Culture and odor categorization: Agreement between cultures depends upon the odors. Food Qual Prefer 15(7–8):669–679, SPEC.ISS
Dalton P (2000) Psychophysical and behavioral characteristics of olfactory adaptation. Chem Senses 25(4):487–492
Davide F, Holmberg M, Lundström I (2001) “Virtual olfactory interfaces: Electronic noses and olfactory displays”. Communications Through Virtual Technologies: Identity Community and Technology in the Internet Age, pp 193–220
Dinh HQ, Walker N, Hodges LF, Song C, Kobayashi A (1999) “Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments”. Proceedings—Virtual Reality Annual International Symposium, pp 222–228
Doty RL, Shaman P, Applebaum SL (1984) Smell Identification Ability: Changes with Age. Science 226(4681):1441–1443
Dubois D, Rouby C (2002) Names and Categories for Odors: The Veridical Label. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 47–66
Elsner RJF (2001) Odor Threshold, Recognition, Discrimination and Identification in Centenarians. Arch Gerontol Geriatr 33(1):81–94
Fox K (2007) The Smell Report—The human sense of smell. Social Issues Research Centre (SIRC). Available: http://www.sirc.org/publik/smell_human.html [Accessed: November 06, 2007]
Frank RA, Dulay MF, Niergarth KA, Gesteland RC (2004) A comparison of the sniff magnitude test and the University of Pennsylvania Smell Identification Test in children and nonnative English speakers. Physiol Behav 81(3):475–480
Gardiner MB (2004) “A Discerning Obsession. The study of smell brings two HHMI investigators the Nobel Prize”. HHMI Bulletin, vol. 17, no. 3, pp 4–6. Available: http://www.hhmi.org/bulletin/fall2004/nobel/. [Accessed: November 16, 2007]. Fall
Gulliver SR (2004) Distributed Multimedia Quality: The User Perspective, Doctor of Philosophy edn. Brunel University, United Kingdom
Gulliver SR, Ghinea G (2006) Defining user perception of distributed multimedia quality. ACM Trans Multimed Comput Comm Appl 2(4):241–257
Harel D, Carmel L, Lancet D (2003) Towards an odor communication system. Comput Biol Chem 27(2):121–133
Harel D, Carmel L, Lancet D (2001) An Algorithmic Approach to Odor Communication and Reproduction. Weizmann Science Press of Israel, Jerusalem
Herz RS (2002) Influences of Odors on Mood and Affective Cognition. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 160–177
Hudson R, Distel H (2002) The Individuality of Odor Perception. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 408–420
Kobal G (1991) Changes in olfactory perception during the menstrual cycle. Cell Mol Life Sci (CMLS) 47(7):712–715
Hummel T, Heilmann S, Murphy C (2002) Age-related Changes in Chemosensory Functions. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 441–456
Hummel T, Sekinger B, Wolf SR, Pauli E, Kobal G (1997) ‘Sniffin‘ sticks’. Olfactory performance assessed by the combined testing of odor identification, odor discrimination and olfactory threshold. Chem Senses 22(1):39–52
Issanchou S, Valentin D, Sulmont C, Degel J, Köster EP (2002) Testing Odor Memory: Incidental versus Intentional Learning, Implicit versus Explicit Memory. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 211–230
Jones L, Bowers CA, Washburn D, Cortes A, Satya RV (2004) “The Effect of Olfaction on Immersion into Virtual Environments” in Human Performance, Situation Awareness and Automation: Issues and Considerations for the 21st Century. Lawrence Erlbaum Associates, pp 282–285
Kaye JJ (2004) Making Scents: aromatic output for HCI. Interactions 11(1):48–61
Kaye JN (2001) Symbolic Olfactory Display, Master of Science edn, Massachusetts Institute of Technology, Massachusetts, U.S.A. Available: http://www.media.mit.edu/~jofish/thesis/ [Accessed: September 11, 2005]
Keller A, Vosshall LB (2004) Human Olfactory Psychophysics. Curr Biol 14(20):R875–R878
Kim DW, Nishimoto K, Kunifuji S (2006) “An editing and displaying system of olfactory information for the home video”. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 4253 LNAI—III, pp 859–866
Köster EP (2002) The Specific Characteristics of the Sense of Smell. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 27–44
Laing DG (1983) Natural sniffing gives optimum odour perception for humans. Perception 12(2):99–117
Larsson M (2002) Odor Memory: A Memory Systems Approach. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 231–245
Larsson M, Finkel D, Pedersen NL (2000) Odor Identification: Influences of Age, Gender, Cognition, and Personality. J Gerontol B Psychol Sci Soc Sci 55(5):P304–P310
Lehrner J, Walla P (2002) Development of Odor Naming and Odor Memory from Childhood to Young Adulthood. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 278–290
Lundström JN, McClintock MK, Olsson MJ (2006) Effects of reproductive state on olfactory sensitivity suggest odor specificity. Biol Psychol 71(3):244–247
Mair RG, Bouffard JA, Engen T, Morton TH (1978) Olfactory sensitivity during the menstrual cycle. Sens Process 2(2):90–98
Matsukura H, Yoshida H, Ishida H, Nakamoto T (2009) “Interactive Odor Playback Based on Fluid Dynamics Simulation”. VR 2009—IEEE Virtual Reality Conference, art. no. 4811042, pp 255–256, Lafayette, Louisiana, USA
Matsukura H, Yoshida H, Ishida H, Saitoh A, Nakamoto T (2009) “Odor Presentation with a Vivid Sense of Reality: Incorporating Fluid Dynamics Simulation into Olfactory Display”. VR 2009—IEEE Virtual Reality Conference, art. no. 4811062, pp. 295–296, Lafayette, Louisiana, USA
Mizuno K, Ueda A (2004) Antenatal olfactory learning influences infant feeding. Early Hum Dev 76(2):83–90
Mochizuki A, Amada T, Sawa S, Takeda T, Motoyashiki S, Kohyama K, Imura M, Chihara K (2004) “Fragra: a visual-olfactory VR game”, SIGGRAPH '04: ACM SIGGRAPH 2004 Sketches. ACM Press, New York, p 123
Morrot G, Brochet F, Dubourdieu D (2001) The Color of Odors. Brain Lang 79(2):309–320
Moskowitz HR, Dravnieks A, Cain WS, Turk A (1974) Standardized procedure for expressing odor intensity. Chem Senses Flavor 1(2):235–237
Nagle HT, Schiffman SS, Gutierrez-Osuna R (1998) How and why of electronic noses. IEEE Spectr 35(9):22–34
Nakaizumi F, Yanagida Y, Noma H, Hosaka K (2006) “SpotScents: A novel method of natural scent delivery using multiple scent projectors”. VR’06—IEEE Virtual Reality Conference 2006, art. no. 1624066, pp 207–214, Alexandria, Virginia, USA
Nakamoto T, Murakami K (2009) “Selection method of odor components for olfactory display using mass spectrum database”. VR 2009—IEEE Virtual Reality Conference 2009, art. no. 4811016, pp 159–162, Lafayette, LA, USA
Nakamoto T, Otaguro S, Kinoshita M, Nagahama M, Ohinishi K, Ishida T (2008) Cooking up an Interactive Olfactory Game Display. IEEE Comput Graph Appl 28(1):75–78
Nakamoto T (2006) Movie with Scents Generated by Olfactory Display Using Solenoid Valves. IEICE Trans Fund Electron Comm Comput Sci E89-A(11):3327–3332
Nakamoto T (2005) Odor recorder. Sensor Letters 3(2):136–150
Nakamoto T (2005) Record of dynamic changes of odors using an odor recorder. Sensors Mater 17(7):365–383
Olofsson JK, Nordin S (2004) Gender differences in chemosensory perception and event-related potentials. Chem Senses 29(7):629–637
Parr WV, Heatherbell D, White KG (2002) Demystifying wine expertise: Olfactory threshold, perceptual skill and semantic memory in expert and novice wine judges. Chem Senses 27(8):747–755
Parr WV, White KG, Heatherbell DA (2004) Exploring the nature of wine expertise: What underlies wine experts‘ olfactory recognition memory advantage? Food Qual Prefer 15(5):411–420
Pines M (2007) The Mystery of Smell: The Vivid World of Odors. Howard Hughes Medical Institute (HHMI). Available: http://www.hhmi.org/senses/d110.html [Accessed: November 16, 2007]
Pornpanomchai C, Threekhunprapa A, Pongrasamiroj K, Sukklay P (2009) “SubSmell: Multimedia with a simple olfactory display”. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5414 LNCS, pp 462–472
Sakai N, Imada S, Saito S, Kobayakawa T, Deguchi Y (2005) “The effect of visual images on perception of odors”. Chemical Senses 30( SUPPL. 1)
Saito S, Ayabe-Kanamura S, Takashima Y, Gotow N, Naito N, Nozawa T, Mise M, Deguchi Y, Kobayakawa T (2006) Development of a smell identification test using a novel stick-type odor presentation kit. Chem Senses 31(4):379–391
Saltus R (2007) “Common Senses”. HHMI Bulletin, vol. 20, no. 1, pp. 3. Available: http://www.hhmi.org/bulletin/feb2007/features/senses3.html. [Accessed: November 16, 2007]
Sarter NB (2006) Multimodal information presentation: Design guidance and research challenges. Int J Ind Ergon 36(5):439–445
Schaal B, Montagner H, Hertling E, Bolzoni D, Moyse A, Quichon R (1980) Olfactory Stimulation in the Relationship between Child and Mother. Reprod Nutr Dev 20(3B):843–858
Schaal B, Soussignan R, Marlier L (2002) Olfactory Cognition at the Start of Life: The Perinatal Shaping of Selective Odor Responsiveness. In: Rouby C, Schaal B, Dubois D, Gervais R, Holley A (eds) Olfaction, Taste, and Cognition, Paperback Re-issue edn. Cambridge University Press, New York, pp 421–440
Spencer BS (2006) Incorporating the Sense of Smell Into Patient and Haptic Surgical Simulators. IEEE Trans Inf Technol Biomed 10(1):168–173
Stevenson RJ, Case TI (2005) Olfactory imagery: A review. Psychon Bull Rev 12(2):244–264
Stevenson RJ, Mahmut M, Sundqvist N (2007) Age-Related Changes in Odor Discrimination. Dev Psychol 43(1):253–260
Todrank J, Wysock CJ, Beauchamp GK (1991) The effects of adaptation on the perception of similar and dissimilar odors. Chem Senses 16(5):467–482
Toledano A (2004) Is the CCCRC olfactory test a universal test? Otolaryngol Head Neck Surg 131(2):P55
Tortell R, Luigi DP, Dozois A, Bouchard S, Morie JF, Ilan D (2007) “The effects of scent and game play experience on memory of a virtual environment”. Virtual Reality
Varendi H, Porter RH, Winberg J (1997) Natural odour preferences of newborn infants change over time. Acta Paediatrica International Journal of Paediatrics 86(9):985–990
Variety staff (2001) Variety review of “Scent of Mystery”. Variety, Inc., Available: 82 [Accessed: August 21, 2007]
Ward P, Davies B, Kooijman D (2007) Olfaction and the retail environment: examining the influence of ambient scent. Service Business 1(4):295–316
Washburn DA, Jones LM, Satya RV, Bowers CA, Cortes A (2007) Olfactory Use in Virtual Environment Training, Modelling and Simulation Magazine, Institute for Simulation and Training, University of Central Florida, vol. 2, no. 3. Available: http://www.modelingandsimulation.org/issue7/olfactory.html [Accessed: November 17, 2007]
Washburn DA, Jones LM (2004) Could Olfactory Displays Improve Data Visualization? Comput Sci Engg 6(6):80–83
Watanabe K, Umezu K, Kurahashi T (2002) Human olfactory contrast changes during the menstrual cycle. Jpn J Physiol 52(4):353–359
Yanagida Y, Noma H, Tetsutani N, Tomono A (2003) An unencumbering, localized olfactory display”, CHI '03: CHI '03 extended abstracts on Human factors in computing systems. ACM, New York, p 988
Yanagida Y, Kawato S, Noma H, Tetsutani N, Tomono A (2003) “A nose-tracked, personal olfactory display”. ACM SIGGRAPH 2003 Sketches & Applications pp 1-1, San Diego, California, USA
Web References
6423 = A Rose 1943 Time. Available: http://www.time.com/time/magazine/article/0,9171,851882,00.html [Accessed: November 16, 2007]
Aging Well with Your Sense of Smell: a handbook for baby boomers, Olfactory Research Fund, Ltd. Available: http://www.senseofsmell.org/pdf/AgingWell.pdf [Accessed: November 16, 2007]
Carl Linnaeus (1707–1778) Available: http://www.ucmp.berkeley.edu/history/linnaeus.html [Accessed: November 16, 2007]
Fragra—An Interactive Olfactory Game System (2003) IVRC (Inter-collegiate Virtual Reality Contest) www.ivrc.net. Available: http://chihara.aist-nara.ac.jp/ivrc2003/index.html [Accessed: August 23, 2007]
Flavour Wheel for Maple Products, Agriculture and Agri-Food Canada. Available: http://www.agr.gc.ca/maple_wheel/index_e.php?page=wheel-roue [Accessed: November 16, 2007]
Flavor Wheels of the World (2004) Available: http://www.eblong.com/zarf/flavorwheel.html [Accessed: November 16, 2007]
Flavour Wheel. Available: http://www.oxfordchemicals.com/oxford/ocweb.nsf/flavourwheel!OpenPage [Accessed: November 16, 2007]
Fragrances of the World. Available: http://www.fragrancesoftheworld.com/fotw_home.swf [Accessed: November 16, 2007]
Olfactory Types (1996) Available: http://sun.science.wayne.edu/~wpoff/cor/sen/smeltype.html [Accessed: November 16, 2007]
The Scent Collar, The Institute for Creative Technologies & AnthroTronix, Inc. Available: http://people.ict.usc.edu/~morie/ScentCollarBrochure.pdf [Accessed: November 17, 2007]
Sensorama‘s Pre-Virtual Reality, Eric Lefcowitz. Available: http://www.retrofuture.com/sensorama.html [Accessed: August 23, 2007]
ABC News (1999) Smell-O-Vision Coming to Internet Soon. Available: http://www.temple.edu/ispr/examples/ex99_10_20.html [Accessed: August 21, 2007]
Artmuseum.net, Morton Heilig | Sensorama (1962) Artmuseum.net. Available: http://www.artmuseum.net/w2vr/timeline/Heilig.html [Accessed: August 23, 2007]
BBC (2006) ‘Smellovision’ for Japan cinema, BBC. Available: http://news.bbc.co.uk/1/hi/entertainment/4903984.stm [Accessed: August 21, 2007]
Christensen B (2006) The Real ICT Scent Collar, Technovelgy.com. Available: http://www.technovelgy.com/ct/Science-Fiction-News.asp?NewsNum=529 [Accessed: November 17, 2007]
Colman AM (2001) Crocker-Henderson system. Available: http://www.encyclopedia.com/doc/1O87-CrockerHendersonsystem.html [Accessed: November 16, 2007]
Colman AM (2001) Henning‘s prism. Available: http://www.encyclopedia.com/doc/1O87-Henningsprism.html [Accessed: November 16, 2007]
Colman AM (2001) Zwaardemaker smell system. Available: http://www.encyclopedia.com/doc/1O87-Zwaardemakersmellsystem.html [Accessed: November 16, 2007]
Dictionary.com, Odour, Dictionary.com Unabridged (v 1.1). Random House, Inc. Available: http://dictionary.reference.com/browse/odour [Accessed: November 16, 2007]
Heritage S (2006) The New Colin Farrell Movie Stinks In Japan. Available: http://www.hecklerspray.com/the-new-colin-farrell-movie-stinks-in-japan/20062756.php [Accessed: August 23, 2007]
HHMI News (2001) Researchers Discover Precise Olfactory Map. Available: http://www.hhmi.org/news/buck3.html [Accessed: November 16, 2007]
Jacob T A tutorial on the sense of smell, Cardiff University, UK. Available: http://www.cf.ac.uk/biosi/staff/jacob/teaching/sensory/olfact1.html [Accessed: November 16, 2007]
Kiger PJ, Smith MJ (2006) Lesson #9—Beware of Unproven Technologies The Lingering Reek of “Smell-O-Vision”, HarperCollins. Available: http://www.in70mm.com/news/2006/oops/index.htm [Accessed: August 21, 2007]
Leffingwell JC Olfaction. Available: http://www.leffingwell.com/olfaction.htm [Accessed: September 21, 2007]
Mautner J (2006) Making dollars from Scents, Available: http://www.foodarts.com/Foodarts/FA_Feature/0,4041,129,00.html [Accessed: February 15, 2010]
Nakamoto T Cooking game with scents, Tokyo Institute of Technology. Available: http://www.titech.ac.jp/news/e/news061129.html [Accessed: August 23, 2007]
Nakamoto T Cooking game with scents, Nakamoto Lab, Tokyo Institute of Technology]. Available: http://silvia.mn.ee.titech.ac.jp/research/cookingcontents.htm [Accessed: August 24, 2007]
Nobelprize.org (2004) The Nobel Prize in Physiology or Medicine 2004. Available: http://nobelprize.org/nobel_prizes/medicine/laureates/2004/press.html [Accessed: November 16, 2007]
NTT Communications (NTT Com) (2006) Movie Enhanced with Internet-based Fragrance System. Available: http://www.in70mm.com/news/2006/new_world/index.htm [Accessed: August 21, 2007]
Osborne G (2001) Interview with Michael Edwards, Basenotes. Available: http://www.basenotes.net/interviews/int-medwards.html [Accessed: November 16, 2007]
Platt C (1999) You‘ve Got Smell!, Wired Magazine, vol. 7, no. 11. Available: http://www.wired.com/wired/archive/7.11/digiscent.html [Accessed: November 17, 2007]
Smith MJ, Kiger PJ (2006) The Lingering Reek of Smell-O-Vision, Los Angeles Times. Available: http://www.latimes.com/features/magazine/west/la-tm-oops6feb05,1,2932206.story?coll=la-iraq-complete [Accessed: August 21, 2007]
Vafai S Does olfactory acuity decline with age? Available: http://zebra.sc.edu/smell/ann/myth2.html [Accessed: November 17, 2007].
Vafai S Do men and women differ in their capacity to detect odors?. Available: http://zebra.sc.edu/smell/ann/myth1.html [Accessed: November 17, 2007]
Well & Good (2004) Issue 4, Sense of smell, University of Iowa Health Care, Available: http://www.uihealthcare.com/news/wellandgood/2004/issue4/senseofsmell.html [Accessed: November 06, 2007]
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ghinea, G., Ademoye, O.A. Olfaction-enhanced multimedia: perspectives and challenges. Multimed Tools Appl 55, 601–626 (2011). https://doi.org/10.1007/s11042-010-0581-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-010-0581-4