More Web Proxy on the site http://driver.im/

research-article

Public Access

IntelliPrompter: speech-based dynamic note display interface for oral presentations

Authors:

Harriet J. Fell,

Timothy W. BickmoreAuthors Info & Claims

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

Pages 172 - 180

https://doi.org/10.1145/3136755.3136818

Published: 03 November 2017 Publication History

Abstract

The fear of forgetting what to say next is a common problem in oral presentation delivery. To maintain good content coverage and reduce anxiety, many presenters use written notes in conjunction with presentation slides. However, excessive use of notes during delivery can lead to disengagement with the audience and low quality presentations. We designed IntelliPrompter, a speech-based note display system that automatically tracks a presenter’s coverage of each slide’s content and dynamically adjusts the note display interface to highlight the most likely next topic to present. We developed two versions of our intelligent teleprompters using Google Glass and computer screen displays. The design of our system was informed by findings from 36 interviews with presenters and analysis of a presentation note corpus. In a within-subjects study comparing our dynamic screen-based and Google Glass note display interfaces with a static note system, presenters and independent judges expressed a strong preference for the dynamic screen-based system.

References

[1]

R. Asadi, H. J. Fell, T. W. Bickmore, and H. Trinh. 2016. Real-Time Presentation Tracking Using Semantic Keyword Spotting. In INTERSPEECH, pp. 3081-3085.

[2]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77101

[3]

M. Chollet, G. Sratou, A. Shapiro, L. P. Morency, and S. Scherer. 2014. An interactive virtual audience platform for public speaking training. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, pp. 1657-1658.

Digital Library

[4]

I. Damian, C. S. S. Tan, T. Baur, J. Schöning, K. Luyten, and E. André. 2015. Augmenting social interactions: Realtime behavioural feedback using social signal processing techniques. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 565-574.

Digital Library

[5]

Nancy Duarte. 2008. Slide: ology: The art and science of creating great presentations. Sebastopol, CA: O'Reilly Media.

Digital Library

[6]

D. Edge, J. Savage, and K. Yatani. 2013. HyperSlides: dynamic presentation prototyping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 671-680.

Digital Library

[7]

Andy Goodman. 2006. Why bad presentations happen to good causes. Andy Goodman & Cause Communication.

[8]

IBM. Speech to Text | IBM Watson Developer Cloud. 2016. Retrieved August 20, 2017 from https://www.ibm.com/watson/services/speech-to-text/

[9]

K. Kurihara, M. Goto, J. Ogata, Y. Matsusaka, and T. Igarashi. 2007. Presentation sensei: a presentation training system using speech and image processing. In Proceedings of the 9th international conference on Multimodal interfaces, pp. 358-365. ACM.

Digital Library

[10]

C. D. Manning, M. Surdeanu, J. Bauer, J. R. Finkel, S. Bethard, and D. McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In ACL (System Demonstrations), pp. 55-60.

[11]

James C. McCroskey and Linda L. McCroskey.1988. Self-report as an approach to measuring communication competence. Communication Research Reports, 5, 108-113.

[12]

Microsoft PowerPoint. http://office.microsoft.com/en-us/powerpoint

[13]

George A. Miller. 1995. WordNet: a lexical database for English. Communications of the ACM 38, no. 11 (1995): 39-41.

Digital Library

[14]

T. Okada, T. Yamamoto, T. Terada, and M. Tsukamoto. 2011. Wearable MC system a system for supporting MC performances using wearable computing technologies. In Proceedings of the 2nd Augmented Human International Conference, p. 25.

Digital Library

[15]

Gordon L. Paul. 1966. Insight versus desensitization in psychotherapy: An experiment in anxiety reduction. Stanford University Press.

[16]

J. Pennington, R. Socher, and C. D. Manning. 2014. Glove: Global Vectors for Word Representation. In EMNLP, vol. 14, pp. 1532-43.

[17]

Ivicia Rogina. 2002. Lecture and presentation tracking in an intelligent meeting room. In Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p. 47. IEEE Computer Society, 2002.

Digital Library

[18]

L. M. Schreiber, G. D. Paul, and L. R. Shibley. 2012. The development and test of the public speaking competence rubric. Communication Education 61, no. 3 (2012): 205-233.

[19]

Charles D. Spielberger. 1989. State-trait anxiety inventory. Consulting Psychologists Press.

[20]

M. I. Tanveer, E. Lin, and M. E. Hoque. 2015. Rhema: A real-time in-situ intelligent interface to help people with public speaking. In Proceedings of the 20th International Conference on Intelligent User Interfaces, pp. 286-295.

Digital Library

[21]

H. Trinh, R. Asadi, D. Edge, and T. Bickmore. 2017. RoboCOP: A Robotic Coach for Oral Presentations. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 2, Article 27 (June 2017), 24 pages.

Digital Library

[22]

H. Trinh, K. Yatani, and D. Edge. 2014. PitchPerfect: integrated rehearsal environment for structured presentation preparation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1571-1580.

Digital Library

[23]

Edward R. Tufte. 2003. The cognitive style of PowerPoint. Cheshire, CT: Graphics Press.

[24]

Jaime A. Ward and Paul Lukowicz. 2016. What's my line? glass versus paper for cold reading in duologues. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, pp. 1765- 1768.

Digital Library

[25]

Ding Xingeng and Liu Jianxiang. 2012. Advantages and disadvantages of PowerPoint in lectures to science students. International Journal of Education and Management Engineering (IJEME) 2, no. 9 (2012): 61.

Cited By

Lee EYang EHuh JOh U(2024)EcoScript: A Real-Time Presentation Supporting Tool using a Speech Recognition Model2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI)10.1109/IRI62200.2024.00031(96-101)Online publication date: 7-Aug-2024
https://doi.org/10.1109/IRI62200.2024.00031
Warner JPavel ANguyen TAgrawala MHartmann B(2023)SlideSpecs: Automatic and Interactive Presentation Feedback CollationProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584035(695-709)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584035
McMillan DJaber R(2021)Leaving the Butler Behind: The Future of Role Reproduction in CUIProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469606(1-4)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469606
Show More Cited By

Index Terms

IntelliPrompter: speech-based dynamic note display interface for oral presentations
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

The Presenter Experience of Canvas Presentations
Human-Computer Interaction – INTERACT 2015
Abstract
Most presentations are given with supporting visuals and driven by specialized presentation software. Today, this software either follows the classic slideware metaphor, presenting a series of discrete screens—or it implements the more recent ...
Sharing the Load Online: Virtual Presentations with Virtual Co-Presenter Agents
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

The pandemic has caused a significant increase in the use of videoconferencing for oral presentations. Prior work demonstrated that an embodied conversational agent that co-delivers an oral presentation could be used in face-to-face presentations to ...
Speech-based cursor control: a study of grid-based solutions

Speech recognition can be a powerful tool for use in human-computer interaction. Many researchers are investigating the use of speech recognition systems for dictation-based activities, resulting in dramatic improvements in recent years. However, this ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

November 2017

676 pages

ISBN:9781450355438

DOI:10.1145/3136755

General Chairs:
Edward Lank
University of Waterloo, Canada
,
Alessandro Vinciarelli
University of Glasgow, UK
,
Program Chairs:
Eve Hoggan
Aarhus University, Denmark
,
Sriram Subramanian
University of Sussex, UK
,
Stephen A. Brewster
University of Glasgow, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

ICMI '17

Sponsor:

SIGCHI

ICMI '17: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 13 - 17, 2017

Glasgow, UK

Acceptance Rates

ICMI '17 Paper Acceptance Rate 65 of 149 submissions, 44%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
394
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)16

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee EYang EHuh JOh U(2024)EcoScript: A Real-Time Presentation Supporting Tool using a Speech Recognition Model2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI)10.1109/IRI62200.2024.00031(96-101)Online publication date: 7-Aug-2024
https://doi.org/10.1109/IRI62200.2024.00031
Warner JPavel ANguyen TAgrawala MHartmann B(2023)SlideSpecs: Automatic and Interactive Presentation Feedback CollationProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584035(695-709)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584035
McMillan DJaber R(2021)Leaving the Butler Behind: The Future of Role Reproduction in CUIProceedings of the 3rd Conference on Conversational User Interfaces10.1145/3469595.3469606(1-4)Online publication date: 27-Jul-2021
https://dl.acm.org/doi/10.1145/3469595.3469606
Peng YJang JBigham JPavel AKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Say It All: Feedback for Improving Non-Visual Presentation AccessibilityProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445572(1-12)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445572
Bickmore TKimani EShamekhi AMurali PParmar DTrinh H(2020)Virtual agents as supporting media for scientific presentationsJournal on Multimodal User Interfaces10.1007/s12193-020-00350-yOnline publication date: 6-Nov-2020
https://doi.org/10.1007/s12193-020-00350-y
Asadi RTrinh HFell HBickmore TBerkovsky SHijikata YRekimoto JBurnett MBillinghurst MQuigley A(2018)QuesterProceedings of the 23rd International Conference on Intelligent User Interfaces10.1145/3172944.3172974(583-593)Online publication date: 5-Mar-2018
https://dl.acm.org/doi/10.1145/3172944.3172974

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents