Is Interpretation of Artificial Subtle Expressions Language-Independent?: Comparison among Japanese, German, Portuguese, and Mandarin Chinese
Authors: 
Takanori Komatsu, 
Rui Prada, Kazuki Kobayashi, 
Seiji Yamada, Kotaro Funakoshi, 
Mikio NakanoAuthors Info & Claims
Pages 2175 - 2180
Abstract
Up until now, several studies have shown that a speech interface system giving verbal suggestions with beeping sounds that decrease in pitch conveyed a low system confidence level to users intuitively, and these beeping sounds were named "artificial subtle expressions" (ASEs). However, all participants in these studies were only Japanese, so if the participants' mother tongue has different sensitivity to variations in pitch compared with Japanese, the interpretations of the ASEs might be different. We then investigated whether the ASEs are interpreted in the same way as with Japanese regardless of the users' mother tongues; specifically we focused on three language categories in traditional phonological typology. We conducted a web-based experiment to investigate whether the ways speakers of German, Portuguese (stress accent language), Mandarin Chinese (tone language) and Japanese (pitch accent language) interpret the ASEs are different or not. The results of this experiment showed that the ways of interpreting did not differ, so this suggests that these ways are language-independent.
References
[1]
Antifakos, S., Kern, N., Shiele, B., and Schwaninger, A. Towards Improving Trust in Context Aware Systems by Displaying System Confidence, In Proc. MobileHCI'05, ACM Press (2005), 9--14.
[2]
Bellotti, V. and Edwards, K. Intelligibility and accountability: Human considerations in context-aware systems, Human-Computer Interaction 16, 2 (2001), 193--212.
[3]
Benzeghibaa, M., De Moria, R., Derooa, O., Dupont S., Erbesa, T., Jouveta, D., Fissorea, F., Lafacea, P., Mertinsa, A., Risa, C., Rosea, R., Tyagia, V., and Wellekensa, C. Automatic speech recognition and speech variability: A review, Speech Communication 49, 10--11 (2007), 763--786.
[4]
Cai, H. and Lin, Y. Tuning Trust Using Cognitive Cues for Better Human-Machine Collaboration, In Proc. HFES2010, pp. 2437--2441(5).
[5]
Feng, J., and Sears, A. Using Confidence Scores to Improve Hands-Free Speech Based Navigation in Continuous Dictation Systems, ACM Transactions on Computer-Human Interaction 11, 4, ACM Press (2004), 329--356.
[6]
Higashinaka, R., Sudoh, L., and Nakano, M. Incorporating Discourse Features into Confidence Scoring of Intention Recognition Results in Spoken Dialogue Systems, Speech Communication 48, 3--4 (2006), 417--436.
[7]
Hirst, D., and Di Cristo, A. (Eds). Intonation systems: A survey of twenty languages, Cambridge University Press, 1998.
[8]
Horvitz, E., and Barry, M. Display of information for time-critical decision making, In Proc. 11th Conf. on Uncertainty in Artificial Intelligence, Morgan Kaufmann (1995), 296--305.
[9]
Horvitz, E. Principles of mixed-initiative user interfaces, In Proc. CHI'99, ACM Press (1999), 159--166.
[10]
Komatsu, T., Yamada, S., Kobayashi, K., Funakoshi, K. and Nakano, M. Artificial Subtle Expressions: Intuitive Notification Methodology for Artifacts, In Proc. CHI'10, ACM Press (2010), 1941--1944. 14.
[11]
McCawley, J. D. What is a tone language, In Fromkin, V (Eds), Tone: a linguistic survey, 113--131, Academic Press, 1978.
[12]
Ogawa, A., and Nakamura, A. Joint estimation of confidence and error causes in speech recognition, Speech Communication 54, 9 (2012), 1014--1028.
[13]
O'Grady, W., Dobrovolsky, M., and Aronoff, M. Contemporary Linguistics (Third Edition), St. Martin's Press, 1997
[14]
Parasuraman, R. Human use and abuse of Automation, In M. Mouloua and J. Koonce (Eds.), Human-Automation Interaction: Research and Practice. Erlbaum Associates, 1997.
[15]
Van der Hulst, H., and Smith, N (Eds). Autosegmental studies in pitch accent, Foris, 1998.
Index Terms
- Is Interpretation of Artificial Subtle Expressions Language-Independent?: Comparison among Japanese, German, Portuguese, and Mandarin Chinese
Recommendations
Disambiguation of Homograms in a Pitch Accent Language
CSAI '17: Proceedings of the 2017 International Conference on Computer Science and Artificial IntelligenceThe Croatian language is a pitch-accent language in which the tone contour realized in the stressed syllable carries the lexical information. Therefore, in some cases, different lexical accent gives the word a different meaning. In such cases, the ...
Predicting utterance pitch targets in Yorùbá for tone realisation in speech synthesis
Pitch is a fundamental acoustic feature of speech and as such needs to be determined during the process of speech synthesis. While a range of communicative functions are attributed to pitch variation in speech of all languages, it plays a vital role in ...
Automatic recognition of oral vowels in tone language: Experiments with fuzzy logic and neural network models
Automatic recognition of tone language speech is a complex problem in that it involves two parallel recognition tasks. A recognition system to accomplish this task must be able to simultaneously recognise tone and phone Components in the acoustic ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
April 2015
2546 pages
ISBN:9781450331463
DOI:10.1145/2702613
- General Chairs:
- Bo Begole,
- Jinwoo Kim,
- Program Chairs:
- Kori Inkpen,
- Woontack Woo
Copyright © 2015 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 18 April 2015
Check for updates
Author Tags
Qualifiers
- Work in progress
Funding Sources
- KAKENHI
Conference
CHI '15
Sponsor:
CHI '15: CHI Conference on Human Factors in Computing Systems
April 18 - 23, 2015
Seoul, Republic of Korea
Acceptance Rates
CHI EA '15 Paper Acceptance Rate 379 of 1,520 submissions, 25%;
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 67Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in