More Web Proxy on the site http://driver.im/

research-article

Same translation but different experience: the effects of highlighting on machine-translated conversations

Authors:

Hao-Chuan Wang,

Susan R. FussellAuthors Info & Claims

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 449 - 458

https://doi.org/10.1145/2470654.2470719

Published: 27 April 2013 Publication History

Abstract

Machine translation (MT) has the potential to allow members of multilingual organizations to interact via their own native languages, but issues with the quality of MT output have made it difficult to realize this potential. We hypothesized that highlighting keywords in MT output might make it easier for people to overlook translation errors and focus on what was intended by the message. To test this hypothesis, we conducted a laboratory experiment in which native English speakers interacted with a Mandarin-speaking confederate using machine translation. Participants performed three brainstorming tasks, under each of three conditions: no highlighting, keyword highlighting, and random highlighting. Our results indicated that people consider the identical messages clearer and less distracting when the keywords in the message are highlighted. Keyword highlighting also improved subjective impressions of the partner and the quality of the collaboration. These findings inform the design of future communication tools to support multilingual communications.

References

[1]

Abu-Hakima, S., McFarland, C., & Meech, J.F. (2001). An agent-based system for email highlighting. In Proc. of AGENTS 2001, ACM Press, 224--225.

Digital Library

[2]

Aiken, M., Wang, J., Gu, L., & Paolillo, J. (2011). An exploratory study of how technology supports communication in multilingual groups. International Journal of e-Collaboration 7, 1, 17--29.

Digital Library

[3]

Barner-Rasmussen, W., & Bjorkman, I. (2007). Language fluency, socialization and inter-unit relationships in Chinese and Finnish subsidiaries. Management and Organizational Review, 3, 105--128.

[4]

Bederson, B.B., Hu, C., & Resnik, P. (2010). Translation by iterative collaboration between monolingual users. In Proc. of Graphics Interface 2010, ACM Press, 39--46.

Digital Library

[5]

Chessa, F., & Brelstaff, G. (2011). Going beyond Google Translate? In Proc. of the 9th ACM SIGCHI Italian Chapter International Conference on ComputerHuman Interaction 2011, ACM Press, 108--113.

Digital Library

[6]

Chi, E.H., Hong, H., L., Heiser, J., Card, S.K., & Gumbrecht, M. (2007). ScentIndex and ScentHighlights: productive reading techniques for conceptually reorganizing subject indexes and highlighting passages. Information Visualization, 6, 1, 32--47.

Digital Library

[7]

Clark, H. H. (1996). Using Language. Cambridge Press.

[8]

Clark, H.H., & Brennan, S.E. (1991). Grounding in Communication. In L.B. Resnick, R.M. Levine & S.D. Teasley (Eds.), Perspectives on Socially Shared Cognition (pp. 127--149). Washington, DC: APA.

[9]

Feely, A.-J., & Harzing, A.W.K. (2003) Language management in multinational companies. CrossCultural Management: An Int'l Journal, 10, 37--52.

[10]

Harzing, A-W., & Feely, A.J. (2008). The language barrier and its implications for HQ-subsidiary relationships. Cross-cultural Management: An International Journal, 15, 49--61.

[11]

Hautassari, A. (2010). Machine translation effects on group interaction: an intercultural collaboration experiment. In Proc. ICIC 2010, ACM Press, 69--78.

Digital Library

[12]

Henderson, J.K. (2005). Language diversity in international management teams. International Studies of Management and Organization, 35, 66--82.

[13]

Johnson, D., & Wen, S. (1976). Effects of correct and extraneous markings under time limits on reading comprehension. Psychology in the Schools, 13, 454-- 456.

[14]

Kawasaki, K., Sasaki, H., & Yamaguchi, H. (2008). Effectiveness of highlighting as a prompt in text reading on a computer monitor. In Proc. of the 8th WSEAS Conference on Multimedia System and Signal Processing 2008, ACM Press, 311--315.

Digital Library

[15]

Lim, J., & Yang, Y.P. (2008). Exploring computerbased multilingual negotiation support for EnglishChinese dyads: Can we negotiate in our native languages? Behaviour & Information Technology, 27, 139--151.

Digital Library

[16]

Marshall, C.C. (1997). Annotation: from paper books to digital library. In Proc. of the 2nd ACM international Conference on Digital Libraries 1997, ACM Press, 131--140.

Digital Library

[17]

Miyabe, M., & Yoshino, T. (2010). Influence of detecting inaccurate message in real-time remote textbased communication via machine translation. In Proc. of ICIC 2010, ACM Press, 59--67.

Digital Library

[18]

Miyabe, M., Yoshino, T., & Shigenobu, T. (2009). Effects of undertaking translation repair using back translation. In Proc. of IWIW 2009, ACM Press, 33--40.

Digital Library

[19]

Morita, D., & Ishida, T. (2009). Collaborative translation by monolinguals with machine translators. In Proc. of IUI 2009, ACM Press, 361--365.

Digital Library

[20]

Nisbett, R. (2003). The Geography of Thought: How Asians and Westerners Think Differently and Why. New York: Free Press.

[21]

Olive, J., Christianson, C., & McCary, J. (2011). Handbook of Natural Language Processing and Machine Translation: DARPA Global Autonomous Language Exploitation. Springer Press.

Digital Library

[22]

Olson, G.M., & Olson, J.S. (2000). Distance matters. Human Computer Interaction, 15, 139--178.

Digital Library

[23]

Tange, H., & Lauring, J. (2009). Language management and social interaction within the multilingual workplace. Journal of Communication Management, 13, 218--232.

[24]

Teevan, J., Dumais, S.T., & Liebling, D.J. (2010). A longitudinal study of how highlighting web content change affects people's web interaction. In Proc. of CHI 2010, ACM Press, 1353--1356.

Digital Library

[25]

Wu, J., & Yuan, Y. (2003). Improving searching and reading performance: the effect of highlighting and text color coding. Information & Management, 40, 617--637.

Digital Library

[26]

Wang, H.C., Cosley, D., & Fussell, S.R. (2010). Idea Expander: supporting group brainstorming with conversationally triggered visual thinking stimuli. In Proc. of CSCW 2010, ACM Press, 103--106.

Digital Library

[27]

Wang, H.C., Fussell, S.R., & Cosley, D. (2011). From diversity to creativity: stimulating group brainstorming with cultural differences and conversationally-retrieved picture. In Proc. CSCW 2011, 265--274.

Digital Library

[28]

Yamashita, N., & Ishida, T. (2006). Effects of machine translation on collaborative work. In Proc. CSCW 2006, 515--523.

Digital Library

[29]

Yamashita, N., & Ishida, T. (2006). Automatic prediction of misconceptions in multilingual computermediated communication. In Proc. IUI 2006, 62--69.

Digital Library

[30]

Yamashita, N., Inaba, R., Kuzuoka, H., & Ishida, T. (2009). Difficulties in establishing common ground in multiparty groups using machine translation. In Proc. CHI 2009, 679--688.

Digital Library

[31]

Yeh, C-L., & Chen, Y-C. (2004). Topic identification in Chinese based on centering model. Proc. ACL 2004 Workshop on Reference Resolution and its Application.

Cited By

Mathis FSun YPreussner A(2024)MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate SystemProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656652(1-9)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656652
Li XYamashita NDuan WShirai YFussell S(2022)Improving Non-Native Speakers' Participation with an Automatic Agent in Multilingual GroupsProceedings of the ACM on Human-Computer Interaction10.1145/35675627:GROUP(1-28)Online publication date: 29-Dec-2022
https://dl.acm.org/doi/10.1145/3567562
Robertson SDíaz M(2022)Understanding and Being Understood: User Strategies for Identifying and Recovering From Mistranslations in Machine Translation-Mediated ChatProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3534638(2223-2238)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3534638
Show More Cited By

Index Terms

Same translation but different experience: the effects of highlighting on machine-translated conversations
1. Human-centered computing
  1. Collaborative and social computing

Recommendations

Effect of Machine Translation in Interlingual Conversation: Lessons from a Formative Study
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Language barrier is the primary challenge for effective cross-lingual conversations. Spoken language translation (SLT) is perceived as a cost-effective alternative to less affordable human interpreters, but little research has studied how people ...
Features of Accuracy Mismatch between Back-Translated Sentences and Target-Translated Sentences
CULTURE-COMPUTING '11: Proceedings of the 2011 Second International Conference on Culture and Computing

In communication using a machine translation, inaccurate translation prevents effective communication between individuals and leads to misunderstandings. Back-translation is used to check the accuracy of a sentence translated to a native language. For ...
How beliefs about the presence of machine translation impact multilingual collaborations
CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing

Traditional communication tools tend to make their presence known, e.g., "when my collaborators and I are using IM to discuss our work, how could we not realize the actual presence of IM?" In the case of machine translation (MT) mediated collaborations, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2013

3550 pages

ISBN:9781450318990

DOI:10.1145/2470654

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI '13 Paper Acceptance Rate 392 of 1,963 submissions, 20%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
626
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)4

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mathis FSun YPreussner A(2024)MRTranslate: Bridging Language Barriers in the Physical World Using a Mixed Reality Point-and-Translate SystemProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656652(1-9)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656652
Li XYamashita NDuan WShirai YFussell S(2022)Improving Non-Native Speakers' Participation with an Automatic Agent in Multilingual GroupsProceedings of the ACM on Human-Computer Interaction10.1145/35675627:GROUP(1-28)Online publication date: 29-Dec-2022
https://dl.acm.org/doi/10.1145/3567562
Robertson SDíaz M(2022)Understanding and Being Understood: User Strategies for Identifying and Recovering From Mistranslations in Machine Translation-Mediated ChatProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3534638(2223-2238)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3534638
Kim SOh CCho WShin DSuh BLee J(2021)Trkic G00gle: Why and How Users Game Translation AlgorithmsProceedings of the ACM on Human-Computer Interaction10.1145/34760855:CSCW2(1-24)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476085
Kafle SDingman BHuenerfauth M(2021)Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture VideosACM Transactions on Accessible Computing10.1145/347065114:4(1-24)Online publication date: 15-Oct-2021
https://dl.acm.org/doi/10.1145/3470651
Zhang YAsamoah Owusu DGong EChopra SCarpuat MGao G(2021)Leveraging Machine Translation to Support Distributed Teamwork Between Language-Based Subgroups: The Effects of Automated Keyword TaggingExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451837(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451837
Guerberof Arenas AMoorkens JO’Brien S(2021)The impact of translation modality on user experience: an eye-tracking study of the Microsoft Word user interfaceMachine Translation10.1007/s10590-021-09267-zOnline publication date: 22-Jun-2021
https://doi.org/10.1007/s10590-021-09267-z
Nurminen M(2020)Raw machine translation use by patent professionalsTranslation, Cognition & BehaviorTranslation, Cognition and Behavior10.1075/tcb.00036.nur3:1(100-121)Online publication date: 13-May-2020
https://doi.org/10.1075/tcb.00036.nur
Lim HCosley DFussell S(2019)How Emotional and Contextual Annotations Involve in Sensemaking Processes of Foreign Language Social Media PostsProceedings of the ACM on Human-Computer Interaction10.1145/33591713:CSCW(1-18)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359171
Haslwanter JHeiml MWolfartsberger JMakedon F(2019)Lost in translationProceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3316782.3322746(333-342)Online publication date: 5-Jun-2019
https://dl.acm.org/doi/10.1145/3316782.3322746
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents