Abstract
As language is fundamental to human activities, proficiency in other languages becomes important. Besides for developing abilities for communication, the knowledge is also a tool for a survival. With the introduction of computerized mobile devices, i.e. PDAs, new opportunities for communicating in other language arose. This paper describes a new communication paradigm that is language independent using icon language on a PDA. Users can create iconic messages as realization of their concepts or ideas in mind. The proof of concept tool is able to interpret and convert the messages to (natural language) text and speech in different languages. To provide faster interactions in next icon selection, the tool has icon prediction. Our user test results confirmed that using provided icons our target users could express their concepts and ideas solely using a spatial arrangement of icons.
The research reported here is part of the Interactive Collaborative Information Systems (ICIS) project, supported by the Dutch Ministry of Economic Affairs, grant nr: BSIK03024.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Basu A., Sankar S., Chakraborty K., Bhattarcharya S., Choudhury M, Patel R.: Vernacula Education and Communication Tool for the People with Multiple Disabilities, Development by Design Conference, Bangalore (2002)
Beardon, C.: CD-Icon, an Iconic Language-Based on Conceptual Dependency. Intelligent Tutoring Media 3(4) (1992)
Black A.W., Lenzo A.K.: Flite, a Small, Fast Speech Synthesis Engine, System Documentation (edn 1.2) for Flite version 1.2, USA (2003)
Boren, T., Ramey, J.: Thinking Aloud, Reconciling Theory and Practice. IEEE Transactions on Professional Communication, 3–43 (2000)
Bousquet-Vernhettes, C., Privat, R., Vigouroux, N.: Error Handling in Spoken Dialogue Systems, Toward Corrective Dialogue. In: Proc. Of ISCA 2003, USA (2003)
Chandler D.: Semiotics, the Basic, Routledge (2001)
Chang, S.K., Polese, G., Orefice, S., Tucci, M.: A Methodology and Interactive Environment for Iconic Language Design. International Journal of Human Computer Studies 41, 683–716 (1994)
Comerford, L., Frank, D., Gopalakrishnan, P., Gopnanth, R., Sedivy, J.: The IBM Personal Speech Assistant. In: Proc. of the ICASSP 2001, USA (2001)
Corballis, M.C.: Did language Evolve from Manual Gestures? In: 3rd Conference of The Evolution of Language 2000, France (2000)
Dusan, S., Gadbois, G.J., Flanagan, J.: Multimodal Interaction on PDA’s integrating Speech and Pen Inputs. In: Proc of. EUROSPEECH 2003, Switzerland (2003)
Fitrianie S.: An Icon-Based Communication Tool on a PDA, Postgraduate Thesis, Eindhoven University of Technology, the Netherlands (2004)
Frutiger, A.: Sign and Symbols, Their Design and Meaning. van Nostrand Reinholt, New York (1989)
Horton, W.: The Icon Book. John Wiley, New York (1994)
Housz T.I.: The Elephant’s Memory (1994-1996)
Kjeldskov, J., Kolbe, N.: Interaction Design for Handheld Computers. In: Proc. of the 5th APCHI 2002, Science Press, China (2002)
Leemans N.E.M.P.: VIL, A Visual Inter Lingua, Doctoral Dissertation, Worcester Polytechnic Institute, USA (2001)
Littlejohn, S.W.: Theories of human communication, 5th edn. Wadsworth, Belmont (1996)
Mealing, S., Yazdabi, M.: Communicating Through Pictures, Department of Computer Science. University of Exeter, England (1992)
Perlovsky, L.I.: Emotions, Learning and Control, Proc. of International Symposium: Intelligent Control, Intelligent Systems and Semiotics, Cambridge, MA, pp. 131–137 (1999)
WahlsterW., R.N., Blocher, A.: SmartKom,Multimodal Communication with a Life- Like Character. In: Proc. Of EUROSPEECH 2001, Denmark (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fitrianie, S., Rothkrantz, L.J.M. (2005). Language-Independent Communication Using Icons on a PDA. In: Matoušek, V., Mautner, P., Pavelka, T. (eds) Text, Speech and Dialogue. TSD 2005. Lecture Notes in Computer Science(), vol 3658. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11551874_52
Download citation
DOI: https://doi.org/10.1007/11551874_52
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28789-6
Online ISBN: 978-3-540-31817-0
eBook Packages: Computer ScienceComputer Science (R0)