Abstract
The feasibility of using a motion sensor to replace a conventional electrolarynx (EL) user interface was explored. A mobile phone motion sensor with multi-agent platform was used to investigate on/off and pitch frequency control capability. A very small battery operated ARM-based control unit was also developed to evaluate the motion sensor based user-interface. The control unit was placed on the wrist and the vibration device was placed against the throat using support bandage. Two different conversion methods were used for the forearm tilt angle to pitch frequency conversion: linear mapping method and F0 template-based method. A perceptual evaluation was performed with two well-trained normal speakers and ten subjects. The results of the evaluation study showed that both methods were able to produce better speech quality in terms of naturalness.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
SECOM company Ltd., Electrolarynx “MY VOICE”, http://www.secom.co.jp/personal/medical/myvoice.html
Griffin laboratories, Tru Tone users guide
Kikuchi, Y., Kasuya, H.: Development and evaluation of pitch adjustable electrolarynx. In: SP 2004, pp. 761–764 (2004)
Takahashi, H., Nakao, M., Ohkusa, T., Hatamura, Y., Kikuchi, Y., Kaga, K.: Pitch control with finger pressure for electrolaryngial or intra-mouth vibrating speech.Jp. J. Logopedics and Phoniatrics 42(1), 1–8 (2001)
Saikachi, Y.: Development and Perceptual Evaluation of Amplitude-Based F0 Control in Electrolarynx Speech. Journal of Speech, Language, and Hearing Research 52, 1360–1369 (2009)
Uemi, N., Ifukube, T., Takahashi, M., Matsushima, J.: Design of a new electrolarynx having a pitch control function. In: Proceedings of 3rd IEEE International Workshop on Robot and Human Communication, RO-MAN, Nagoya, Japan, July 18-20, pp. 198–203 (1994)
Nakamura, K., Toda, T., Saruwatari, H., Shikano, K.: The use of air-pressure sensor in electrolaryngeal speech enhancement. In: INTERSPEECH, Makuahari, Japan, September 26-30, pp. 1628–1631 (2010)
Fuchs, A.K., Hagmüller, M.: Learning an Artificial F0- Contour for ALT Speech. In: INTERSPEECH, Portland, Oregon, September 9-13 (2012)
Kubert, H.L.: Electromyographic control of a hands-free electrolarynx using neck strap muscles. J. Commun. Disord. 42(3), 211–225 (2009)
Matsui, K., et al.: Enhancement of Esophageal Speech using Formant Synthesis. Journal of Acoustical Society of Japan (E) 23(2), 66–79 (2002)
Fujisaki, H.: In Vocal Physiology: Voice Production, Mechanisms and Functions. Raven Press (1988)
Matsui, K., et al.: A preliminary user interface study of speech enhancement system. In: Proc. of the 1st International Conference on Industrial Application Engineering, pp. 53–56 (2013)
Sánchez, A., Villarrubia, G., Zato, C., Rodríguez, S., Chamoso, P.: A gateway protocol based on FIPA-ACL for the new agent platform PANGEA. In: Pérez, J.B., et al. (eds.) Trends in Pract. Appl. of Agents & Multiagent Syst. AISC, vol. 221, pp. 41–51. Springer, Heidelberg (2013)
Zato, C., Villarrubia, G., Sánchez, A., Bajo, J., Corchado, J.M.: PANGEA: A New Platform for Developing Virtual Organizations of Agents. International Journal of Artificial Intelligence 11(13), 93–102 (2013)
Matsui, K., et al.: Development of Electrolarynx with Hands-Free Prosody Control. In: The Proc. of the 8th ISCA, August 31, pp. 273–277 (2013)
Poslad, S., Buckle, P., Hadingham, R.: The FIPA-OS agent platform: Open Source for Open Standards. In: Procedings of Autonous Agents AGENTS 2000, Barcelona (2000)
Argente, E., Giret, A., Valero, S., Julian, V., Botti, V.: Survey of MAS Methods and Platforms focusing on organizational concepts. In: Vitria, J., Radeva, P., Aguilo, I. (eds.) Recent Advances in Artificial Intelligence Research and Development, Frontiers in Artificial Intelligence and Applications, pp. 309–316 (2004)
McCabe, F.G., Clark, K.L.: APRIL—Agent PRocess Interaction Language. In: Wooldridge, M.J., Jennings, N.R. (eds.) Proceedings of the Workshop on Agent Theories, Architectures, and Languages on Intelligent Agents (ECAI 1994), pp. 324–340. Springer-Verlag New York, Inc., New York (1995)
Bicharra García, A.C., Sanchez-Pi, N., Correia, L., Molina, J.M.: Multi-agent simulations for emergency situations in an airport scenario. Advances in Distributed Computing and Artificial Intelligence Journal (2013) ISSN: 2255-2863
Bordini, R.H., Hübner, J.F., Vieira, R.: Jason and the Golden Fleece of agent-oriented programming. In: Bordini, R.H., Dastani, M., Dix, J., El Fallah Seghrouchni, A. (eds.) Multi-Agent Programming: Languages, Platforms and Applications, ch. 1, pp. 3–37. Springer (2005)
Tapia, D.I., Abraham, A., Corchado, J.M., Alonso, R.S.: Agents and ambient intelligence: case studies. Journal of Ambient Intelligence and Humanized Computing 1(2), 85–93 (2010)
Bajo, J., Corchado, J.M.: Evaluation and monitoring of the air-sea interaction using a CBR-agents approach. In: Muñoz-Ávila, H., Ricci, F. (eds.) ICCBR 2005. LNCS (LNAI), vol. 3620, pp. 50–62. Springer, Heidelberg (2005)
Tapia, D.I., Rodríguez, S., Bajo, J., Corchado, J.M.: FUSION@, a SOA-based multi-agent architecture. In: International Symposium on Distributed Computing and Artificial Intelligence 2008 (DCAI 2008), pp. 99–107 (2008)
Rodríguez, S., Pérez-Lancho, B., De Paz, J.F., Bajo, J., Corchado, J.M.: Ovamah: Multiagent-based adaptive virtual organizations. In: 12th International Conference on Information Fusion, FUSION 2009, pp. 990–997 (2009)
Tapia, D.I., De Paz, J.F., Rodríguez, S., Bajo, J., Corchado, J.M.: Multi-agent system for security control on industrial environments. International Transactions on System Science and Applications Journal 4(3), 222–226 (2008)
Rodríguez, S., de Paz, Y., Bajo, J., Corchado, J.M.: Social-based planning model for multiagent systems. Expert Systems with Applications 38(10), 13005–13023 (2011)
Pinzón, C.I., Bajo, J., De Paz, J.F., Corchado, J.M.: S-MAS: An adaptive hierarchical distributed multi-agent architecture for blocking malicious SOAP messages within Web Services environments. Expert Systems with Applications 38(5), 5486–5499
CommonWell Project (2010), http://commonwell.eu/index.php
Monami project (2010), http://www.monami.info/
DISCATEL (2010), http://www.imsersounifor.org/proyectodiscatel/
INREDIS (2011), http://www.inredis.es/
INCLUTEC (2011), http://www.idi.aetic.es/evia/es/inicio/contenidos/documentacion/documentacion_grupos_de_trabajo/contenido.aspx
Zato, C., Villarrubia, G., Sánchez, A., Bajo, J., Corchado, J.M.: PANGEA: A New Platform for Developing Virtual Organizations of Agents. International Journal of Artificial Intelligence 11(A13), 93–102 (2013)
Pavon, J., Sansores, C., Gomez-Sanz, J.J.: Modelling and simulation of social systems with INGENIAS. International Journal of Agent-Oriented Software Engineering 2(2), 196–221 (2008)
Rodríguez, S., de Paz, Y., Bajo, J., Corchado, J.M.: Social-based planning model for multiagent systems. Expert Systems with Applications 38(10), 13005–13023 (2011)
Garijo, F., Gómes-Sanz, J.J., Pavón, J., Massonet, P.: Multi-agent system organization: An engineering perspective. Pre-Proceeding of the 10th European Workshop on Modeling Autonomous Agents in a Multi-Agent World, MAAMAW 2001 (2001)
Zato, C., Sánchez, A., Villarrubia, G., Bajo, J., Rodríguez, S.: Integration of a proximity detection prototype into a VO developed with PANGEA. In: Casillas, J., Martínez-López, F.J., Corchado, J.M. (eds.) Management of Intelligent Systems. AISC, vol. 171, pp. 197–204. Springer, Heidelberg (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Matsui, K., Kimura, K., Pérez, A., Rodríguez, S., Corchado, J.M. (2014). Development of Electrolarynx by Multi-agent Technology and Mobile Devices for Prosody Control. In: Corchado, J.M., et al. Highlights of Practical Applications of Heterogeneous Multi-Agent Systems. The PAAMS Collection. PAAMS 2014. Communications in Computer and Information Science, vol 430. Springer, Cham. https://doi.org/10.1007/978-3-319-07767-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-07767-3_6
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07766-6
Online ISBN: 978-3-319-07767-3
eBook Packages: Computer ScienceComputer Science (R0)