Assessing Organizational Effectiveness of Cooperative Agents
Pages 917 - 926
Abstract
This paper investigates the effect of agents coalitional strategy on their effectiveness using an evaluation approach that causes no alteration of the global systems performance. Cooperation process is thus considered during the execution of a Multiagent System (MAS) in order to collect all necessary data for the evaluation phase. A structural analysis is then led to set instant and global assessments of the agents management and output. The observation and evaluation tools are implemented using aspect-oriented programming. We prove through experiments that they do not alter the global performance of the system regarding execution time and reached scores. The approach could then be validated as an objective evaluator of the system by judging real organizational capabilities of its agents in achieving their goals.
References
[1]
B. Horling, V. Lesser, A survey of multi-agent organizational paradigms, The Knowledge Engineering Review, 19 (2004) 281-316.
[2]
S. Airiau, Cooperative games and multiagent systems, The Knowledge Engineering Review, 28 (2013) 381-424.
[3]
E. Kaddoum, M.P. Gleizes, J.P. George, P. Glize, G. Picard, Analyse des critres dvaluation de systmes multi-agents adaptatifs, in: Analyse des critres dvaluation de systmes multi-agents adaptatifs, JFSMA, 2009, pp. 123-132.
[4]
F.B. Hmida, W.L. Chaari, M. Tagina, Graph theory to evaluate communication in industrial multiagent systems, IJIIDS, 5 (2011) 361-388.
[5]
Bouzouita, K., Lejouad Chaari, W., Tagina, M. Utility-based approach to represent agents conversational preferences. In: Information Processing and Management of Uncertainty in Knowledge-Based Systems - 15th International Conference, IPMU 2014, Montpellier, France, July 15-19, 2014, Proceedings, Part II; vol. 443 CCIS. Springer Berlin Heidelberg. ISBN 9783319088549; 2014, p. 454-463.
[6]
Hmida, F.B., Chaari, W.L., Dupas, R., Seguy, A. Graph-based evaluation of organization in multiagent systems. In: 9th International Conference of Modeling, Optimization and Simulation-MOSIM12. 2012.
[7]
R. Mandiau, E. Le Strugeon, G. Agimont, Study of the influence of organizational structure on the efficiency of a multi-agent system, Networking and Information Systems, 2 (1999) 153-180.
[8]
Pujol-Gonzalez, M., Kleiner, A., Farinelli, A., Ramchurn, S., Shi, B., Mafoletti, F., et al. Rmasbench: Multi-agent coordination benchmark 2012-2014. URL: http://github.com/RMASBench/RMASBench.
[9]
Hmida, F.B. Performance Evaluation of Multiagent Systems. Phd thesis; University of Bordeaux I; University of Manouba, Tunisia; 2013. URL: https://hal.archives-ouvertes.fr/tel-01101049.
[10]
Hmida, F.B., Chaari, W.L., Tagina, M. Aspect-based multiagent systems observation for performance evaluation Intelligent Systems and Agents 2008; 172.
[11]
Sba, A.H., Chaari, W.L., Ghdira, K. Intra-agent explanation using temporal and extended causal maps. In: 17th International Conference in Knowledge Based and Intelligent Information and Engineering Systems, KES 2013, Kitakyushu, Japan, 9-11 September 2013. 2013, p. 241-249.
[12]
A.H. Sba, W.L. Chaari, Extended causal map for reasoning explanation in multi-agent systems, IJISTA, 12 (2013) 301-315.
[13]
G. Kiczales, J. Lamping, A. Mendhekar, C. Maeda, C.V. Lopes, J. Loingtier, Aspect-oriented programming, in: Aspect-oriented programming, ECOOP, 1997, pp. 220-242.
[14]
Farinelli, A., Rogers, A., Petcu, A., Jennings, N.R. Decentralised coordination of low-power embedded devices using the max-sum algorithm. In: AAMAS 08 Proc. 7th Int. Jt. Conf. Auton. agents multiagent Syst., Estoril, Portugal, May 12-16, 2008, Volume 2; Aamas. ISBN 978-0-9817381-1-6; 2008, p. 639-646.
[15]
Ohta, M., Koto, T., Takeuchi, I., Takahashi, T., Kitano, H. Design and implementation of the kernel and agents for the robocup-rescue. In: MultiAgent Systems, 2000. Proceedings. Fourth International Conference on. IEEE; 2000, p. 423-424.
[16]
Pujol-Gonzalez, M., Cerquides, J., Farinelli, A., Meseguer, P., Rodriguez-Aguilar, J.A. Efficient Inter-Team Task Allocation in RoboCup Rescue. In: Proc. 14th Int. Conf. Auton. Agents Multiagent Syst. ISBN 9781450337694; 2015, p. 413-421. URL: http://www.aamas2015.com/en/AAMAS 2015 USB/aamas/p413.pdf.
Recommendations
An evaluation method for multi-agent systems
KES-AMSTA'10: Proceedings of the 4th KES international conference on Agent and multi-agent systems: technologies and applications, Part IThe growing employment of Multi-Agent Systems (MASs) in several domains of everyday life has provided the impetus for much research into new tools and methodologies for their design and implementation. But up to now, few works have focused on evaluation ...
Evaluation of multi-agent systems: proposal and validation of a metric plan
Transactions on Computational Collective Intelligence VIIIn the MAS evaluation research field there are still few works devoted to evaluating systems' efficacy, and none of these aimed to measure the adequacy of the MAS in terms of rationality, autonomy, reactivity and environment adaptability. A reliable ...
Self-organization in service discovery in presence of noncooperative agents
Self-organization and cooperation of agents in open societies play an important role in the success of the service discovery process. Self-organization allows agents to deal with dynamic requirements in service demand. Moreover, in distributed ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
Elsevier Science Publishers B. V.
Netherlands
Publication History
Published: 01 September 2017
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 30 Jan 2025