Abstract
Variants of the Rand index of clustering agreement have been used to measure agreement between spatial configurations of points (Akkucuk 2004; Akkucuk and Carroll 2006; Chen 2006; Chen and Buja 2009). For these measures, the k-nearest neighbors of each point are compared across configurations. The agreement measure can be generalized across multiple values of k (France and Carroll 2007). The generalized agreement metric is denoted as ψ. In this paper, we further generalize ψ to the case of more than two configurations. We develop a partial agreement measure as a neighborhood agreement equivalent of the partial correlation coefficient. We demonstrate the use of ψ and partial ψ using an illustrative example. (MATLAB implementations of routines for calculating ψ and partial ψ are available at https://sites.google.com/site/psychminegroup/.)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akkucuk, U. (2004). Nonlinear mapping: Approaches based on optimizing an index of continuity and applying classical metric MDS on revised distances. Ph.D. dissertation, Rutgers.
Akkucuk, U., & Carroll, J. D. (2006). PARAMAP vs. Isomap: a comparison of two nonlinear mapping algorithms. Journal of Classification, 23(2), 221–254.
Barro, R. J., & Lee, J. Wha. (2001). International data on educational attainment: updates and implications. Oxford Economic Papers, 53(3), 541–563.
Brusco, M., & Steinley, D. (2008). A binary integer program to maximize the agreement between partitions. Journal of Classification, 25(2), 185–193.
Chen, L. (2006). Local multidimensional scaling for nonlinear dimension reduction, graph layout and proximity analysis. Ph.D. dissertation, University of Pennsylvania.
Chen, L., & Buja, A. (2009). Local multidimensional scaling for nonlinear dimension reduction, graph drawing, and proximity analysis. Journal of the American Statistical Association, 104(486), 209–219.
Corrodo, G. (1921). Measurement of inequality and incomes. The Economic Journal, 31, 124–126.
Fisher, R. A. (1924). The distribution of the partial correlation coefficient. Metron, 3, 332.
France, S. L., & Carroll, J. D. (2007). Development of an agreement metric based upon the Rand index for the evaluation of dimensionality reduction techniques, with applications to mapping customer data. In P. Perner (Ed.), Machine learning and data mining in pattern recognition (pp. 499–517). Heidelberg: Springer.
France, S. L. & Carroll, J. D. (2009). DEMScale: Large scale MDS accounting for a ridge operator and demographic variables. In N. M. Adams, C. Robardet, A. Siebes, & J.-F. Boulicaut (Eds.), Proceedings of the 8th international symposium on intelligent data analysis. Heidelberg: Springer.
Hubert, L. J., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2(1), 193–218.
Kaski, S., Nikkila, J., Oja, M., Venna, J., Toronen, P., & Castren, E. (2003). Trustworthiness and metrics in visualizing similarity of gene expression. BMC Bioinformatics, 4(1), 48. M3: 10.1186/1471-2105-4-48.
Kruskal, J. B. (1964). Multidimensional scaling for optimizing a goodness of fit metric to a nonmetric hypothesis. Psychometrika, 29(1), 1–27.
Lee, J. A. & Verleysen, M. (2009). Quality assessment of dimensionality reduction: Rank-based criteria. Neurocomputing, 72(7–9), 1431–1443.
Lueks, W., Mokbel, B., Biehl, M., & Hammer, B. (2011). How to evaluate dimensionality reduction? In Proceedings of the workshop – new challenges in neural computation (Vol. 5, pp. 29–37). ISSN:1865-3960. http://www.techfak.uni-bielefeld.de/~fschleif/mlr/mlr\_05\_2011.pdf;MLR0511.
Rand, W. M. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66(336), 846–850.
Tenenbaum, J. B., de Silva, V., & Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500), 2319–2323.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
France, S.L. (2013). Properties of a General Measure of Configuration Agreement. In: Lausen, B., Van den Poel, D., Ultsch, A. (eds) Algorithms from and for Nature and Life. Studies in Classification, Data Analysis, and Knowledge Organization. Springer, Cham. https://doi.org/10.1007/978-3-319-00035-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-00035-0_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-00034-3
Online ISBN: 978-3-319-00035-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)