Abstract
Non-rigid and partial 3D model retrieval are two significant and challenging research directions in the field of 3D model retrieval. Little work has been done in proposing a hybrid shape descriptor that works for both retrieval scenarios, let alone the integration of the component features of the hybrid shape descriptor in an automatic way. In this paper, we propose a hybrid shape descriptor that integrates both geodesic distance-based global features and curvature-based local features. We also develop an automatic algorithm to generate meta similarity resulting from different component features of the hybrid shape descriptor based on Particle Swarm Optimization. Experimental results demonstrate the effectiveness and advantages of our framework, as well as the significant improvements in retrieval performances. The framework is general and can be applied to similar approaches that integrate more features for the development of a single algorithm for both non-rigid and partial 3D model retrieval.
Similar content being viewed by others
References
Akbar S, Kueng J, Wagner R (2006) Multi-feature based 3D model similarity retrieval. In: 2006 International conference on computing informatics (ICOCI’06), pp 1–6
Arthur D, Vassilvitskii S (2007) k-means+ +: the advantages of careful seeding. In: Bansal N, Pruhs K, Stein C (eds) SODA. SIAM, pp 1027–1035
Attene M, Marini S, Spagnuolo M, Falcidieno B (2010) The fast reject schema for part-in-whole 3D shape matching. In: Daoudi M, Schreck T, Spagnuolo M, Pratikakis I, Veltkamp RC, Theoharis T (eds) Eurographics Workshop on 3D Object Retrieval, Norrköping, Sweden May 2, 2010. Proceedings. Eurographics Association, pp 23–30
Ben-Chen M, Gotsman C (2008) Characterizing shape using conformal factors. In: 3DOR 2008, pp 1–8
Biasotti S, Marini S (2006) Sub-part correspondence using structure and geometry. In: Gallo G, Battiato S, Stanco F (eds) Eurographics Italian chapter conference. Eurographics, pp 23–28
Bober M (2011) MPEG-7 visual shape descriptors. IEEE Trans Circuits Syst Video Technol 11(6):716–719
Borg I, Groenen P (2005) Modern multidimensional scaling: theory and applications, 2nd edn. Springer
Bronstein AM, Bronstein MM, Guibas LJ, Ovsjanikov M (2011) Shape google: geometric words and expressions for invariant shape retrieval. ACM Trans Graph 30(1):1:1–1:20
Bronstein MM, Kokkinos I (2010) Scale-invariant heat kernel signatures for non-rigid shape recognition. In: CVPR10, pp 1704–1711
Bustos B, Schreck T, Walter M, Barrios JM, Schaefer M, Keim DA (2012) Improving 3D similarity search by enhancing and combining 3D descriptors. Multimed Tools Appl 58(1):81–108
Cohen SD, Guibas LJ (1999) The Earth mover’s distance under transformation sets. In: ICCV, pp 1076–1083
Cornea ND, Demirci MF, Silver D, Shokoufandeh A, Dickinson SJ, Kantor PB (2005) 3D object retrieval using many-to-many matching of curve skeletons. In: International Conference on Shape Modeling and Applications (SMI 2005), 15–17 June 2005, Cambridge, MA, USA. IEEE Computer Society, pp 368–373
Daras P, Axenopoulos A, Litos G (2012) Investigating the effects of multiple factors towards more accurate 3-D object retrieval. IEEE Trans Multimed 14(2), 374–388
Eberhart RC, Hu X (1999) Human tremor analysis using Particle Swarm Optimization. In: Proc. of the congress on evolutionary computation, pp 1927–1930
Elbaz AE, Kimmel R (2003) On bending invariant signatures for surfaces. IEEE Trans Pattern Anal Mach Intell 25(10):1285–1295
Faloutsos C, Lin KI (1995) Fastmap: A fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets. In: Carey MJ, Schneider DA (eds) SIGMOD Conference, pp 163–174
Furuya T, Ohbuchi R (2009) Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features. In: Marchand-Maillet S, Kompatsiaris Y (eds) CIVR. ACM, pp 1–8
Gal R, Cohen-Or D (2006) Salient geometric features for partial shape matching and similarity. ACM Trans Graph 25(1):130–150
Garland M, Heckbert PS (1997) Surface simplification using quadric error metrics. In: SIGGRAPH, pp 209–216
Gatzke T, Grimm C, Garland M, Zelinka S (2005) Curvature maps for local shape comparison. In: International conference on shape modeling and applications (SMI 2005), 15–17 June 2005, Cambridge, MA, USA. IEEE Computer Society, pp 246–255
Groenen P, Velden Mvd (2004) Multidimensional scaling. Tech. rep.
Hamza AB, Krim H (2003) Geodesic object representation and recognition. In: Nyström I, di Baja GS, Svensson S (eds) DGCI, Lecture notes in computer science, vol 2886. Springer, pp 378–387
Heider P, Pierre-Pierre A, Li R, Grimm C (2011) Local shape descriptors, a survey and evaluation. In: Laga H, Schreck T, Ferreira A, Godil A, Pratikakis I, Veltkamp RC (eds) Eurographics Workshop on 3D Object Retrieval 2011, Llandudno, UK, April 10, 2011. Proceedings. Eurographics Association, pp 49–56
Horn B (1984) Extended gaussian images. Proc IEEE 72(12):1671–1686
Järvelin K, Kekäläinen J (2002) Cumulated gain-based evaluation of IR techniques. ACM Trans Inf Syst 20(4):422–446
Johnson AE, Hebert M (1999) Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans Pattern Anal Mach Intell 21(5):433–449
Kalogerakis E, Hertzmann A, Singh K (2010) Learning 3D mesh segmentation and labeling. ACM Trans Graph 29(4):102:1–102:12
Koenderink JJ, van Doorn AJ (1992) Surface shape and curvature scales. Image Vis Comput 10(8):557–564
Kruskal J (1964) Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29(1):1–27
Laga H, Nakajima M (2008) Supervised learning of similarity measures for content-based 3D model retrieval. In: LKR, pp 210–225
Lavoué G (2011) Bag of words and local spectral descriptor for 3D partial shape retrieval. In: Laga H, Schreck T, Ferreira A, Godil A, Pratikakis I, Veltkamp RC (eds) Eurographics Workshop on 3D Object Retrieval 2011, Llandudno, UK, April 10, 2011. Proceedings. Eurographics Association, pp 41–48
Lee CH, Varshney A, Jacobs DW (2005) Mesh saliency. ACM Trans Graph 24(3):659–666
Lévy B (2006) Laplace-Beltrami eigenfunctions towards an algorithm that “understands” geometry. In: SMI, p 13
Li B, Godil, A, Johan, H (2012) Non-rigid and partial 3D model retrieval using hybrid shape descriptor and meta similarity. In: George B, et al (eds) ISVC 2012, LNCS, Advances in visual computing. Springer, Heidelberg
Li B, Johan H (2011) 3D model retrieval using hybrid features and class information. Multimed Tools Appl 62(3):821–846
Li FF, Perona P, California Institute of Technology (2005) A Bayesian hierarchical model for learning natural scene categories. In: CVPR (2), IEEE Computer Society, pp 524–531
Li X, Godil A (2009) Exploring the Bag-of-Words method for 3D shape retrieval. In: ICIP, IEEE, pp 437–440
Lian Z, Godil A (2011) A feature-preserved canonical form for non-rigid 3D meshes. In: Goesele M, Matsushita Y, Sagawa R, Yang R (eds) 3DIMPVT, IEEE, pp 116–123
Lian Z, Godil A, Bustos B, Daoudi M, Hermans J, Kawamura S, Kurita Y, Lavoué G, Nguyen HV, Ohbuchi R, Ohkita Y, Ohishi Y, Porikli F, Reuter M, Sipiran I, Smeets D, Suetens P, Tabia H, Vandermeulen D (2013) A comparison of methods for non-rigid 3D shape retrieval. Pattern Recogn 46(1):449–461
Lian Z, Godil A, Bustos B, Daoudi M, Hermans J, Kawamura S, Kurita Y, Lavoué G, Nguyen HV, Ohbuchi R, Ohkita Y, Ohishi Y, Reuter FPM, Sipiran I, Smeets D, Suetens P, Tabia H, Vandermeulen D (2011) SHREC ’11 track: Shape retrieval on non-rigid 3D watertight meshes. In: Laga H, Schreck T, Ferreira A, Godil A, Pratikakis I, Veltkamp RC (eds) Eurographics Workshop on 3D Object Retrieval 2011, Llandudno, UK, April 10, 2011. Proceedings. Eurographics Association, pp 79–88
Lian Z, Godil A, Fabry T, Furuya T, Hermans J, Ohbuchi R, Shu C, Smeets D, Suetens P, Vandermeulen D, Wuhrer S (2010) SHREC’10 track: Non-rigid 3D shape retrieval. In: Daoudi M, Schreck T, Spagnuolo M, Pratikakis I, Veltkamp RC, Theoharis T (eds) Eurographics Workshop on 3D Object Retrieval, Norrköping, Sweden May 2, 2010. Proceedings. Eurographics Association, pp 101–108
Lian Z, Godil A, Sun X (2010) Visual similarity based 3D shape retrieval using Bag-of-Features. In: Shape modeling international. IEEE computer society, pp 25–36
Lian Z, Godil A, Sun X, Zhang H (2010) Non-rigid 3D shape retrieval using Multidimensional Scaling and Bag-of-Features. In: ICIP, IEEE, pp 3181–3184
Lian Z, Godil A, Xiao J (2012) Feature-preserved 3D canonical form. Int J Comput Vis 102(1–3):221–238
Liu Y, Wang X, Wang HY, Zha H, Qin H (2010) Learning robust similarity measures for 3D partial shape retrieval. Int J Comput Vis 89(2–3):408–431
Liu Y, Zha H, Qin H (2006) Shape topics: A compact representation and new algorithms for 3D partial shape retrieval. In: CVPR (2), pp 2025–2032
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110
Maes C, Fabry T, Keustermans J, Smeets D, Suetens P, Vandermeulen D (2010) Feature detection on 3D face surfaces for pose normalisation and recognition. In: Proceedings of the 4th IEEE international conference on biometrics: theory applications and systems (BTAS), pp 1–6
Nguyen HV, Porikli F (2011) Concentric ring signature descriptor for 3d objects. In: Macq B, Schelkens P (eds) ICIP. IEEE, pp 2893–2896
Ohbuchi R, Osada K, Furuya T, Banno T (2008) Salient local visual features for shape-based 3D model retrieval. In: Shape modeling international, IEEE, pp 93–102
Osada R, Funkhouser T, Chazelle B, Dobkin D (2001) Matching 3D models with shape distributions. In: Proc. of shape modeling and applications, pp 154–166
Rabin J, Peyré G, Cohen LD (2010) Geodesic shape retrieval via optimal mass transport. In: ECCV (5), pp 771–784
Raviv D, Bronstein MM, Bronstein AM, Kimmel R (2010) Volumetric heat kernel signatures. In: Proceedings of the ACM workshop on 3D object retrieval, 3DOR’10. ACM, New York, USA, pp. 39–44
Reuter M, Wolter FE, Peinecke N (2006) Laplace-Beltrami spectra as “Shape-DNA” of surfaces and solids. Comput-Aided Des 38(4):342–366
Rusinkiewicz S (2004) Estimating curvatures and their derivatives on triangle meshes. In: 3DPVT, IEEE computer society, pp 486–493
Sammon JW (1969) A nonlinear mapping for data structure analysis. IEEE Trans Comput 18(5):401–409
Schwartz EL, Shaw A, Wolfson E (1989) A numerical solution to the generalized Mapmaker’s problem: flattening nonconvex polyhedral surfaces. IEEE Trans Pattern Anal Mach Intell 11(9):1005–1008
Sfikas K, Theoharis T, Pratikakis I (2012) Non-rigid 3D object retrieval using topological information guided by conformal factors. Vis Comput 28(9):943–955.
Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: Proc. of IEEE international conference on evolutionary computation (ICEC), pp 69–73
Shilane P, Min P, Kazhdan M, Funkhouser T (2004) The Princeton shape benchmark. In: Proc. of shape modeling and applications, pp 167–178
Siddiqi K, Zhang J, Macrini D, Shokoufandeh A, Bouix S, Dickinson SJ (2008) Retrieving articulated 3-D models using medial surfaces. Mach Vis Appl 19(4):261–275
Smeets D, Fabry T, Hermans J, Vandermeulen D, Suetens P (2009) Isometric deformation modelling for object recognition. In: Jiang X, Petkov N (eds) CAIP, Lecture notes in computer science, vol 5702. Springer, pp 757–765
Smeets D, Fabry T, Hermans J, Vandermeulen D, Suetens P (2010) Inelastic deformation invariant modal representation for non-rigid 3D object recognition. In: López FJP, Fisher RB (eds) AMDO, Lecture notes in computer science, vol 6169. Springer, pp 162–171
Sun J, Ovsjanikov M, Guibas L (2009) A concise and provably informative multi-scale signature based on heat diffusion. In: Alexa M, Kazhdan M, Polthier K (eds) Eurographics symposium on geometry processing, pp 1383–1392
Sundar H, Silver D, Gagvani N, Dickinson SJ (2003) Skeleton based shape matching and retrieval. In: Shape modeling international. IEEE computer society, pp 130–139
Tang S, Godil A (2012) An evaluation of local shape descriptors for 3D shape retrieval. CoRR abs/1202.2368
Tierny J, Vandeborre JP, Daoudi M (2009) Partial 3D shape retrieval by reeb pattern unfolding. Comput Graph Forum 28(1):41–55
Toldo R, Castellani U, Fusiello A (2010) The bag of words approach for retrieval and categorization of 3D objects. Vis Comput 26(10):1257–1268
Vedaldi A, Fulkerson B (2008) VLFeat: An open and portable library of computer vision algorithms. http://www.vlfeat.org/. Accsessed April 2013
Veltkamp RC, ter Haar FB (2007) SHREC 2007 3D Retrieval contest. Technical Report UU-CS-2007-015, Department of Information and Computing Sciences, Utrecht University
Villani C (2003) Topics in optimal transportation. American Mathematical Society
Wu HY, Zha H, Luo T, Wang X, Ma S (2010) Global and local isometry-invariant descriptor for 3D shape comparison and partial matching. In: CVPR, pp 438–445
Wuhrer S, Shu C, Bose P, Azouz ZB (2007) Posture invariant correspondence of incomplete triangular manifolds. Int J Shape Model 13(2):139–157
Zhang H, van Kaick O, Dyer R (2007) Spectral methods for mesh processing and analysis. In: Proc. of Eurographics state-of-the-art report, pp 1–22
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, B., Godil, A. & Johan, H. Hybrid shape descriptor and meta similarity generation for non-rigid and partial 3D model retrieval. Multimed Tools Appl 72, 1531–1560 (2014). https://doi.org/10.1007/s11042-013-1464-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1464-2