[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Style compatibility for 3D furniture models

Published: 27 July 2015 Publication History

Abstract

This paper presents a method for learning to predict the stylistic compatibility between 3D furniture models from different object classes: e.g., how well does this chair go with that table? To do this, we collect relative assessments of style compatibility using crowdsourcing. We then compute geometric features for each 3D model and learn a mapping of them into a space where Euclidean distances represent style incompatibility. Motivated by the geometric subtleties of style, we introduce part-aware geometric feature vectors that characterize the shapes of different parts of an object separately. Motivated by the need to compute style compatibility between different object classes, we introduce a method to learn object class-specific mappings from geometric features to a shared feature space. During experiments with these methods, we find that they are effective at predicting style compatibility agreed upon by people. We find in user studies that the learned compatibility metric is useful for novel interactive tools that: 1) retrieve stylistically compatible models for a query, 2) suggest a piece of furniture for an existing scene, and 3) help guide an interactive 3D modeler towards scenes with compatible furniture.

Supplementary Material

ZIP File (a85-liu.zip)
Supplemental files
MP4 File (a85.mp4)

References

[1]
Akazawa, Y., Okada, Y., and Niijima, K. 2005. Automatic 3d scene generation based on contact constraints. In Proc. Conf. on Computer Graphics and Artificial Intelligence, 593--598.
[2]
Bach, F., Jenatton, R., Mairal, J., and Obozinski, G. 2012. Optimization with sparsity-inducing penalties. Foundations and Trends in Machine Learning 4, 1, 1--106.
[3]
Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3d modeling. ACM Trans. Graph. 30, 4, 35.
[4]
Chaudhuri, S., Kalogerakis, E., Giguere, S., and Funkhouser, T. 2013. Attribit: content creation with semantic attributes. In Proc. UIST, ACM, 193--202.
[5]
Fisher, M., and Hanrahan, P. 2010. Context-based search for 3d models. ACM Trans. Graph. 29, 6, 182.
[6]
Fisher, M., Savva, M., and Hanrahan, P. 2011. Characterizing structural relationships in scenes using graph kernels. ACM Trans. Graph. 30, 4, 34.
[7]
Fisher, M., Ritchie, D., Savva, M., Funkhouser, T., and Hanrahan, P. 2012. Example-based synthesis of 3d object arrangements. ACM Trans. Graph. 31, 6, 135.
[8]
Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., and Jacobs, D. 2003. A search engine for 3d models. ACM Trans. Graph. 22, 1, 83--105.
[9]
Garces, E., Agarwala, A., Gutierrez, D., and Hertzmann, A. 2014. A similarity measure for illustration style. ACM Trans. Graph. 33, 4, 93.
[10]
Goldberger, J., Roweis, S., Hinton, G., and Salakhutdinov, R. 2004. Neighbourhood components analysis. Advances in Neural Information Processing Systems.
[11]
Hotelling, H. 1936. Relations between two sets of variates. Biometrika 28, 3-4, 321--377.
[12]
Huang, Q.-X., Su, H., and Guibas, L. 2013. Fine-grained semi-supervised labeling of large shape collections. ACM Trans. Graph. 32, 6, 190.
[13]
Jain, A., Thormählen, T., Ritschel, T., and Seidel, H.-P. 2012. Material memex: Automatic material suggestions for 3d objects. ACM Trans. Graph. 31, 5, 143.
[14]
Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4, 55.
[15]
Kazhdan, M., Chazelle, B., Dobkin, D., Funkhouser, T., and Rusinkiewicz, S. 2004. A reflective symmetry descriptor for 3d models. Algorithmica 38, 1, 201--225.
[16]
Kim, V. G., Li, W., Mitra, N. J., Chaudhuri, S., DiVerdi, S., and Funkhouser, T. 2013. Learning part-based templates from large collections of 3d shapes. ACM Trans. Graph. 32, 4, 70.
[17]
Kulis, B. 2012. Metric learning: A survey. Foundations & Trends in Machine Learning 5, 4, 287--364.
[18]
Li, H., Zhang, H., Wang, Y., Cao, J., Shamir, A., and Cohen-Or, D. 2013. Curve style analysis in a set of shapes. Computer Graphics Forum 32, 6, 77--88.
[19]
Lun, Z., Kalogerakis, E., and Sheffer, A. 2015. Elements of style: Learning structure-transcending perceptual shape style similarity. ACM Trans. Graph. 34, 4.
[20]
Ma, C., Huang, H., Sheffer, A., Kalogerakis, E., and Wang, R. 2014. Analogy-driven 3D style transfer. Computer Graphics Forum 33, 2, 175--184.
[21]
Merrell, P., Schkufza, E., Li, Z., Agrawala, M., and Koltun, V. 2011. Interactive furniture layout using interior design guidelines. ACM Trans. Graph. 30, 4, 87.
[22]
Merriam-Webster. 2004. Merriam-Webster Dictionary. Merriam-Webster Mass Market, July.
[23]
Miller, J. 2005. Furniture. Penguin.
[24]
O'Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory font selection using crowdsourced attributes. ACM Trans. Graph. 33, 4, 92.
[25]
Parikh, D., and Grauman, K. 2011. Relative attributes. In Proc. ICCV, 503--510.
[26]
Shapira, L., Shalom, S., Shamir, A., Cohen-Or, D., and Zhang, H. 2010. Contextual part analogies in 3d objects. International Journal of Computer Vision 89, 2-3, 309--326.
[27]
Tangelder, J. W., and Veltkamp, R. C. 2008. A survey of content based 3d shape retrieval methods. Multimedia tools and applications 39, 3, 441--471.
[28]
Umetani, N., Igarashi, T., and Mitra, N. J. 2012. Guided exploration of physically valid shapes for furniture design. ACM Trans. Graph. 31, 4, 86.
[29]
Wilber, M. J., Kwak, I. S., and Belongie, S. J. 2014. Cost-effective hits for relative similarity comparisons. In Proc. HCOMP.
[30]
Xu, K., Li, H., Zhang, H., Cohen-Or, D., Xiong, Y., and Cheng, Z.-Q. 2010. Style-content separation by anisotropic part scales. ACM Trans. Graph. 29, 6, 184.
[31]
Yu, L.-F., Yeung, S. K., Tang, C.-K., Terzopoulos, D., Chan, T. F., and Osher, S. 2011. Make it home: automatic optimization of furniture arrangement. ACM Trans. Graph. 30, 4, 86.
[32]
Zheng, Y., Cohen-Or, D., and Mitra, N. J. 2013. Smart variations: Functional substructures for part compatibility. Computer Graphics Forum 32, 2pt2, 195--204.
[33]
Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. 1997. Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM TOMS 23, 4, 550--560.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 4
August 2015
1307 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2809654
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015
Published in TOG Volume 34, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. compatibility
  2. crowdsourcing
  3. scene synthesis
  4. style

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)50
  • Downloads (Last 6 weeks)19
Reflects downloads up to 10 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Enhancing the Interior Design Process with Crowdsourced Furnishing Pairing RecommendationsArchives of Design Research10.15187/adr.2024.05.37.2.7937:2(79-101)Online publication date: 31-May-2024
  • (2024)Joint Stroke Tracing and Correspondence for 2D AnimationACM Transactions on Graphics10.1145/364989043:3(1-17)Online publication date: 29-Feb-2024
  • (2024)Fluid Control with Laplacian EigenfunctionsACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657468(1-11)Online publication date: 13-Jul-2024
  • (2024)Hybrid physics-infused 1D-CNN based deep learning framework for diesel engine fault diagnosticsNeural Computing and Applications10.1007/s00521-024-10055-y36:28(17511-17539)Online publication date: 1-Oct-2024
  • (2023)Spectral Coarsening with Hodge LaplaciansACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591544(1-11)Online publication date: 23-Jul-2023
  • (2023)Data-driven Digital Lighting Design for Residential Indoor SpacesACM Transactions on Graphics10.1145/358200142:3(1-18)Online publication date: 17-Mar-2023
  • (2023)A Survey of Personalized Interior DesignComputer Graphics Forum10.1111/cgf.1484442:6Online publication date: 22-May-2023
  • (2023)Learning 3D Shape Aesthetics Globally and LocallyComputer Graphics Forum10.1111/cgf.1470241:7(579-588)Online publication date: 20-Mar-2023
  • (2023)Emotional Voice PuppetryIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324710129:5(2527-2535)Online publication date: 22-Feb-2023
  • (2023)SceneViewer: Automating Residential Photography in Virtual EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.321483629:12(5523-5537)Online publication date: 1-Dec-2023
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media