[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3534678.3539485acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Causal Discovery on Non-Euclidean Data

Published: 14 August 2022 Publication History

Abstract

Researchers recently started developing deep learning models capable of handling non-Euclidean data. However, because of existing framework limitations on model representations and learning algorithms, few have explored causal discovery on non-Euclidean data. This paper is the first attempt to do so. We start by proposing the Non-Euclidean Causal Model (NECM) which describes the causal generative relationship of non-Euclidean data and creates a new tensor data type along with a mapping process for the non-Euclidean causal mechanism. Second, within the NECM, we propose the non-Euclidean Hybrid Learning (NEHL) method, a causal discovery algorithm relying on the concept of the ball covariance recently introduced in the statistics field. Third, we generate two types of non-Euclidean datasets: Functional Data and Symmetric Positive Definite manifold data in conformity with the NECM. Finally, experimental results on the generated data and real-world data demonstrate the effectiveness of the proposed NEHL method.

References

[1]
Hirotugu Akaike. 1974. A new look at the statistical model identification. IEEE Trans. Automat. Control 19, 6 (1974), 716--723.
[2]
Rabi Bhattacharya and Lizhen Lin. 2018. Differential Geometry for Model Independent Analysis of Images and Other Non-Euclidean Data: Recent Developments. (01 2018).
[3]
Ning Bi, Jun Tan, Jian-Huang Lai, and Ching Suen. 2018. High-Dimensional Supervised Feature Selection via Optimized Kernel Mutual Information. Expert Systems with Applications 108 (05 2018). https://doi.org/10.1016/j.eswa.2018.04.037
[4]
Michael M. Bronstein, Joan Bruna, Yann LeCun, Arthur Szlam, and Pierre Vandergheynst. 2017. Geometric Deep Learning: Going beyond Euclidean data. IEEE Signal Processing Magazine 34, 4 (2017), 18--42. https://doi.org/10.1109/MSP.2017.2693418
[5]
Yahong Han, Fei Wu, Dacheng Tao, Jian Shao, Yueting Zhuang, and Jianmin Jiang. 2012. Sparse Unsupervised Dimensionality Reduction for Multiple View Data. Circuits and Systems for Video Technology, IEEE Transactions on 22 (10 2012), 1485--1496. https://doi.org/10.1109/TCSVT.2012.2202075
[6]
Chenping Hou, Changshui Zhang, Yi Wu, and Feiping Nie. 2010. Multiple view semi-supervised dimensionality reduction. Pattern Recognition 43 (03 2010), 720--730. https://doi.org/10.1016/j.patcog.2009.07.015
[7]
Patrik Hoyer, Dominik Janzing, Joris Mooij, Jonas Peters, and Bernhard Scholkopf. 2014. Nonlinear causal discovery with additive noise models. Advances in Neural Information Processing Systems 21: Proceedings of the 2008 Conference, 689--696 (2009) (08 2014).
[8]
Markus Kalisch and Peter Buhlmann. 2005. Estimating high-dimensional directed acyclic graphs with the PC-algorithm. J. Mach. Learn. Res 8 (11 2005).
[9]
Tong Lin and Hongbin Zha. 2008. Riemannian Manifold Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 5 (2008), 796--809. https://doi.org/10.1109/TPAMI.2007.70735
[10]
Wenliang Pan, XueqinWang, Heping Zhang, Hongtu Zhu, and Jin Zhu. 2020. Ball Covariance: A Generic Measure of Dependence in Banach Space. J. Amer. Statist. Assoc. 115, 529 (2020), 307--317. https://doi.org/10.1080/01621459.2018.1543600
[11]
Jean Philippe Pellet and Andre Elisseeff. 2008. Using Markov Blankets for Causal Structure Learning. Journal of Machine Learning Research 9, 9 (2008), 1295--1342.
[12]
J.O. Ramsay and B.W. Silverman. 2001. Functional Data Analysis. In International Encyclopedia of the Social & Behavioral Sciences, Neil J. Smelser and Paul B. Baltes (Eds.). Pergamon, Oxford, 5822--5828. https://doi.org/10.1016/B0-08-043076--7/00434--4
[13]
J. J. Rissanen. 1978. Modeling by shortest data description. Automatica 14, 5 (1978), 465--471.
[14]
Mark Schmidt, Alexandru Niculescu-Mizil, and Kevin Murphy*. 2007. Learning graphical model structure using L1-regularization paths. In Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, July 22--26, 2007, Vancouver, British Columbia, Canada.
[15]
Shohei Shimizu, Patrik Hoyer, Aapo Hyvarinen, and Antti Kerminen. 2006. A Linear Non-Gaussian Acyclic Model for Causal Discovery. Journal of Machine Learning Research 7 (10 2006), 2003--2030.
[16]
P. Spirtes, C. Glymour, and R. Scheines. 2000. Causation, Prediction, and Search, 2nd Edition. The MIT Press (2000).
[17]
Fengzhen Tang, Meng Fan, and Peter Tino. 2020. Generalized Learning Riemannian Space Quantization: A Case Study on Riemannian Manifold of SPD Matrices. IEEE Transactions on Neural Networks and Learning Systems PP (03 2020), 1--12. https://doi.org/10.1109/TNNLS.2020.2978514
[18]
Marc Teyssier and Daphne Koller. 2012. Ordering-Based Search: A Simple and Effective Algorithm for Learning Bayesian Networks. Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence, UAI 2005 (07 2012).
[19]
Jing Yang, Ning An, and Gil Alterovitz. 2016. A Partial Correlation Statistic Structure Learning Algorithm Under Linear Structural Equation Models. IEEE Transactions on Knowledge and Data Engineering 28, 10 (2016), 2552--2565. https://doi.org/10.1109/TKDE.2016.2578315
[20]
J. Yang, G. Fan, K. Xie, Q. Chen, and A. Wang. 2021. Additive noise model structure learning based on rank correlation. Information Sciences 571, 2 (2021).
[21]
Stefanos Zafeiriou, Michael Bronstein, Taco Cohen, Oriol Vinyals, Le Song, Jure Leskovec, Pietro Lio, Joan Bruna, and Marco Gori. 2022. Guest Editorial: Non-Euclidean Machine Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 2 (2022), 723--726. https://doi.org/10.1109/TPAMI.2021.3129857
[22]
K. Zhang, J. Peters, D. Janzing, and B. Schoelkopf. 2011. Kernel-based Conditional Independence Test and Application in Causal Discovery. 804--813.

Cited By

View all
  • (2024)Heterogeneous graph-based knowledge tracing with spatiotemporal evolutionExpert Systems with Applications10.1016/j.eswa.2023.122249238(122249)Online publication date: Mar-2024
  • (2023)A Non-Euclidean Causal Discovery Algorithm in Metric Spaces2023 4th International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI)10.1109/ICCBD-AI62252.2023.00017(53-57)Online publication date: 15-Dec-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
August 2022
5033 pages
ISBN:9781450393850
DOI:10.1145/3534678
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 August 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. ball covariance
  2. causal discovery
  3. causal model
  4. hybrid learning
  5. non-euclidean data

Qualifiers

  • Research-article

Funding Sources

  • the National Key Research and Development Program of China
  • the Provincial Key Research and Development Program of Anhui
  • the National Natural Science Foundation of China

Conference

KDD '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)93
  • Downloads (Last 6 weeks)16
Reflects downloads up to 11 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Heterogeneous graph-based knowledge tracing with spatiotemporal evolutionExpert Systems with Applications10.1016/j.eswa.2023.122249238(122249)Online publication date: Mar-2024
  • (2023)A Non-Euclidean Causal Discovery Algorithm in Metric Spaces2023 4th International Conference on Computer, Big Data and Artificial Intelligence (ICCBD+AI)10.1109/ICCBD-AI62252.2023.00017(53-57)Online publication date: 15-Dec-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media