Accelerated GNN Training with DGL and RAPIDS cuGraph in a Fraud Detection Workflow
Authors: 
Brad Rees, Xiaoyun Wang, Joe Eaton, Onur Yilmaz, Rick Ratzel, Dominque LaSalleAuthors Info & Claims
Pages 4820 - 4821
Abstract
Graph Neural Networks (GNNs) have gained the interest of industry with Relational Graph Convolutional Networks (R-GCNs) showing promise for fraud detection. Taking existing workflows that leverage graph features to train a gradient boosted decision tree (GBDT) and replacing the graph features with GNN produced embedding achieves an increase in accuracy. However, recent work has shown that the combination of graph attributes with GNN embeddings provides the biggest lift in accuracy.
Whether to use a GNN is half of the picture. Data loading, data cleaning and prep (ETL), and graph processing are critical first steps before graph features or GNN training can be performed. Moreover, the entire process is interactive, optimizing training and validation, for shorter model delivery cycles. Quicker model updates are the key to staying ahead of evolving fraud techniques. McDonald and Deotte [1] published a BLOG on the importance of being able to iterate quickly in finding a solution.
The RAPIDS [2] suite of open-source software libraries gives the data scientist the freedom to execute end-to-end analytics work-flows on GPUs. The ETL and data loading portion is handled by RAPIDS cuDF, which utilizes a familiar DataFrame API. The GBDT process is handled by RAPIDS cuML that has an implementation of XGBoost and RandomForest. The graph analytic portion is handled by RAPIDS cuGraph. Recently cuGraph announced integration into Deep Graph Library (DGL) [3]. For GNN training, graph sampling can consume up to 80% of the training time. RAPIDS cuGraph sampling algorithms execute 10x to 100x faster than similar CPU versions and scale to support massive size graphs. Join us as we dive into GNNs for fraud detection and as we demonstrate how RAPIDS + DGL drastically reduces training time. We will cover everything from accelerating data load and data prep to accelerated GNN training with cuGraph + DGL.
References
[1]
Carol McDonald, Chris Deotte, NVIDIA Developer Technical BLOG, Jan 26, 2021
[2]
RAPIDS, https://rapids.ai/
[3]
Deep Graph Library, https://www.dgl.ai/
[4]
https://developer.nvidia.com/blog/leveraging-machine-learning-to-detect-fraud-tips-to-developing-a-winning-kaggle-solution/
Index Terms
- Accelerated GNN Training with DGL and RAPIDS cuGraph in a Fraud Detection Workflow
Recommendations
Auto-Divide GNN: Accelerating GNN Training with Subgraph Division
Euro-Par 2023: Parallel ProcessingAbstractGraph Neural Networks (GNNs) have gained considerable attention in recent years for their exceptional performance on graph-structured data. Sampling-based GNN training is the most common method used for training GNNs on large-scale graphs, and it ...
GPT-GNN: Generative Pre-Training of Graph Neural Networks
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningGraph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective way to reduce the ...
GL-GNN: Graph learning via the network of graphs
AbstractGraph neural networks (GNNs) have achieved great success in many scenarios with graph-structured data. However, in many real applications, three issues arise when applying GNNs: graphs are unavailable, nodes have noisy features, graphs are ...
Highlights- We propose a novel network-of-graphs based graph-learnable method GL-GNN.
- GL-GNN is the first model that uses the network of graphs to learn graph structures for GNNs.
- GL-GNN is more robust to edge attack than multiple recently ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
August 2022
5033 pages
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 14 August 2022
Check for updates
Author Tags
Qualifiers
- Abstract
Conference
KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
August 14 - 18, 2022
Washington DC, USA
Acceptance Rates
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 271Total Downloads
- Downloads (Last 12 months)54
- Downloads (Last 6 weeks)3
Reflects downloads up to 10 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in