Isolating Graph Topology from Model Architecture in GNN-Based Fraud Detection: An Empirical Framework
Roya, Amiri and Jaf, Sardar (2026) Isolating Graph Topology from Model Architecture in GNN-Based Fraud Detection: An Empirical Framework. Big Data and Cognitive Computing, 10 (9). ISSN 2504-2289
| Item Type: | Article |
|---|
Abstract
Graph topology and model architecture are routinely co-designed in GNN-based fraud detection, making it impossible to attribute performance gains to either component. We address this by fixing the training loop, features, and evaluation protocol while independently varying graph construction strategy and GNN architecture. Three strategies
are evaluated: multi-relation temporal, hybrid structural-similarity, and intra-group, each evaluated across three GNN architectures (GATv2, GCN, and GraphSAGE). A feature-identical MLP with no graph structure serves as an empirical anchor. On the Sparkov dataset, all three GNN strategies exceed the MLP by 5.0–9.7 F1 points, confirming that topology contributes genuine discriminative value when per-cardholder histories are dense. On the IBM dataset, the intra-group strategy collapses 6.9 F1 points below the MLP, a consequence of near-empty neighbourhoods (mean degree 1.1) following down-sampling, while multi-relation retains ranking advantages in AUC (Area Under the Curve; 0.985) and Average Precision (0.908) despite marginal F1 parity.
Across both datasets, multi-relation temporal construction is the highest-performing strategy, achieving F1 0.908 and AUC 0.994 on Sparkov and F1 0.831 on IBM, though this ranking is not entirely architecture-independent: GraphSAGE narrowly inverts the multi-relation/intra-group order on Sparkov. These results suggest that graph construction quality, rather than mere graph presence, matters more for GNN performance than connectivity alone under the conditions evaluated here.
Preview |
PDF
BDCC-10-00294.pdf - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview |
More Information
| Uncontrolled Keywords: graph neural networks; credit card fraud detection; GATv2; GCN; GraphSAGE; ar-chitecture sensitivity |
| Depositing User: Sardar Jaf |
Identifiers
| Item ID: 20648 |
| Identification Number: 10.3390/bdcc10090294 |
| ISSN: 2504-2289 |
| URI: https://sure.sunderland.ac.uk/id/eprint/20648 | Official URL: https://www.mdpi.com/ |
Users with ORCIDS
Catalogue record
| Date Deposited: 21 Sep 2026 13:14 |
| Last Modified: 21 Sep 2026 13:14 |
| Author: |
Sardar Jaf
|
| Author: | Amiri Roya |
| Author: | Amiri Roya |
| Author: | Sardar Jaf |
University Divisions
Faculty of Business and Technology > School of Computer Science and EngineeringSubjects
Computing > CybersecurityComputing > Artificial Intelligence
Actions (login required)
![]() |
View Item (Repository Staff Only) |


Dimensions
Dimensions