Leaderboards

For all datasets, we sample 100 negative destination nodes for each positive sample in the test set. All the negative samples are fixed and will be downloaded when using TGBSeqDataLoader. See Get Started for usage details.


ML-20M

RankMethodTest MRR (%)ContactReferencesDate
1GraphMixer21.97±0.17TGB-Seq TeamPaper, CodeOctober 29th, 2024
2CAWN12.31±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024
3TCL12.04±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024
4TGAT10.47±0.20TGB-Seq TeamPaper, CodeOctober 29th, 2024

Taobao

RankMethodTest MRR (%)ContactReferencesDate
1TCL31.55±0.03TGB-Seq TeamPaper, CodeOctober 29th, 2024
2GraphMixer31.54±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024

Yelp

RankMethodTest MRR (%)ContactReferencesDate
1GraphMixer33.96±0.19TGB-Seq TeamPaper, CodeOctober 29th, 2024
2CAWN25.71±0.09TGB-Seq TeamPaper, CodeOctober 29th, 2024
3TCL24.39±0.67TGB-Seq TeamPaper, CodeOctober 29th, 2024
4DyGFormer21.68±0.20TGB-Seq TeamPaper, CodeOctober 29th, 2024

GoogleLocal

RankMethodTest MRR (%)ContactReferencesDate
1TGN50.53±1.72TGB-Seq TeamPaper, CodeOctober 29th, 2024
2JODIE35.77±1.16TGB-Seq TeamPaper, CodeOctober 29th, 2024
3DyRep29.58±0.78TGB-Seq TeamPaper, CodeOctober 29th, 2024
4GraphMixer21.31±0.14TGB-Seq TeamPaper, CodeOctober 29th, 2024
5TGAT19.78±0.24TGB-Seq TeamPaper, CodeOctober 29th, 2024
6DyGFormer18.39±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024
7TCL18.30±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024
8CAWN18.26±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024

Flickr

RankMethodTest MRR (%)ContactReferencesDate
1TGN63.97±1.52TGB-Seq TeamPaper, CodeOctober 29th, 2024
2JODIE58.43±5.44TGB-Seq TeamPaper, CodeOctober 29th, 2024
3DyRep56.78±1.38TGB-Seq TeamPaper, CodeOctober 29th, 2024
4DyGFormer49.58±2.87TGB-Seq TeamPaper, CodeOctober 29th, 2024
5CAWN48.69±6.08TGB-Seq TeamPaper, CodeOctober 29th, 2024
6GraphMixer45.01±0.08TGB-Seq TeamPaper, CodeOctober 29th, 2024
7TCL40.00±1.76TGB-Seq TeamPaper, CodeOctober 29th, 2024
8TGAT23.53±3.35TGB-Seq TeamPaper, CodeOctober 29th, 2024

YouTube

RankMethodTest MRR (%)ContactReferencesDate
1GraphMixer58.87±0.12TGB-Seq TeamPaper, CodeOctober 29th, 2024
2TCL50.17±1.98TGB-Seq TeamPaper, CodeOctober 29th, 2024
3CAWN47.55±1.08TGB-Seq TeamPaper, CodeOctober 29th, 2024
4DyGFormer46.08±3.44TGB-Seq TeamPaper, CodeOctober 29th, 2024
5TGAT43.56±2.53TGB-Seq TeamPaper, CodeOctober 29th, 2024

Patent

RankMethodTest MRR (%)ContactReferencesDate
1GraphMixer18.97±2.54TGB-Seq TeamPaper, CodeOctober 29th, 2024
2DyGFormer15.31±3.64TGB-Seq TeamPaper, CodeOctober 29th, 2024
3CAWN12.34±0.47TGB-Seq TeamPaper, CodeOctober 29th, 2024
4TCL10.60±1.75TGB-Seq TeamPaper, CodeOctober 29th, 2024
5TGAT8.49±0.18TGB-Seq TeamPaper, CodeOctober 29th, 2024
RankMethodTest MRR (%)ContactReferencesDate
1GraphMixer48.57±0.02TGB-Seq TeamPaper, CodeOctober 29th, 2024
2TCL43.02±2.16TGB-Seq TeamPaper, CodeOctober 29th, 2024