Leaderboards
For all datasets, we sample 100 negative destination nodes for each positive sample in the test set. All the negative samples are fixed and will be downloaded when using TGBSeqDataLoader. See Get Started for usage details.
ML-20M
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | TGN | 23.99±0.20 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | GraphMixer | 21.97±0.17 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | JODIE | 21.16±0.73 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | DyRep | 19.00±1.69 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | CAWN | 12.31±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | TCL | 12.04±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | TGAT | 10.47±0.20 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
Taobao
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | TGN | 60.28±0.54 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | JODIE | 48.36±2.18 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | DyRep | 40.03±2.40 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | TCL | 31.55±0.03 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | GraphMixer | 31.54±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
Yelp
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | JODIE | 69.88±0.31 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | TGN | 69.79±0.24 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | DyRep | 57.69±1.05 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | GraphMixer | 33.96±0.19 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | CAWN | 25.71±0.09 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | TCL | 24.39±0.67 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | DyGFormer | 21.68±0.20 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
GoogleLocal
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | TGN | 54.13±1.97 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | JODIE | 41.86±1.49 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | DyRep | 37.73±1.34 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | GraphMixer | 21.31±0.14 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | TGAT | 19.78±0.24 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | DyGFormer | 18.39±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | TCL | 18.30±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 8 | CAWN | 18.26±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
Flickr
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | DyGFormer | 49.58±2.87 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | CAWN | 48.69±6.08 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | JODIE | 46.21±0.83 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | TGN | 46.03±6.78 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | GraphMixer | 45.01±0.08 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | TCL | 40.00±1.76 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | DyRep | 38.04±4.19 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 8 | TGAT | 23.53±3.35 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
YouTube
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | GraphMixer | 58.87±0.12 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | TGN | 55.16±5.89 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | TCL | 50.17±1.98 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | CAWN | 47.55±1.08 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | DyGFormer | 46.08±3.44 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | TGAT | 43.56±2.53 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | JODIE | 41.67±2.86 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 8 | DyRep | 35.12±4.13 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
Patent
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | JODIE | 24.60±0.38 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | TGN | 22.83±2.25 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | DyRep | 21.01±1.14 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | GraphMixer | 18.97±2.54 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | DyGFormer | 14.20±2.93 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 6 | CAWN | 12.34±0.47 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 7 | TCL | 10.60±1.75 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 8 | TGAT | 8.49±0.18 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
WikiLink
| Rank | Method | Test MRR (%) | Contact | References | Date |
|---|
| 1 | TGN | 62.94±2.16 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 2 | JODIE | 57.94±1.33 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 3 | GraphMixer | 48.57±0.02 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 4 | TCL | 43.02±2.16 | TGB-Seq Team | Paper, Code | October 29th, 2024 |
| 5 | DyRep | 42.63±1.33 | TGB-Seq Team | Paper, Code | October 29th, 2024 |