Skip to content

Commit

Permalink
Merge pull request IllinoisGraphBenchmark#42 from IllinoisGraphBenchm…
Browse files Browse the repository at this point in the history
…ark/leaderboard-creation

Leaderboard creation
  • Loading branch information
msharmavikram authored Nov 8, 2023
2 parents 5a131e4 + 17fd9e8 commit c87e5f3
Show file tree
Hide file tree
Showing 2 changed files with 23 additions and 2 deletions.
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,9 @@
</p>


## Official IGB Leadboard is now online!! 🎉
Head over to the [leaderboard](https://github.com/IllinoisGraphBenchmark/IGB-Datasets/blob/leaderboard-creation/results/README.md#leaderboard-wip) and make your submission.

## Installation Guide

```python
Expand Down
22 changes: 20 additions & 2 deletions results/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,21 @@
# Results
# Leaderboard

This folder contains results of the runs that we performed. The results a bit outdated and will be updated in the coming days.
Welcome to the official leaderboard for the Illinois Graph Benchmark. This will help us keep track of the state of the art GNN models and encourage reproducibility.

## How to submit

You can make your submission using this [Google form](https://forms.gle/h88sdFx173jHRkmb7).

### Illinois Graph Benchmark - Heterogeneous (IGB-HET) Leaderboard
| Rank | Method | Test Accuracy | Contact | Date | References |
| -- | -- | --: | -- | -- | --: |
| - | `R-GAT` | OOM | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |
| - | `R-GGN` | OOM | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |
| - | `R-SAGE` | OOM | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |

### Illinois Graph Benchmark - Homogeneous (IGB-HOM) Leaderboard
| Rank | Method | Test Accuracy | Contact | Date | References |
| -- | -- | --: | -- | -- | --: |
| 1 | `GAT` | 55.51 | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |
| 2 | `SAGE` | 54.95 | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |
| 3 | `GGN` | 48.59 | [Arpandeep - IGB Team](mailto:[email protected]) | 21st June 2023 | [Paper](https://arxiv.org/pdf/2302.13522.pdf) |

0 comments on commit c87e5f3

Please sign in to comment.