Skip to content

Commit

Permalink
Update inference_rules.adoc | Add rule specific to RGAT
Browse files Browse the repository at this point in the history
  • Loading branch information
arjunsuresh authored Dec 3, 2024
1 parent 679e15d commit 84690f6
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions inference_rules.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -759,6 +759,8 @@ The following techniques are disallowed:
* Techniques that only improve performance when there are identical
samples in a query. For example, sorting samples in SSD.

* Techniques that reduce the number of unique samples in a query. For example, sorting samples in Graph Neural Networks' RGAT.

* Speculative decoding for auto-generative language models (i.e. using a smaller model to predict the next token for the reference model).

== FAQ
Expand Down

0 comments on commit 84690f6

Please sign in to comment.