Code

Guided gen support#9

Code

Closed

DhruvaBansal00 wants to merge 3 commits intoneuralmagic:mainneuralmagic/vllm:mainfrom DhruvaBansal00:guided-gen-supportDhruvaBansal00/vllm:guided-gen-supportCopy head branch name to clipboard

+34-1

Commits

Commits on Sep 6, 2024

• Support guided generation with AsyncLLMEngine

  DhruvaBansal00

  committed
  b3c8647

Commits on Sep 10, 2024

• fix

  DhruvaBansal00

  committed
  8b82f03

• Use self.engine for accessing tokenizer group

  DhruvaBansal00

  committed
  55710cd