Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core][Frontend] Add faster-outlines as guided decoding backend #10277

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

[Core][Frontend] Add faster-outlines as guided decoding backend #10277

wants to merge 6 commits into from
+175 −3

Commits on Nov 12, 2024

  1. Add integration, add test, and add faster-outlines as a guided decodi… 

    …ng backend option.
    @unaidedelf8777
    unaidedelf8777 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    7147438 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into main

    @unaidedelf8777
    unaidedelf8777 authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    7e1f162 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. fix long line in tests

    @unaidedelf8777
    unaidedelf8777 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a011b34 View commit details
    Browse the repository at this point in the history

  2. run format.sh, isort

    @unaidedelf8777
    unaidedelf8777 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ae16caf View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Format and add faster-outlines to args

    @mgoin
    mgoin authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    b049951 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Update faster-outlines minimum version. 

    Re-released faster-outlines to pypi in order to compile for python3.9 and above; Updating the version in requirements-common.txt in order to comply with vllm being based on python3.9
    @unaidedelf8777
    unaidedelf8777 authored Nov 15, 2024
    Configuration menu
    Copy the full SHA
    78a809f View commit details
    Browse the repository at this point in the history