Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[PoC]: Support encode only models by Workflow Defined Engine #8452

Draft
wants to merge 43 commits into
base: main
Choose a base branch
from
Draft

[PoC]: Support encode only models by Workflow Defined Engine #8452

wants to merge 43 commits into from
+9,800 −0

Commits on Sep 13, 2024

  1. wde core, xlm_roberta, bge-m3

    @noooop
    noooop committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a6a003b View commit details
    Browse the repository at this point in the history

  2. tests xlm_roberta, bge-m3

    @noooop
    noooop committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    fdfa0ff View commit details
    Browse the repository at this point in the history

  3. demos

    @noooop
    noooop committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    62bf07d View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. update tests

    @noooop
    noooop committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    15348da View commit details
    Browse the repository at this point in the history

  2. support bge-reranker-v2-m3

    @noooop
    noooop committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    046b4e9 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. yapf

    @noooop
    noooop committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6c9ca52 View commit details
    Browse the repository at this point in the history

  2. yapf

    @noooop
    noooop committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6d7fef0 View commit details
    Browse the repository at this point in the history

  3. yapf

    @noooop
    noooop committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    dd976e7 View commit details
    Browse the repository at this point in the history

  4. support torch spda backend

    @noooop
    noooop committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    93503b7 View commit details
    Browse the repository at this point in the history

  5. support bert

    @noooop
    noooop committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    81c6936 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. yapf & ruff

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    41214ab View commit details
    Browse the repository at this point in the history

  2. yapf & ruff

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    b06fc40 View commit details
    Browse the repository at this point in the history

  3. yapf & ruff

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    1059e65 View commit details
    Browse the repository at this point in the history

  4. isort

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    6000cdf View commit details
    Browse the repository at this point in the history

  5. yapf & ruff

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    e838179 View commit details
    Browse the repository at this point in the history

  6. isort

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f2f4a09 View commit details
    Browse the repository at this point in the history

  7. yapf & ruff

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a4d01fb View commit details
    Browse the repository at this point in the history

  8. isort

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    d421ccd View commit details
    Browse the repository at this point in the history

  9. support xformers

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7f6675d View commit details
    Browse the repository at this point in the history

  10. support bge v1.5 family

    @noooop
    noooop committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f953e86 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. ruff & isort & yapf

    @noooop
    noooop committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    b30e9f2 View commit details
    Browse the repository at this point in the history

  2. support xformers

    @noooop
    noooop committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    d3ceeb0 View commit details
    Browse the repository at this point in the history

  3. support Flashinfer backend

    @noooop
    noooop committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    0ce2482 View commit details
    Browse the repository at this point in the history

  4. support Torch naive backend

    @noooop
    noooop committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    7cede53 View commit details
    Browse the repository at this point in the history

  5. support Snowflake Arctic Embed (Family)

    @noooop
    noooop committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    6736e0d View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. ready to support enable_bidirectional

    @noooop
    noooop committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    a992ba0 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. ruff & isort & yapf

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    ed5f433 View commit details
    Browse the repository at this point in the history

  2. fix decoder only attention basic_correctness

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    b14d864 View commit details
    Browse the repository at this point in the history

  3. support output_last_hidden_states

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    aa3ef30 View commit details
    Browse the repository at this point in the history

  4. support e5-mistral-7b

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5032def View commit details
    Browse the repository at this point in the history

  5. misc

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    4b12e30 View commit details
    Browse the repository at this point in the history

  6. misc

    @noooop
    noooop committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    2649945 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. mv e5-mistral-7 to retriever

    @noooop
    noooop committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    3a5b30c View commit details
    Browse the repository at this point in the history

  2. support gte-Qwen2

    @noooop
    noooop committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5532932 View commit details
    Browse the repository at this point in the history

  3. ruff

    @noooop
    noooop committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    bf477a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. support gte-Qwen2-7B-instruct

    @noooop
    noooop committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    4820daa View commit details
    Browse the repository at this point in the history

  2. misc

    @noooop
    noooop committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    aa302ba View commit details
    Browse the repository at this point in the history

  3. support data parallelism

    @noooop
    noooop committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    60931e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. dirty fix distributed environment

    @noooop
    noooop committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    efef0b3 View commit details
    Browse the repository at this point in the history

  2. dirty fix destroy model parallel

    @noooop
    noooop committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    a45e867 View commit details
    Browse the repository at this point in the history

  3. dirty fix pp environment

    @noooop
    noooop committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    236980d View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. Merge branch 'vllm-project:main' into wde_encode_only

    @noooop
    noooop authored Sep 29, 2024
    Configuration menu
    Copy the full SHA
    653da13 View commit details
    Browse the repository at this point in the history

  2. catch up vllm main

    @noooop
    noooop committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    653794e View commit details
    Browse the repository at this point in the history