Code

Upgrade to use vLLM 0.6.6#12710

Code

Draft

gc-fu wants to merge 6 commits intointel:mainintel/ipex-llm:mainfrom gc-fu:upggradegc-fu/BigDL:upggradeCopy head branch name to clipboard

+1,422-122

Commits

Commits on Jan 7, 2025

• init

  hzjane

  committed
  ae5be1e

  Copy full SHA for ae5be1e

• update engine init

  hzjane

  committed
  58743e5

  Copy full SHA for 58743e5

Commits on Jan 14, 2025

• fix serving load_in_low_bit problem

  gc-fu

  committed
  e42d185

  Copy full SHA for e42d185

Commits on Jan 16, 2025

• temp

  gc-fu

  committed
  520c35c

  Copy full SHA for 520c35c

• temp

  gc-fu

  committed
  ef1da38

  Copy full SHA for ef1da38

• temp

  gc-fu

  committed
  8c15962

  Copy full SHA for 8c15962