Skip to content

v0.1.5

Compare
Choose a tag to compare
@baowendin baowendin released this 01 Mar 09:25
· 1337 commits to main since this release

features

  • refactor large amount of server code

fixs

  • fix inference server concurrency limit no decrease
  • cancel request correctly when client disconnected
  • fix ptuning with separate path