v0.1.6

zerozw released this 09 Mar 07:06

· 1292 commits to main since this release

de4761a

features

support starcoder2
support gemma

fixs

fix lora merge
fix num_return_sequences 1
fix query cancel not release source
fix tp block num sync
fix some model rotary embedding dim 64

Assets 4