Use min-decode-steps = 256 by default for server and benchmark#47

Merged

masahi merged 1 commit intooctoml:batch-servingfrom masahi:engine-tweak

Nov 2, 2023

+4

Commits on Nov 2, 2023

Use min-decode-steps = 256 by default for server and benchmark
masahi
committed