Skip to content
Back to pull request #1544

[CB] Split token streaming and generation to different threads for all CB based pipelines #601

Sign in to view logs

[CB] Split token streaming and generation to different threads for all CB based pipelines

[CB] Split token streaming and generation to different threads for all CB based pipelines #601

WWB tests (3.11)

WWB tests (3.11)
succeeded Jan 17, 2025 in 31m 20s