[backport -> release/3.7.x] fix(ai-proxy): Fix Cohere breaks with model parameter in body; Fix OpenAI token counting for function requests; Fix user sending own-model parameter#13230

Merged

AndyZhang0707 merged 12 commits intorelease/3.7.xfrom backport-13000-to-release/3.7.x

Jun 20, 2024

+293-72

Commits on Jun 20, 2024

fix(ai-proxy): check response tokens always string

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): prevent user choosing own model, if one is specified in plugin conf

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): prefer model tuning parameters from plugin config, over user requests

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): cohere and anthropic now accept non-empty model param

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): streaming when chunks contains truncated SSE messages

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): analytics missing when model is cjson.null

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): invalid precedence on model tuning params

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): userdata token text returned when function calling

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): changelog tense

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): token streaming truncation

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): remove nil checks on model and tuning parameters

tysoekong
authored and
github-actions[bot]
committed
fix(ai-proxy): test-mode for streaming tests

tysoekong
authored and
github-actions[bot]
committed