Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

基于Key限流 和 AI token 限流插件拓展 #1498

Open
KingOfXi opened this issue Nov 11, 2024 · 1 comment
Open

基于Key限流 和 AI token 限流插件拓展 #1498

KingOfXi opened this issue Nov 11, 2024 · 1 comment
Labels
help wanted Extra attention is needed level/normal sig/wasm

Comments

@KingOfXi
Copy link

AI token限流 可以对每个apikey配置token per miniute 限流，不过可以在这基础上，对路由服务配置一个 总的tpm限流吗？
基于key限流 同理可以对每个key配置request per miniute限流，需要在这基础上对路由服务配置一个总的rpm限流。
@johnlanni
Copy link
Collaborator

我理解就是不需要 limit_by_xxx，就是规则粒度的限流

@johnlanni johnlanni added the help wanted Extra attention is needed label Nov 18, 2024
@github-project-automation github-project-automation bot moved this to Todo in Higress Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted Extra attention is needed level/normal sig/wasm
Projects
Higress
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
2 participants
@johnlanni @KingOfXi