基于Higress访问大模型，无法传递apikey #1460

lixiaoyin-221 · 2024-10-30T12:38:23Z

lixiaoyin-221
Oct 30, 2024

provider:
  apiTokens:
    - "sk-xx"
  modelMapping:
    '*': "gpt-4o-mini"
  type: "openai"

使用下面的请求进行访问

curl --location 'https://xxxhost:8643/openai/v1/chat/completions' \
--header 'Content-Type: application/json' \
--data '{
    "model": "gpt-4o-mini",
    "messages": [
        {
            "role": "system",
            "content": "You are a helpful assistant."
        },
        {
            "role": "user",
            "content": "Write a haiku that explains the concept of recursion."
        }
    ]
}'

提示未提供apikey，我换了一些模型，同样提示未能从header中获取到token。
首先我理解apikey应该是由网关插件接管，不再通过请求发送，再者我在header中传也同样不起作用，请问是哪里的问题

johnlanni · 2024-10-31T01:40:24Z

johnlanni
Oct 31, 2024
Maintainer

@lixiaoyin-221 进到容器里，执行 cat /var/log/higress/gateway.log 看看有没有错误信息，估计是插件没加载成功

4 replies

lixiaoyin-221 Oct 31, 2024
Author

gateway.log没有任何报错信息，看了日志目录下其它日志，也没有报错信息。

当使用Postman访问时，gateway.log中可以看到访问日志：
{"authority":"higress.xxx.com:8643","bytes_received":"287","bytes_sent":"0","downstream_local_address":"172.17.0.3:8443","downstream_remote_address":"192.168.65.1:36259","duration":"0","istio_policy_status":"-","method":"POST","path":"/openai/v1/chat/completions","protocol":"HTTP/1.1","request_id":"c4980396-42b3-45e6-af7d-09a6a870002f","requested_server_name":"higress.xxx.com","response_code":"308","response_flags":"-","route_name":"openai","start_time":"2024-10-31T01:58:36.351Z","trace_id":"-","upstream_cluster":"-","upstream_host":"-","upstream_local_address":"-","upstream_service_time":"-","upstream_transport_failure_reason":"-","user_agent":"PostmanRuntime/7.42.0","x_forwarded_for":"192.168.65.1"}

而且当我切换模型时，报错信息会变为对应模型的报错信息，说明请求已经转发过去了，只不过没带header

johnlanni Oct 31, 2024
Maintainer

你在容器里执行一下 curl localhost:15000/logging?wasm=trace -X POST

然后再请求一下，看看有没有wasm相关的日志，没有的话，说明插件没有生效

johnlanni Oct 31, 2024
Maintainer

另外看下配置目录下 wasmplugins 里的 ai-proxy-1.0.0.yaml，发一下yaml内容，注意 apiKey 脱敏

lixiaoyin-221 Oct 31, 2024
Author

apiVersion: extensions.higress.io/v1alpha1
kind: WasmPlugin
metadata:
annotations:
higress.io/wasm-plugin-description: Provide unified OpenAI API compatible interface
to call different AI service providers.
higress.io/wasm-plugin-icon: https://img.alicdn.com/imgextra/i1/O1CN018iKKih1iVx287RltL_!!6000000004419-2-tps-42-42.png
higress.io/wasm-plugin-title: AI Proxy
creationTimestamp: "2024-10-30T02:58:43Z"
labels:
higress.io/resource-definer: higress
higress.io/wasm-plugin-built-in: "true"
higress.io/wasm-plugin-category: ai
higress.io/wasm-plugin-name: ai-proxy
higress.io/wasm-plugin-version: 1.0.0
managedFields:

apiVersion: extensions.higress.io/v1alpha1
fieldsType: FieldsV1
fieldsV1:
f:metadata:
f:annotations:
.: {}
f:higress.io/wasm-plugin-description: {}
f:higress.io/wasm-plugin-icon: {}
f:higress.io/wasm-plugin-title: {}
f:labels:
.: {}
f:higress.io/resource-definer: {}
f:higress.io/wasm-plugin-built-in: {}
f:higress.io/wasm-plugin-category: {}
f:higress.io/wasm-plugin-name: {}
f:higress.io/wasm-plugin-version: {}
f:spec:
f:matchRules: {}
f:priority: {}
f:url: {}
manager: Kubernetes Java Client
operation: Update
time: "2024-10-30T13:10:27Z"
name: ai-proxy-1.0.0
namespace: higress-system
resourceVersion: "36"
spec:
matchRules:
config:
provider:
apiTokens:
- xxxx
azureServiceUrl: https://chatgpt-test2.openai.azure.com/openai/deployments/chatgpt-test2/chat/completions?api-version=2024-02-15-preview
type: azure
ingress:
- openai
  priority: 100
  url: oci://higress-registry.cn-hangzhou.cr.aliyuncs.com/plugins/ai-proxy:latest
  status: {}

Trace日志也是有的：
2024-10-31T03:03:53.857600Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_context_create(3, 1) thread=211
2024-10-31T03:03:53.857657Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_context_create return: void thread=211
2024-10-31T03:03:53.857662Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_headers(3, 17, 0) thread=211
2024-10-31T03:03:53.857668Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 149884, 10, 64836, 64832) thread=211
2024-10-31T03:03:53.857677Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(21) thread=211
2024-10-31T03:03:53.857680Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 562880 thread=211
2024-10-31T03:03:53.857682Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857686Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(8446992, 10, 64888, 64892) thread=211
2024-10-31T03:03:53.857692Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(6) thread=211
2024-10-31T03:03:53.857693Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 566744 thread=211
2024-10-31T03:03:53.857695Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 0 thread=211
2024-10-31T03:03:53.857697Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(8446976, 12, 64888, 64892) thread=211
2024-10-31T03:03:53.857698Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 1 thread=211
2024-10-31T03:03:53.857703Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116519, 12, 64836, 64832) thread=211
2024-10-31T03:03:53.857705Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(16) thread=211
2024-10-31T03:03:53.857706Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 562856 thread=211
2024-10-31T03:03:53.857708Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857710Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116503, 16, 64836, 64832) thread=211
2024-10-31T03:03:53.857712Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=211
2024-10-31T03:03:53.857721Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 559216, 47) thread=211
2024-10-31T03:03:53.857725Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestHeader] provider=azure thread=211
2024-10-31T03:03:53.857726Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857729Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_effective_context(3) thread=211
2024-10-31T03:03:53.857731Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_effective_context return: 0 thread=211
2024-10-31T03:03:53.857732Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116455, 5, 62084, 62080) thread=211
2024-10-31T03:03:53.857734Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(27) thread=211
2024-10-31T03:03:53.857735Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8425312 thread=211
2024-10-31T03:03:53.857737Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857744Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_property(562832, 17, 566728, 3) thread=211
2024-10-31T03:03:53.857748Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_property return: 0 thread=211
2024-10-31T03:03:53.857750Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116519, 12, 62084, 62080) thread=211
2024-10-31T03:03:53.857752Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(16) thread=211
2024-10-31T03:03:53.857753Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 562808 thread=211
2024-10-31T03:03:53.857755Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857756Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116531, 14, 62084, 62080) thread=211
2024-10-31T03:03:53.857758Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(3) thread=211
2024-10-31T03:03:53.857759Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 566720 thread=211
2024-10-31T03:03:53.857760Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857762Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116545, 17, 62084, 62080) thread=211
2024-10-31T03:03:53.857765Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=211
2024-10-31T03:03:53.857780Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 8462192, 96) thread=211
2024-10-31T03:03:53.857782Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: check has request body: contentType:application/json, contentLengthStr:287, transferEncodingStr: thread=211
2024-10-31T03:03:53.857785Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857788Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116455, 5, 62004, 62000) thread=211
2024-10-31T03:03:53.857790Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(27) thread=211
2024-10-31T03:03:53.857791Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8425248 thread=211
2024-10-31T03:03:53.857793Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857795Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 111451, 21, 8425248, 27) hread=211
2024-10-31T03:03:53.857798Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857799Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 116455, 5, 570488, 81) thread=211
2024-10-31T03:03:53.857801Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857803Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 149884, 10, 62004, 62000) thread=211
2024-10-31T03:03:53.857805Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(21) thread=211
2024-10-31T03:03:53.857806Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 562784 thread=211
2024-10-31T03:03:53.857807Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857809Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 111430, 21, 562784, 21) hread=211
2024-10-31T03:03:53.857811Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857812Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 149884, 10, 555824, 30) hread=211
2024-10-31T03:03:53.857814Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857815Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 123210, 7, 555762, 32) thread=211
2024-10-31T03:03:53.857817Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857819Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_remove_header_map_value(0, 148784, 14) thread=211
2024-10-31T03:03:53.857821Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_remove_header_map_value return: 0 thread=211
2024-10-31T03:03:53.857825Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(2, 559120, 46) thread=211
2024-10-31T03:03:53.857826Z info envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1387 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] SetRequestBodyBufferLimit: 10485760 thread=211
2024-10-31T03:03:53.857828Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857831Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_property(8425216, 24, 8446768, 8) thread=211
2024-10-31T03:03:53.857834Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_property return: 0 thread=211
2024-10-31T03:03:53.857835Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_headers return: 1 thread=211
2024-10-31T03:03:53.857843Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_body(3, 287, 0) thread=211
2024-10-31T03:03:53.857846Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_body return: 1 thread=211
2024-10-31T03:03:53.857851Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_body(3, 287, 1) thread=211
2024-10-31T03:03:53.857854Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_buffer_bytes(0, 0, 574, 65160, 65164) thread=211
2024-10-31T03:03:53.857856Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(287) thread=211
2024-10-31T03:03:53.857858Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 553568 thread=211
2024-10-31T03:03:53.857859Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_buffer_bytes return: 0 thread=211
2024-10-31T03:03:53.857862Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 559024, 45) thread=211
2024-10-31T03:03:53.857864Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestBody] provider=azure thread=211
2024-10-31T03:03:53.857865Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857869Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 8444064, 326) thread=211
2024-10-31T03:03:53.857870Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestBody] newBody={
"model": "gpt-4o-mini",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant."
},
{
"role": "user",
"content": "Write a haiku that explains the concept of recursion."
}
]
} thread=211
2024-10-31T03:03:53.857871Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857913Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 8457680, 202) thread=211
2024-10-31T03:03:53.857915Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] request body: {"model":"gpt-4o-mini","messages":[{"role":"system","content":"You are a helpful assistant."},{"role":"user","content":"Write a haiku that explains the concept of recursion."}]} thread=211
2024-10-31T03:03:53.857916Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=211
2024-10-31T03:03:53.857919Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_buffer_bytes(0, 0, 2147483647, 8465984, 177) thread=211
2024-10-31T03:03:53.857923Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_buffer_bytes return: 0 thread=211
2024-10-31T03:03:53.857925Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_body return: 0 thread=211
2024-10-31T03:03:53.857948Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_response_headers(3, 2, 1) thread=211
2024-10-31T03:03:53.857951Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(2, 116519, 12, 65284, 65280) thread=211
2024-10-31T03:03:53.857955Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=211
2024-10-31T03:03:53.857957Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(2, 116503, 16, 65284, 65280) thread=211
2024-10-31T03:03:53.857959Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=211
2024-10-31T03:03:53.857961Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(562688, 21, 64936, 64940) thread=211
2024-10-31T03:03:53.857965Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(15) thread=211
2024-10-31T03:03:53.857967Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8446192 thread=211
2024-10-31T03:03:53.857968Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 0 thread=211
2024-10-31T03:03:53.857970Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_response_headers return: 0 thread=211
2024-10-31T03:03:53.858045Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_log(3) thread=211
2024-10-31T03:03:53.858051Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_log return: void thread=211
2024-10-31T03:03:53.858053Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_done(3) thread=211
2024-10-31T03:03:53.858055Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_done return: 1 thread=211
2024-10-31T03:03:53.858057Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_delete(3) thread=211
2024-10-31T03:03:53.858059Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_delete return: void thread=211
{"authority":"higress.gkid.com:8643","bytes_received":"287","bytes_sent":"0","downstream_local_address":"172.17.0.3:8443","downstream_remote_address":"192.168.65.1:36261","duration":"0","istio_policy_status":"-","method":"POST","path":"/openai/v1/chat/completions","protocol":"HTTP/1.1","request_id":"56192331-c01b-44f4-b208-309933f99dd1","requested_server_name":"higress.gkid.com","response_code":"308","response_flags":"-","route_name":"openai","start_time":"2024-10-31T03:03:53.857Z","trace_id":"-","upstream_cluster":"-","upstream_host":"-","upstream_local_address":"-","upstream_service_time":"-","upstream_transport_failure_reason":"-","user_agent":"PostmanRuntime/7.42.0","x_forwarded_for":"192.168.65.1"}
2024-10-31T03:05:56.396431Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_context_create(2, 1) thread=219
2024-10-31T03:05:56.399664Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_context_create return: void thread=219
2024-10-31T03:05:56.399724Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_headers(2, 16, 0) thread=219
2024-10-31T03:05:56.400177Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 149884, 10, 64836, 64832) thread=219
2024-10-31T03:05:56.400278Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(21) thread=219
2024-10-31T03:05:56.400300Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 563672 thread=219
2024-10-31T03:05:56.400307Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.400314Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(534112, 10, 64888, 64892) thread=219
2024-10-31T03:05:56.400326Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(6) thread=219
2024-10-31T03:05:56.400442Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 565624 thread=219
2024-10-31T03:05:56.400450Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 0 thread=219
2024-10-31T03:05:56.400455Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(534096, 12, 64888, 64892) thread=219
2024-10-31T03:05:56.400459Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 1 thread=219
2024-10-31T03:05:56.400850Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116519, 12, 64836, 64832) thread=219
2024-10-31T03:05:56.400988Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(16) thread=219
2024-10-31T03:05:56.400997Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 563648 thread=219
2024-10-31T03:05:56.401001Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401006Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116503, 16, 64836, 64832) thread=219
2024-10-31T03:05:56.401038Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=219
2024-10-31T03:05:56.401117Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 560416, 47) thread=219
2024-10-31T03:05:56.401126Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestHeader] provider=azure thread=219
2024-10-31T03:05:56.401129Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.401133Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_effective_context(2) thread=219
2024-10-31T03:05:56.401136Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_effective_context return: 0 thread=219
2024-10-31T03:05:56.401139Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116455, 5, 62084, 62080) thread=219
2024-10-31T03:05:56.401165Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(27) thread=219
2024-10-31T03:05:56.401178Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8425376 thread=219
2024-10-31T03:05:56.401181Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401198Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_property(563600, 17, 565600, 3) thread=219
2024-10-31T03:05:56.401233Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_property return: 0 thread=219
2024-10-31T03:05:56.401239Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116519, 12, 62084, 62080) thread=219
2024-10-31T03:05:56.401247Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(16) thread=219
2024-10-31T03:05:56.401251Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 563576 thread=219
2024-10-31T03:05:56.401253Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401254Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116531, 14, 62084, 62080) thread=219
2024-10-31T03:05:56.401257Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(3) thread=219
2024-10-31T03:05:56.401259Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 565592 thread=219
2024-10-31T03:05:56.401262Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401264Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116545, 17, 62084, 62080) thread=219
2024-10-31T03:05:56.401268Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=219
2024-10-31T03:05:56.401295Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 8449904, 96) thread=219
2024-10-31T03:05:56.401300Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: check has request body: contentType:application/json, contentLengthStr:287, transferEncodingStr: thread=219
2024-10-31T03:05:56.401302Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.401462Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 116455, 5, 62004, 62000) thread=219
2024-10-31T03:05:56.401471Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(27) thread=219
2024-10-31T03:05:56.401474Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8425312 thread=219
2024-10-31T03:05:56.401475Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401478Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 111451, 21, 8425312, 27) hread=219
2024-10-31T03:05:56.401484Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401485Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 116455, 5, 573216, 81) thread=219
2024-10-31T03:05:56.401488Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401493Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(0, 149884, 10, 62004, 62000) thread=219
2024-10-31T03:05:56.401497Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(21) thread=219
2024-10-31T03:05:56.401500Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 563552 thread=219
2024-10-31T03:05:56.401502Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401504Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 111430, 21, 563552, 21) hread=219
2024-10-31T03:05:56.401507Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401510Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 149884, 10, 555824, 30) hread=219
2024-10-31T03:05:56.401512Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401515Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_replace_header_map_value(0, 123210, 7, 555762, 32) thread=219
2024-10-31T03:05:56.401517Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_replace_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401520Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_remove_header_map_value(0, 148784, 14) thread=219
2024-10-31T03:05:56.401523Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_remove_header_map_value return: 0 thread=219
2024-10-31T03:05:56.401531Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(2, 560320, 46) thread=219
2024-10-31T03:05:56.401534Z info envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1387 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] SetRequestBodyBufferLimit: 10485760 thread=219
2024-10-31T03:05:56.401537Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.401541Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_property(8425280, 24, 533872, 8) thread=219
2024-10-31T03:05:56.401547Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_property return: 0 thread=219
2024-10-31T03:05:56.401551Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_headers return: 1 thread=219
2024-10-31T03:05:56.401573Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_body(2, 287, 0) thread=219
2024-10-31T03:05:56.401678Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_body return: 1 thread=219
2024-10-31T03:05:56.401695Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_request_body(2, 287, 1) thread=219
2024-10-31T03:05:56.401699Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_buffer_bytes(0, 0, 574, 65160, 65164) thread=219
2024-10-31T03:05:56.401702Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(287) thread=219
2024-10-31T03:05:56.401712Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 555088 thread=219
2024-10-31T03:05:56.401715Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_buffer_bytes return: 0 thread=219
2024-10-31T03:05:56.401720Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 560224, 45) thread=219
2024-10-31T03:05:56.401722Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestBody] provider=azure thread=219
2024-10-31T03:05:56.401724Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.402145Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 580848, 326) thread=219
2024-10-31T03:05:56.402177Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] [onHttpRequestBody] newBody={
"model": "gpt-4o-mini",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant."
},
{
"role": "user",
"content": "Write a haiku that explains the concept of recursion."
}
]
} thread=219
2024-10-31T03:05:56.402182Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.404267Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_log(1, 8457888, 202) thread=219
2024-10-31T03:05:56.404286Z debug envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1384 wasm log higress-system.ai-proxy-1.0.0: [ai-proxy] request body: {"model":"gpt-4o-mini","messages":[{"role":"system","content":"You are a helpful assistant."},{"role":"user","content":"Write a haiku that explains the concept of recursion."}]} thread=219
2024-10-31T03:05:56.404308Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_log return: 0 thread=219
2024-10-31T03:05:56.404318Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_set_buffer_bytes(0, 0, 2147483647, 553872, 177) thread=219
2024-10-31T03:05:56.404327Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_set_buffer_bytes return: 0 thread=219
2024-10-31T03:05:56.404333Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_request_body return: 0 thread=219
2024-10-31T03:05:56.404396Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_response_headers(2, 2, 1) thread=219
2024-10-31T03:05:56.404514Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(2, 116519, 12, 65284, 65280) thread=219
2024-10-31T03:05:56.404523Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=219
2024-10-31T03:05:56.404526Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_header_map_value(2, 116503, 16, 65284, 65280) thread=219
2024-10-31T03:05:56.404529Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_header_map_value return: 1 thread=219
2024-10-31T03:05:56.404532Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm->host] env.proxy_get_property(562904, 21, 64936, 64940) thread=219
2024-10-31T03:05:56.404541Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_memory_allocate(15) thread=219
2024-10-31T03:05:56.404544Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_memory_allocate return: 8447024 thread=219
2024-10-31T03:05:56.404545Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [vm<-host] env.proxy_get_property return: 0 thread=219
2024-10-31T03:05:56.404573Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_response_headers return: 0 thread=219
2024-10-31T03:05:56.404880Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_log(2) thread=219
2024-10-31T03:05:56.404977Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_log return: void thread=219
2024-10-31T03:05:56.404988Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_done(2) thread=219
2024-10-31T03:05:56.405064Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_done return: 1 thread=219
2024-10-31T03:05:56.405070Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host->vm] proxy_on_delete(2) thread=219
2024-10-31T03:05:56.405120Z trace envoy wasm external/envoy/source/extensions/common/wasm/wasm_vm.cc:46 [host<-vm] proxy_on_delete return: void thread=219
{"authority":"higress.gkid.com:8643","bytes_received":"287","bytes_sent":"0","downstream_local_address":"172.17.0.3:8443","downstream_remote_address":"192.168.65.1:36262","duration":"8","istio_policy_status":"-","method":"POST","path":"/openai/v1/chat/completions","protocol":"HTTP/1.1","request_id":"60851992-ba48-4a75-ba02-c54b2a3d1d99","requested_server_name":"higress.gkid.com","response_code":"308","response_flags":"-","route_name":"openai","start_time":"2024-10-31T03:05:56.396Z","trace_id":"-","upstream_cluster":"-","upstream_host":"-","upstream_local_address":"-","upstream_service_time":"-","upstream_transport_failure_reason":"-","user_agent":"PostmanRuntime/7.42.0","x_forwarded_for":"192.168.65.1"}

johnlanni · 2024-10-31T03:26:00Z

johnlanni
Oct 31, 2024
Maintainer

看日志是返回308了，你是用 HTTP 访问的吗？把域名配置那里的开启HTTPS强制跳转关一下呢？
另外你把 curl 请求后的结果也贴一下？

3 replies

lixiaoyin-221 Oct 31, 2024
Author

{
"error": {
"code": "401",
"message": "Access denied due to invalid subscription key or wrong API endpoint. Make sure to provide a valid key for an active subscription and use a correct regional API endpoint for your resource."
}
}

如果关闭HTTPS强制跳转会提示：400 The plain HTTP request was sent to HTTPS port
这个很奇怪，我是HTTPS访问的

curl --location 'https://higress.xxx.com:8643/openai/v1/chat/completions'
--header 'Content-Type: application/json'
--data '{
"model": "gpt-4o-mini",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant."
},
{
"role": "user",
"content": "Write a haiku that explains the concept of recursion."
}
]
}'

CH3CHO Oct 31, 2024
Maintainer

这是两个事情。一个你是用什么协议访问Higress，另一个是Higress使用什么协议转发请求到后端服务。建议你把 higress-system 命名空间下面的 McpBridge 和 Ingress 配置都贴一下。

johnlanni Oct 31, 2024
Maintainer

你中间是不是走了什么代理呀，因为看日志你请求的url是higress.gkid.com:8643，但是看higress接受处理的地址是 172.17.0.3:8443，应该是你这个监听在8643端口的代理导致的

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

基于Higress访问大模型，无法传递apikey #1460

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 2 comments 7 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

基于Higress访问大模型，无法传递apikey #1460

lixiaoyin-221 Oct 30, 2024

Replies: 2 comments · 7 replies

johnlanni Oct 31, 2024 Maintainer

lixiaoyin-221 Oct 31, 2024 Author

johnlanni Oct 31, 2024 Maintainer

johnlanni Oct 31, 2024 Maintainer

lixiaoyin-221 Oct 31, 2024 Author

johnlanni Oct 31, 2024 Maintainer

lixiaoyin-221 Oct 31, 2024 Author

CH3CHO Oct 31, 2024 Maintainer

johnlanni Oct 31, 2024 Maintainer

lixiaoyin-221
Oct 30, 2024

Replies: 2 comments 7 replies

johnlanni
Oct 31, 2024
Maintainer

lixiaoyin-221 Oct 31, 2024
Author

johnlanni Oct 31, 2024
Maintainer

johnlanni Oct 31, 2024
Maintainer

lixiaoyin-221 Oct 31, 2024
Author

johnlanni
Oct 31, 2024
Maintainer

lixiaoyin-221 Oct 31, 2024
Author

CH3CHO Oct 31, 2024
Maintainer

johnlanni Oct 31, 2024
Maintainer