Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for generator http client #2

Open
wants to merge 55 commits into
base: main
Choose a base branch
from

Conversation

christinaexyou
Copy link

No description provided.

declark1 and others added 30 commits October 3, 2024 11:37
…rom tls config

Co-authored-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]>
…e OpenAI-specific items, drop Completions API.

Signed-off-by: declark1 <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Dan Clark <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Dan Clark <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Dan Clark <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Dan Clark <[email protected]>
…drop GenerationProvider::OpenAi variant

Signed-off-by: declark1 <[email protected]>
…alth_client to detector clients and OpenAiClient

Co-authored-by: Paul Scoropan <[email protected]>

Signed-off-by: declark1 <[email protected]>
)

* otlp initial setup

Signed-off-by: Paul Scoropan <[email protected]>

* small tweaks

Signed-off-by: Paul Scoropan <[email protected]>

* some refactoring

Signed-off-by: Paul Scoropan <[email protected]>

* missed fmting

Signed-off-by: Paul Scoropan <[email protected]>

* Added telemetry ADR doc

Signed-off-by: Paul Scoropan <[email protected]>

* review comments

Signed-off-by: Paul Scoropan <[email protected]>

* missed nit

Signed-off-by: Paul Scoropan <[email protected]>

* doc nits

Signed-off-by: Paul Scoropan <[email protected]>

* rebase fix

Signed-off-by: Paul Scoropan <[email protected]>

* docs traceparent update

Signed-off-by: Paul Scoropan <[email protected]>

---------

Signed-off-by: Paul Scoropan <[email protected]>
Signed-off-by: gkumbhat <[email protected]>
…_doc_chunk

🐛 Fix whole_doc_chunker missing from client list
Signed-off-by: Mateus Devino <[email protected]>
This reverts commit 1cfcc1e.

Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
mdevino and others added 25 commits October 17, 2024 20:17
Signed-off-by: Mateus Devino <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Co-authored-by: Gaurav Kumbhat <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
…hold_passthrough

🐛 Fix threshold getting passed through beyond orchestrator proces…
)

* ✨ Pass along detector_params for text contents and generation

Signed-off-by: Evaline Ju <[email protected]>

* ✨✅ Not pass on threshold param

Signed-off-by: Evaline Ju <[email protected]>

* 🐛 Mutable threshold not intuitive

Signed-off-by: Evaline Ju <[email protected]>

* Update src/clients/detector/text_chat.rs

Co-authored-by: Mateus Devino <[email protected]>
Signed-off-by: Evaline Ju <[email protected]>

* 💡🎨 Update params comment and remove unnecessary clones

Signed-off-by: Evaline Ju <[email protected]>

* ✅ Threshold re-call not problematic

Signed-off-by: Evaline Ju <[email protected]>

---------

Signed-off-by: Evaline Ju <[email protected]>
Co-authored-by: Mateus Devino <[email protected]>
Signed-off-by: Paul Scoropan <[email protected]>
Signed-off-by: Paul Scoropan <[email protected]>
Signed-off-by: Paul Scoropan <[email protected]>
Signed-off-by: Paul Scoropan <[email protected]>
Signed-off-by: Paul Scoropan <[email protected]>
…-telemetry

Integrate telemetry client instrumentation and traceparent propagation in orchestrator
…k#230)

* Add initial stream handling for OpenAiClient

Signed-off-by: declark1 <[email protected]>

* Update OpenAiClient types and fix streaming request

Signed-off-by: declark1 <[email protected]>

* Add OpenAiError and parse error message, order dependencies

Signed-off-by: declark1 <[email protected]>

* Drop openai client tests module

Signed-off-by: declark1 <[email protected]>

* Telemetry rebase and updates

Signed-off-by: declark1 <[email protected]>

* Return SSE events directly from OpenAiClient stream

Signed-off-by: declark1 <[email protected]>

* Add headers to OpenAiClient chat_completions method

Signed-off-by: declark1 <[email protected]>

---------

Signed-off-by: declark1 <[email protected]>
* added error messages to various unwraps

Signed-off-by: resoluteCoder <[email protected]>

* added detector id vars to expect

Signed-off-by: resoluteCoder <[email protected]>

* changed expects to unwrap or else due to lint

Signed-off-by: resoluteCoder <[email protected]>

---------

Signed-off-by: resoluteCoder <[email protected]>
* Implement Chat Completions API

Signed-off-by: declark1 <[email protected]>

* Conditionally enable chat completions endpoint

Signed-off-by: declark1 <[email protected]>

* Update chat completions to chat completions detection, rename items for alignment

Signed-off-by: declark1 <[email protected]>

---------

Signed-off-by: declark1 <[email protected]>
* 📝 Document tags for detectors API

Signed-off-by: Evaline Ju <[email protected]>

* 🚧 Start stream content API and ADR

Signed-off-by: Evaline Ju <[email protected]>

* 📝 Update content stream response

Signed-off-by: Evaline Ju <[email protected]>

* 📝 Document content for request event

Signed-off-by: Evaline Ju <[email protected]>

* 📝 Update stream content API and decisions

Signed-off-by: Evaline Ju <[email protected]>

* 🚚 Rename field

Signed-off-by: Evaline Ju <[email protected]>

* 📝 Update types and clarify indices

Signed-off-by: Evaline Ju <[email protected]>

---------

Signed-off-by: Evaline Ju <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants