Skip to content
test

Eval Refactor Part 1 #19985

Sign in to view logs

Eval Refactor Part 1

Eval Refactor Part 1 #19985

Triggered via push January 4, 2025 04:07
@tssweeneytssweeney
pushed e68a231
tim/apply_scorer
Status Failure
Total duration 7m 49s
Artifacts –

test.yaml

on: push
check-which-tests-to-run  /  check
32s
check-which-tests-to-run / check
Matrix: Trace nox tests
Python lint
1m 7s
Python lint
Trace docs
2m 50s
Trace docs
Build Legacy (Query Service) test container
3s
Build Legacy (Query Service) test container
WeaveJS Lint and Compile
23s
WeaveJS Lint and Compile
trace-tests-matrix-check
7s
trace-tests-matrix-check
Matrix: Legacy (Query Service) Python unit tests
test-query-service-matrix-check
2s
test-query-service-matrix-check
Fit to window
Zoom out
Zoom in

Annotations

25 errors and 102 warnings
Python lint
Process completed with exit code 1.
Trace nox tests (3, 9, groq)
Process completed with exit code 1.
Trace nox tests (3, 9, cerebras)
Process completed with exit code 1.
Trace nox tests (3, 9, dspy)
Process completed with exit code 1.
Trace nox tests (3, 9, trace)
Process completed with exit code 1.
Trace nox tests (3, 9, scorers_tests)
Process completed with exit code 1.
Trace nox tests (3, 9, google_ai_studio)
Process completed with exit code 1.
Trace nox tests (3, 9, litellm)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral0)
Process completed with exit code 1.
Trace nox tests (3, 9, vertexai)
Process completed with exit code 1.
Trace nox tests (3, 9, llamaindex)
Process completed with exit code 1.
Trace nox tests (3, 9, pandas-test)
Process completed with exit code 1.
Trace nox tests (3, 9, trace_server)
Process completed with exit code 1.
Trace nox tests (3, 9, langchain)
Process completed with exit code 1.
Trace nox tests (3, 9, anthropic)
Process completed with exit code 1.
Trace nox tests (3, 9, openai)
Process completed with exit code 1.
Trace nox tests (3, 9, instructor)
Process completed with exit code 1.
Trace nox tests (3, 9, mistral1)
Process completed with exit code 1.
Trace nox tests (3, 9, cohere)
Process completed with exit code 1.
Trace nox tests (3, 9, notdiamond)
Process completed with exit code 1.
Trace nox tests (3, 10, trace)
Process completed with exit code 1.
Trace nox tests (3, 11, trace)
Process completed with exit code 1.
Trace nox tests (3, 12, trace)
Process completed with exit code 1.
Trace nox tests (3, 13, trace)
Process completed with exit code 1.
trace-tests-matrix-check
Process completed with exit code 1.
check-which-tests-to-run / check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
WeaveJS Lint and Compile
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Python lint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 9, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cohere)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, google_ai_studio)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, anthropic)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, dspy)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, notdiamond)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Legacy (Query Service) Python unit tests (0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, langchain)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, pandas-test)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, litellm)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-query-service-matrix-check
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, groq)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, openai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, vertexai)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, mistral0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, instructor)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, cerebras)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, scorers_tests)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, llamaindex)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace docs
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace_server)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 10, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 11, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 12, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Trace nox tests (3, 13, trace)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636