Use continuous batching by default #2763
ilya-lavrenovcausal_lm_cpp.yml
on: pull_request
Matrix: cpp-beam_search_causal_lm-ubuntu
cpp-multinomial-greedy_causal_lm-ubuntu
7m 37s
cpp-greedy_causal_lm-windows
19m 19s
cpp-beam_search_causal_lm-Qwen-7B-Chat
11m 33s
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
8m 20s
cpp-beam_search_causal_lm-Phi-2
6m 24s
cpp-beam_search_causal_lm-notus-7b-v1
7m 56s
cpp-speculative_decoding_lm-ubuntu
10m 0s
cpp-prompt_lookup_decoding_lm-ubuntu
12m 26s
cpp-Phi-1_5
8m 22s
cpp-greedy_causal_lm-redpajama-3b-chat
12m 49s
cpp-chat_sample-ubuntu
11m 44s
visual_language_chat_sample-ubuntu
12m 22s
cpp-continuous-batching-ubuntu
11m 2s
cpp-continuous-batching-windows
19m 36s
cpp-continuous-batching-macos
16m 38s
ci/gha_overall_status_causal_lm
0s
Annotations
6 errors and 18 warnings
|
cpp-multinomial-greedy_causal_lm-ubuntu
Process completed with exit code 1.
|
|
cpp-beam_search_causal_lm-notus-7b-v1
Process completed with exit code 124.
|
|
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
Process completed with exit code 124.
|
|
cpp-chat_sample-ubuntu
Process completed with exit code 1.
|
|
cpp-prompt_lookup_decoding_lm-ubuntu
Process completed with exit code 1.
|
|
ci/gha_overall_status_causal_lm
Process completed with exit code 1.
|
|
cpp-beam_search_causal_lm-Phi-2
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-multinomial-greedy_causal_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-beam_search_causal_lm-notus-7b-v1
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-beam_search_causal_lm-Qwen1_5-7B-Chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-Phi-1_5
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-speculative_decoding_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-chat_sample-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-continuous-batching-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
visual_language_chat_sample-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-greedy_causal_lm-redpajama-3b-chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-beam_search_causal_lm-Qwen-7B-Chat
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-beam_search_causal_lm-ubuntu (python ./samples/python/beam_search_causal_lm/beam_search_causa...
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-beam_search_causal_lm-ubuntu (./build/samples/cpp/beam_search_causal_lm/beam_search_causal_lm)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-prompt_lookup_decoding_lm-ubuntu
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-continuous-batching-macos
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-continuous-batching-macos
You are using macOS 12.
We (and Apple) do not provide support for this old version.
It is expected behaviour that some formulae will fail to build in this old version.
It is expected behaviour that Homebrew will be buggy and slow.
Do not create any issues about this on Homebrew's GitHub repositories.
Do not create any issues even if you think this message is unrelated.
Any opened issues will be immediately closed without response.
Do not ask for help from Homebrew or its maintainers on social media.
You may ask for help in Homebrew's discussions but are unlikely to receive a response.
Try to figure out the problem yourself and submit a fix as a pull request.
We will review it but may or may not accept it.
|
|
cpp-greedy_causal_lm-windows
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
|
cpp-continuous-batching-windows
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|