how to use batching or gpu to inference #567
Answered
by
snakers4
Joyful-Buffalo
asked this question in
Q&A
-
Beta Was this translation helpful? Give feedback.
Answered by
snakers4
Nov 5, 2024
Replies: 1 comment
-
|
Hi, the VAD is not designed to run on GPU. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
snakers4
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi, the VAD is not designed to run on GPU.
As for batching, we also do not support it officially, a it's too complicated and error prone to explain.