New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

自定义算子和模型相关 #10

Open

520jefferson opened this issue Mar 23, 2022 · 0 comments

520jefferson commented Mar 23, 2022

1，请教下triton pytorch model上线的话，是否支持自定义算子，因为有些推理有话的需求在里面。我看triton官方是支持的
https://github.com/triton-inference-server/server/blob/main/docs/custom_operations.md
2，上线模型有T5的case吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment