PaddleX/latest/pipeline_deploy/high_performance_inference #2698
giscus[bot]
bot
Replies: 1 comment 3 replies
-
|
有没有NPU的高性能支持，比如昇腾910b的，目前测试并发高的情况下，响应速度急剧下降，目前看是多进程对NPU资源的竞争性使用导致的。 |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
遇到了同样的问题，请问解决了吗 |
Beta Was this translation helpful? Give feedback.
-
|
不用了，换回GPU了，目前看910b适合部署大模型，小模型多并发性能不行 |
Beta Was this translation helpful? Give feedback.
-
|
您好，可否提供一下在npu上跑的模型和并发配置，我们想复现一下，看看能不能优化这块 |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
PaddleX/latest/pipeline_deploy/high_performance_inference
https://paddlepaddle.github.io/PaddleX/latest/pipeline_deploy/high_performance_inference.html
Beta Was this translation helpful? Give feedback.
All reactions