Update doc

triton-inference-server · May 21, 2024 · e0acd50 · e0acd50
1 parent a593f2f
commit e0acd50
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -736,6 +736,9 @@ class TritonPythonModel:
         return None
 ```
 
+*Note:*: If `response_sender` is reused across multiple requests, the model must
+ensure that the `response_sender` is properly cleaned up for the rescheduled requests.
+
 ### `finalize`
 
 Implementing `finalize` is optional. This function allows you to do any clean