Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: Guidance on how to retry a streaming response #10140

Open
markwallace-microsoft opened this issue Jan 9, 2025 · 0 comments
Open

.Net: Guidance on how to retry a streaming response #10140

markwallace-microsoft opened this issue Jan 9, 2025 · 0 comments
Assignees
Labels
Build Features planned for next Build conference .NET Issue or Pull requests regarding .NET code

Comments

@markwallace-microsoft
Copy link
Member

The LLM may terminate unexpectedly during a streaming response. For non streaming responses a filter can be detect a failure and retry but this doesn't work for streaming responses.

@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code Build Features planned for next Build conference labels Jan 9, 2025
@github-actions github-actions bot changed the title Guidance on how to retry a streaming response .Net: Guidance on how to retry a streaming response Jan 9, 2025
@markwallace-microsoft markwallace-microsoft moved this to Backlog: Planned in Semantic Kernel Jan 9, 2025
@markwallace-microsoft markwallace-microsoft self-assigned this Jan 9, 2025
@markwallace-microsoft markwallace-microsoft moved this from Backlog: Planned to Sprint: Planned in Semantic Kernel Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Build Features planned for next Build conference .NET Issue or Pull requests regarding .NET code
Projects
Status: Sprint: Planned
Development

No branches or pull requests

1 participant