Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unapply non-buffered performance optimisation #289

Merged
merged 2 commits into from
Oct 31, 2024

Conversation

peppy
Copy link
Member

@peppy peppy commented Oct 29, 2024

ProxySQL doesn't work great with this. If there's a pause (or sometimes even if there isn't) ie. connection may be dropped causing the reading to fail and abort the whole process.

I'm PRing this separately because I may bring this back in the near future, depending on how things go. Right now we're bottlenecked on writes, not reads, so it's not a huge issue.

Already using on production run.

@peppy peppy requested a review from smoogipoo October 29, 2024 06:53
@peppy
Copy link
Member Author

peppy commented Oct 29, 2024

Don't merge this quite yet. It's quite a performance hit for certain user cases and I might find a better way.

peppy added 2 commits October 30, 2024 18:01
ProxySQL doesn't work great with this. If there's a pause (or sometimes
even if there isn't) ie. waiting for replication to catch up, the
connection may be dropped causing the reading to fail and abort the
whole process.

I'm PRing this separately because I may bring this back in the near
future, depending on how things go. Right now we're bottlenecked on
writes, not reads, so it's not a huge issue.
@peppy
Copy link
Member Author

peppy commented Oct 31, 2024

@smoogipoo this is good to go for now

@smoogipoo smoogipoo merged commit ba6cb77 into ppy:master Oct 31, 2024
3 checks passed
@peppy peppy deleted the buffer-again branch November 22, 2024 06:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants