perf improvements#11
Merged
Merged
Conversation
- Rewrite SlateDB tuning for slow links (8MiB L0, 64MiB burst capacity). - Add prefix-aware bloom filters for `br/` (reverse ref) keys. - Fix tracing instrumentation to skip large protobuf structs. - Ensure one-shot compaction polls frequently and L0 drains before close. Co-authored-by: Gemini <noreply@google.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Brice Arnould <brice@vleu.net>
Co-authored-by: Gemini <noreply@google.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Brice Arnould <brice@vleu.net>
The bloom was built by two independent SlateDB snapshots of the inbox and committed prefixes, so a file mid-`complete_file` appeared in neither and its block hashes were never inserted — compaction then dropped live blocks. Take a single `db.snapshot()` for both scans. Co-authored-by: Gemini <noreply@google.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Brice Arnould <brice@vleu.net>
drain_deferred and request_blocks ran to completion regardless of ctx.shutdown, which made the supervisor wait the full 2 s grace before aborting workers on disconnect. Check the token at each iteration so shutdown is near-instant; the timeout stays as a safety net for blocked I/O. Co-authored-by: Gemini <noreply@google.com> Co-authored-by: Claude <noreply@anthropic.com> Signed-off-by: Brice Arnould <brice@vleu.net>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.