feat: add event truncation to enforce max payload size#24
Merged
Conversation
kashishhora
requested changes
Feb 26, 2026
MCP servers can return non-text content (images, audio, binary resources) and tool parameters can contain embedded base64 blobs. These bloat event payloads and aren't useful for analytics. This adds a two-layer sanitization step to the event processing pipeline: - Layer 1: replaces image/audio/blob/unknown content blocks in responses - Layer 2: recursively scans parameters and structured_content for large base64 strings (>=10KB) and redacts them Sanitization runs after customer redaction and before event ID generation, using deepcopy to preserve immutability of the original event. Also improves event queue shutdown behavior: - Replace time.sleep with shutdown_event.wait for interruptible retry backoff - Early return in _send_event when shutdown is detected - Pass cancel_futures=True to executor.shutdown()
Introduce a truncation module that enforces a 100 KB maximum event payload size. Oversized string values are truncated, nesting depth and collection breadth are limited, and circular references are detected. Uses progressive tightening — if the first pass doesn't bring the event under the limit, depth and string limits are reduced iteratively. Runs after sanitization in the event pipeline.
naji247
force-pushed
the
feat/event-truncation
branch
from
fe13fb5 to
9ab53e4
Compare
kashishhora
approved these changes
Feb 26, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Test plan
uv run pytest tests/test_truncation.py -vuv run pytest(full suite)