[BLOG POST] Compression Improves Everything*

[xdk-amz]

New Blog Post

What is your proposed topic?
This blog will detail the benefits that compression can have on caching workloads. It will include details on how to use compression specifically in Valkey.

Who is writing this blog post?
@xdk-amz

What is your ideal publishing date?
There is no time constraint or ideal publishing date for this currently

Is this blog post dependent on something else?
Not specifically, but it could be nice to time the blog release with an update to the Glide client to support transparent compression.

[asafpamzn]

@xdk-amz ,
What did you had in mind?
Will be nice to get contribution to compression for valkey-glide :) . We can do it in the rust core and provide native compression to all languages.

[xdk-amz]

I was imagining an optional feature flag for clients that would allow them to use a compression backend transparently. SET/GET commands would implicitly compress/decompress retrieved values. The compression backend can be extensible such that we can support a variety of compression algorithms with varying tradeoffs in TPS, latency, compression ratio, compression/decompression speed, etc.

[stockholmux]

@xdk-amz where are we on this one? I know there is a PR with a lot of feedback. Are you taking it a new direction?

[xdk-amz]

@stockholmux Based on the feedback, I think it would make the most sense to pair the blog with a compression-specific feature in valkey-glide. While it is possible to write the blog with examples that are more relevant to Valkey, all of the examples would include changes in the application layer (ie not really specific to Valkey). Pairing the blog with a transparent compression feature in valkey-glide, even a simple one, seems to me to be the best way to truly make the blog specific to Valkey and additionally offer a new cost-saving feature to the community in valkey-glide.

[stockholmux]

@xdk-amz Thanks for the update! Do you an idea of when the compression stuff in Valkey glide is planned to come up?

[xdk-amz]

@stockholmux I am preparing a PR that should be ready to publish next week for a minimal implementation of this (just basic SET/GET support + java/go/python/node bindings). I may actually omit the java/go/node bindings to keep the PR small and focused on the core Rust implementation with just Python for PoC usage and testing.

I imagine it will take a few weeks to review and get approved, and during this time I can start working on rewriting the blog with usage of the feature as the example.

[asafpamzn]

@xdk-amz , I have a lot of experience with compression and with valkey-glide.
I suggest to open a slack channel to discuss it. I will be happy to assist with the implementation.

[xdk-amz]

valkey-io/valkey-glide#4759 PR

[stockholmux]

@xdk-amz Now, I'll be excited about a compression blog post that cover what you're doing in that PR.

[xdk-amz]

valkey-io/valkey-glide#4759 the initial PR has been merged.

Still to-do before publishing the blog:

• Add support for Java
• Add support for Node
• Add support for Go
• Add support for PHP (GA in 2.3)
• Add support for C# (GA in 2.3
• Generate benchmark data for at least one binding
• Rewrite the blog :)

[xdk-amz]

I rewrote the blog in the context of the new feature with Go benchmarks.