Skip to content

v0.13.2 + tweaks#5

Closed
Hurshal Patel (choochootrain) wants to merge 5 commits into
v0.13.2from
v0.13.2-tweaks
Closed

v0.13.2 + tweaks#5
Hurshal Patel (choochootrain) wants to merge 5 commits into
v0.13.2from
v0.13.2-tweaks

Conversation

@choochootrain
Copy link
Copy Markdown

@choochootrain Hurshal Patel (choochootrain) commented Mar 26, 2026

tweaks

  • reduce retry log verbosity
  • handle file already exists error in azure
  • delete stream concurrency bump from 10 to 1000 for gcs

removed

  • rwlock/arc swap implementation in favor of upstream

Ankur Goyal (ankrgyl) and others added 3 commits March 25, 2026 22:30
When creating a file with `PutMode::Create`, if the file already exists,
the other object store implementations will translate the error into an
`AlreadyExists` error. Here we do that for Azure too.
@manugoyal
Copy link
Copy Markdown

  • delete stream concurrency bump - v0.13 and up no longer have a default implementation with concurrency 10

This means we may have to propagate the concurrency bump to the per-provider implementations. I believe we added this for GCS, and it seems like the GCS implementation still uses concurrency 10:

.buffered(10)
.

So maybe we should bump that up to 1000.

Copy link
Copy Markdown

@ankrgyl Ankur Goyal (ankrgyl) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i would keep it as a 'tweaks' branch. but looks good to me

@choochootrain
Copy link
Copy Markdown
Author

cool ill just close this PR and we can keep the branch around

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants