Skip to content

Chore/use faust assignore if changelogtopics#18

Closed
Mopsgeschwindigkeit wants to merge 4 commits intomasterfrom
chore/use-faust-assignore-if-changelogtopics
Closed

Chore/use faust assignore if changelogtopics#18
Mopsgeschwindigkeit wants to merge 4 commits intomasterfrom
chore/use-faust-assignore-if-changelogtopics

Conversation

@Mopsgeschwindigkeit
Copy link
Copy Markdown

Description

  • Force the usage of the faust-assignor if app uses changelog_topics.
  • Use newest version of Kafka API-Requests for Metadata and Create Topic.

Problems

  • If self.app.conf.table_standby_replicas = 0 the RoundRobinPartitionAssignor is used even is the app contains changelog_topics, which leads to a situation where changelog_topics are not consumed at the start of the app.

  • With newer version of aiokafka, some older api-version where deprecated.

Additional

This PR is based on the work of @nightcityblade (faust-streaming#674).

nightcityblade and others added 2 commits February 27, 2026 00:21
aiokafka 0.13.0 removed the `api_version` parameter from both
`AIOKafkaConsumer` and `AIOKafkaProducer`. Since faust requires
`aiokafka>=0.10.0`, it needs to handle both old and new versions.

This adds a version check and conditionally includes `api_version`
only when running with aiokafka < 0.13.0.

Fixes faust-streaming#672
@Mopsgeschwindigkeit Mopsgeschwindigkeit force-pushed the chore/use-faust-assignore-if-changelogtopics branch from b987610 to 310b7ce Compare March 11, 2026 09:47
nightcityblade and others added 2 commits March 31, 2026 14:19
…st-streaming#674)

aiokafka 0.13.0 removed the `api_version` parameter from both
`AIOKafkaConsumer` and `AIOKafkaProducer`. Since faust requires
`aiokafka>=0.10.0`, it needs to handle both old and new versions.

This adds a version check and conditionally includes `api_version`
only when running with aiokafka < 0.13.0.

Fixes faust-streaming#672

Co-authored-by: nightcityblade <nightcityblade@gmail.com>
@Mopsgeschwindigkeit Mopsgeschwindigkeit force-pushed the chore/use-faust-assignore-if-changelogtopics branch from cfd53dc to eed0079 Compare March 31, 2026 12:19
@Mopsgeschwindigkeit Mopsgeschwindigkeit changed the base branch from master to sxmaster March 31, 2026 12:20
@Mopsgeschwindigkeit Mopsgeschwindigkeit changed the base branch from sxmaster to master March 31, 2026 12:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants