Skip to content

Kafka connector commits incorrect topic partitions offsets #193

@IpShot

Description

@IpShot

Currently it commits offset of the last record so there is persistent lag = 1 in partition.

Screenshot 2024-11-01 at 09 15 31

Steps to reproduce:

  • Run Kafka connector.
  • Produce message to respective topic so it's handled my Kafka connector.
  • See the lag is 1 on a topic partition.
  • Restart Kafka connector.

Result:

  • After connector restarted the message is handled again.

Expected:

  • After connector restart the message is not handled again.

┆Issue is synchronized with this Jira Task by Unito

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions