Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Dec 16, 2025

Kafka client support was missing, preventing standardized reader/writer creation for topics and consumer groups.

  • Kafka client package: Added kafka_client with ReaderConfig/WriterConfig and factory helpers that validate required brokers/topic.
  • Configuration coverage: Reader supports group/partition and offsets; writer supports async/acks, batching, balancer, compression codec, and attempts.
  • Docs: Updated module docs and README to list the new Kafka client.
  • Tests: Added unit tests verifying validation and config propagation to kafka-go.

Example:

r := kafka_client.NewReader(kafka_client.ReaderConfig{
    Brokers: []string{"localhost:9092"},
    Topic:   "events",
    GroupID: "service-a",
})
w := kafka_client.NewWriter(kafka_client.WriterConfig{
    Brokers:      []string{"localhost:9092"},
    Topic:        "events",
    Async:        true,
    RequiredAcks: kafka.RequireAll,
})
Original prompt

This section details on the original issue you should resolve

<issue_title>Kafka client with reader & writer</issue_title>
<issue_description></issue_description>

Comments on the Issue (you are @copilot in this section)


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

Copilot AI and others added 2 commits December 16, 2025 09:17
Co-authored-by: slhmy <31381093+slhmy@users.noreply.github.com>
Co-authored-by: slhmy <31381093+slhmy@users.noreply.github.com>
Copilot AI changed the title [WIP] Add Kafka client with reader and writer Add Kafka reader/writer factory package Dec 16, 2025
Copilot AI requested a review from slhmy December 16, 2025 09:20
@slhmy slhmy marked this pull request as ready for review December 16, 2025 10:24
@slhmy slhmy merged commit dfc6cfd into main Dec 16, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Kafka client with reader & writer

2 participants