Skip to content

IS-18605: Removed references to key_schema and value_schema properties #1323

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
grove merged 1 commit into from
Dec 12, 2025
Merged

IS-18605: Removed references to key_schema and value_schema properties #1323

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion hub/documentation/service-configuration/pipes/configuration-sinks-kafka.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Kafka sink

The Kafka sink produces data to a Kafka topic.

Entities sent to this sink will use the ``"key"``, ``"value"``, ``"headers"``, ``"key_schema"`` and ``"value_schema"`` properties to produce the messages sent to the Kafka topic. The latter two properties are only relevant if the ``"confluent_schema_json"`` serializer is used. The properties ``"key"`` and ``"value"`` are mandatory. The ``"headers"`` property is optional, but it must be an object with string keys and string or bytes values if present.
Entities sent to this sink will use the ``"key"``, ``"value"`` and ``"headers"`` properties to produce the messages sent to the Kafka topic. The latter two properties are only relevant if the ``"confluent_schema_json"`` serializer is used. The properties ``"key"`` and ``"value"`` are mandatory. The ``"headers"`` property is optional, but it must be an object with string keys and string or bytes values if present.

The properties used matches the properties emitted by the :ref:`Kafka source <kafka_source>`. This means that it should be possible to consume a topic and produce to a new topic in a pipe with no DTL.

Expand Down
2 changes: 1 addition & 1 deletion hub/documentation/service-configuration/pipes/configuration-sources-kafka.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Kafka source

The Kafka source consumes data from a Kafka topic. The consumer does not use a consumer group, but instead stores the offset in the pipe, and it does not commit the consumer offset back to Kafka.

The entities emitted from this source has the properties ``"offset"``, ``"partition"``, ``"timestamp"``, ``"key"``, ``"key_schema"``, ``"value"``, ``"value_schema"``, ``"headers"``. If key deserialization fails and ``"strict"`` is ``false`` then the entity will also have an ``"invalid_key"`` property. Similarly if value deserialization fails and ``"strict"`` is ``false`` then the entity will also have an ``"invalid_value"`` property. ``"headers"`` is optional and will only be present if the message has headers. If present the ``"headers"`` property is an object with string keys and string or bytes values. If the header value is of type bytes then it means that the header value couldn't be deserialized as a string.
The entities emitted from this source has the properties ``"offset"``, ``"partition"``, ``"timestamp"``, ``"key"``, ``"value"``, ``"headers"``. If key deserialization fails and ``"strict"`` is ``false`` then the entity will also have an ``"invalid_key"`` property. Similarly if value deserialization fails and ``"strict"`` is ``false`` then the entity will also have an ``"invalid_value"`` property. ``"headers"`` is optional and will only be present if the message has headers. If present the ``"headers"`` property is an object with string keys and string or bytes values. If the header value is of type bytes then it means that the header value couldn't be deserialized as a string.

.. NOTE::

Expand Down