Connection to Apache Pulsar

[hpvd]

Beside the well-known and already connected Kafka,
Apache Pulsar (https://github.com/apache/pulsar#readme)
really looks like another rewarding candidate for a connection (read and write to topics)
It has interesting features out of the box like easy to scale, persistence, georeplication, lambda like functions, is already connected to several other apps (source/sink) see https://pulsar.apache.org/docs/2.10.x/io-connectors/
and seems to grow pretty fast
https://pulsar.apache.org/blog/2022/05/11/apache-pulsar-community-welcomes-500th-contributor/

In July 2022 it seems to have also the highest number of pull requests in the field of messaging/streaming tech - even more than Kafa
https://www.youtube.com/watch?v=ckfw68-cn2o

-> would be really exiting what one can build/which new user groups could be attracted by make it easy to combine Quine and Pulsar :-D

[stevenbenjamin]

There is a pulsar ingest defined here, (see under Body, e.g. alternate selection to File Ingest Stream). That being said, would love to get more input on what options people would like to see here for Pulsar connectivity.

[toliver38]

I'll add that it would be great to have native Pulsar support in Quine. We tried to use the now deprecated KOP project but ran into a series of issues with compatibiity. Our interim solution is to replicate data on specific pulsar topics into Kafka which is less than ideal or scalable.