Skip to content

Corrupted message handling and kafka timeout in routeviews-stream project #59

@herofox052

Description

@herofox052

I'm trying to use bgpstream in live mode, i.e. the ris-live and routeviews-stream project, however I encountered several issues.

Firstly, it seems like bgpstream just stucks when encountering a corrputed message, I ran into this type of error several times and each time there was no new message coming in:

2025-08-25 06:24:30 1079626: bs_format_rislive.c:400: ERROR: RIS Live: JSON top-level not object
2025-08-25 06:24:30 1079626: bs_format_rislive.c:310: WARNING: Corrupted RIS Live message: Closing connection after being behind by more than 134217728 (uncompressed) bytes over 10 seconds

Secondly, when using "project=routeviews-stream", it generates this type of error every time after successfully running for a few seconds. I wonder whether it is because problems of bmp or my network.

%5|1756103455.469|REQTMOUT|rdkafka#consumer-1| [thrd:128.223.51.38:9092/0]: 128.223.51.38:9092/0: Timed out FetchRequest in flight (after 61040ms, timeout #0)
%4|1756103455.469|REQTMOUT|rdkafka#consumer-1| [thrd:128.223.51.38:9092/0]: 128.223.51.38:9092/0: Timed out 1 in-flight, 0 retry-queued, 0 out-queue, 0 partially-sent requests
2025-08-25 06:30:55 1080098: bs_transport_kafka.c:144: ERROR: Local: Timed out (-185): 128.223.51.38:9092/0: 1 request(s) timed out: disconnect (after 107083ms in state UP)

These problems also happen to bgpreader.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions