Skip to content

[Flink][Enhance] Flink should failover when velox operator handle data error #30

@KevinyhZou

Description

@KevinyhZou

Backend

VL (Velox)

Bug description

当velox算子在处理数据的时候,如果遇到异常情况,底层出现了异常,flink 端目前 是无法感知的,导致作业阻塞。

此时flink 正常的处理逻辑应该是,在读取数据的过程中,应该去判断velox task的状态,如果处于failed 或者 error等情况,

应该failover。

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions