Skip to content

[Bug] connector can't recover after doris become normal #611

@kele1997

Description

@kele1997

Search before asking

  • I had searched in the issues and found no similar issues.

Version

https://github.com/apache/doris-flink-connector/tree/release-25.1.0

What's Wrong?

DorisBatchWriter has a field named flushException.
When doris is down, intervalFlush() will set flushException, but after doris is up, no one will clear flushException, and every time connector write data, it will check the flushException, so connector will stuck, and never recover from last exception.

private void intervalFlush() {
try {
boolean flush = batchStreamLoad.intervalFlush();
LOG.debug("interval flush trigger, flush: {}", flush);
} catch (Exception e) {
flushException = e;
}
}

private void checkFlushException() {
if (flushException != null) {
throw new RuntimeException("Writing records to streamload failed.", flushException);
}
}
}

What You Expected?

when doris is up, the connector should recover from last exception

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions