[Bug] The write speed is too slow due to unreasonable locking time during retries

[suxinshuo]

Search before asking

• I had searched in the issues and found no similar issues.

Version

spark-doris-connector-spark-3.3-25.0.1

What's Wrong?

A single spark task writes doris at a speed of about 20 records/s, which is too slow.

What You Expected?

The write speed is close to streamload.

How to Reproduce?

Use spark 3.3.1 to configure doris catalog and write data to doris.

Anything Else?

I found that in the Retry class, even if the write is successful, it will still lock for a period of time. The default time is 50ms, which corresponds to the time of 20 records/s. I understand that if the execution is successful, there should be no need to lock for a period of time?

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[suxinshuo]

I found that this problem has been fixed in the master branch. When will the next version be released?

[JNSimba]

Yes, the master has been fixed and a new version will be released in the next week or two