[Bug] [Doris Sink] param of batchSize set to Doris Sink config is useless

[baisui1981]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

By the document of Chunjun Doris Sink , adding config param of batchSize with value of 100,

When I debug the code processing of Doris Sink as below:

chunjun/chunjun-core/src/main/java/com/dtstack/chunjun/sink/format/BaseRichOutputFormat.java

Line 212 in ee6aeaa

this.batchSize = config.getBatchSize();

As debug, value of config.getBatchSize() is 1 (not 100) ,this led to DorisStreamLoad commit record immediately without any locally buffering

I has review the Doris Sink Code as below，

chunjun/chunjun-connectors/chunjun-connector-doris/src/main/java/com/dtstack/chunjun/connector/doris/options/DorisConf.java

Lines 179 to 182 in ee6aeaa

	jdbcConf.setConnection(Collections.singletonList(connectionConf));
	jdbcConf.setJdbcUrl(url);
	jdbcConf.setPassword(password);
	jdbcConf.setUsername(username);

when I append code then batchSize will take effect.

jdbcConf.setBatchSize(this.getBatchSize())

What you expected to happen

make the param of batchSize set to Doris Sink config take effect.

How to reproduce

as described above

Anything else

No response

Version

1.12_release

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[Paddy0523]

Thanks for your issue. Could you provide a PullRequest to fix it？

[baisui1981]

Thanks for your issue. Could you provide a PullRequest to fix it？

sure