Search before asking
What happened
when sink data with localtimestamp which contains "T".
+I(6178,17,edbba555e3,2022-09-21T15:25:53.155)
+I(6180,2,fdc78ad2da,2022-09-21T15:25:53.155)
2022-09-21 15:25:53,902 - 19720 ERROR [timer-data-write-thread-pool-1-thread-1] com.dtstack.chunjun.sink.format.BaseRichOutputFormat:Writing records failed. com.dtstack.chunjun.throwable.NoRestartException: The dirty consumer shutdown, due to the consumed count exceed the max-consumed [0]
at com.dtstack.chunjun.dirty.consumer.DirtyDataCollector.addConsumed(DirtyDataCollector.java:105)
at com.dtstack.chunjun.dirty.consumer.DirtyDataCollector.offer(DirtyDataCollector.java:79)
at com.dtstack.chunjun.dirty.manager.DirtyManager.collect(DirtyManager.java:140)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.writeSingleRecord(BaseRichOutputFormat.java:470)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.lambda$writeRecordInternal$1(BaseRichOutputFormat.java:488)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.writeRecordInternal(BaseRichOutputFormat.java:488)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.lambda$initTimingSubmitTask$0(BaseRichOutputFormat.java:444)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-09-21 15:25:53,902 - 19720 WARN [dirty-consumer-pool-2-thread-2] com.dtstack.chunjun.dirty.log.LogDirtyDataCollector:
====================Dirty Data=====================
DirtyDataEntry[jobId='362bc200cf5b7e1a8dec0a195898a469', jobName='flinkStreamSQLLocalTest', operatorName='Sink: Sink(table=[default_catalog.default_database.iot_product], fields=[f_seque', dirtyContent='{"arity":4,"rowKind":"INSERT"}', errorMessage='com.dtstack.chunjun.throwable.WriteRecordException: Kudu output-format writeSingleRecordInternal failed.
java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
What you expected to happen
How to reproduce
sink kudu with localTimestamp
Anything else
No response
Version
master
Are you willing to submit PR?
Code of Conduct
Search before asking
What happened
when sink data with localtimestamp which contains "T".
+I(6178,17,edbba555e3,2022-09-21T15:25:53.155)
+I(6180,2,fdc78ad2da,2022-09-21T15:25:53.155)
2022-09-21 15:25:53,902 - 19720 ERROR [timer-data-write-thread-pool-1-thread-1] com.dtstack.chunjun.sink.format.BaseRichOutputFormat:Writing records failed. com.dtstack.chunjun.throwable.NoRestartException: The dirty consumer shutdown, due to the consumed count exceed the max-consumed [0]
at com.dtstack.chunjun.dirty.consumer.DirtyDataCollector.addConsumed(DirtyDataCollector.java:105)
at com.dtstack.chunjun.dirty.consumer.DirtyDataCollector.offer(DirtyDataCollector.java:79)
at com.dtstack.chunjun.dirty.manager.DirtyManager.collect(DirtyManager.java:140)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.writeSingleRecord(BaseRichOutputFormat.java:470)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.lambda$writeRecordInternal$1(BaseRichOutputFormat.java:488)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.writeRecordInternal(BaseRichOutputFormat.java:488)
at com.dtstack.chunjun.sink.format.BaseRichOutputFormat.lambda$initTimingSubmitTask$0(BaseRichOutputFormat.java:444)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022-09-21 15:25:53,902 - 19720 WARN [dirty-consumer-pool-2-thread-2] com.dtstack.chunjun.dirty.log.LogDirtyDataCollector:
====================Dirty Data=====================
DirtyDataEntry[jobId='362bc200cf5b7e1a8dec0a195898a469', jobName='flinkStreamSQLLocalTest', operatorName='Sink: Sink(table=[default_catalog.default_database.iot_product], fields=[f_seque', dirtyContent='{"arity":4,"rowKind":"INSERT"}', errorMessage='com.dtstack.chunjun.throwable.WriteRecordException: Kudu output-format writeSingleRecordInternal failed.
java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
What you expected to happen
How to reproduce
sink kudu with localTimestamp
Anything else
No response
Version
master
Are you willing to submit PR?
Code of Conduct