Enhance SQL Retry

[chenyushuo]

Description

1. Enhance SQL retry.
2. Enhance reward_filter.
3. Enhance logging for checkpoint_manager.

Checklist

Please check the following items before code is ready to be reviewed.

• Code has passed all tests
• Docstrings have been added/updated in Google Style
• Documentation has been updated
• Code is ready for review

[chenyushuo]

/unittest-module-buffer

[github-actions]

Summary

Tests 📝	Passed ✅	Failed ❌	Skipped ⏭️	Other ❓	Flaky 🍂	Duration ⏱️
48	48	0	0	0	0	2m 4s

Tests

Test Name	Status	Flaky	Duration
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline	✅		17.2s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation	✅		6.9s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer	✅		2.9s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft	✅		4.4s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo	✅		5.0s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader	✅		795ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer	✅		1.8s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter	✅		873ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter	✅		803ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter	✅		1.9s
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter	✅		1.8s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter	✅		1.1s
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter	✅		559ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse	✅		6.5s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity	✅		2.3s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control	✅		4.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue	✅		3.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue	✅		3.2s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity	✅		4.0s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration	✅		1.1s
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage	✅		8ms
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_default_sample_strategy	✅		2.0s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_default_queue_staleness_control_sample_strategy	✅		1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_default_sample_strategy	✅		1.8s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_priority_queue_staleness_control_sample_strategy	✅		1.8s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_0::test_sql_staleness_control_sample_strategy	✅		5.3s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_default_sample_strategy	✅		2.0s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_default_queue_staleness_control_sample_strategy	✅		1.7s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_default_sample_strategy	✅		1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_priority_queue_staleness_control_sample_strategy	✅		1.5s
tests/buffer/sample_strategy_test.py::ExperienceStorageTest_1::test_sql_staleness_control_sample_strategy	✅		3.7s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_0	✅		6.0s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write_1	✅		2.7s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write	✅		2.8s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0	✅		81ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1	✅		62ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2	✅		96ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3	✅		96ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4	✅		97ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5	✅		100ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6	✅		138ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple	✅		53ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file	✅		330ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql	✅		2.8s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file	✅		46ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql	✅		3.2s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file	✅		45ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql	✅		3.6s

Github Test Reporter by CTRF 💚