Skip to content

Actions: open-compass/VLMEvalKit

Actions

pr_run_test

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
pr-run-test.yml
950 workflow runs
950 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

pr_run_test pr_run_test #1114: Scheduled
25m 34s main
main
25m 34s
pr_run_test pr_run_test #1113: Scheduled
25m 24s main
main
25m 24s
pr_run_test pr_run_test #1112: Scheduled
26m 11s main
main
26m 11s
[API] Add DeepOCR pipeline API provider pr_run_test #1111: Pull request #1473 synchronize by leejooan
28m 17s leejooan:feat/DEEPOCR-api-provider
leejooan:feat/DEEPOCR-api-provider
28m 17s
[API] Add DeepOCR pipeline API provider pr_run_test #1110: Pull request #1473 opened by leejooan
Action required leejooan:feat/DEEPOCR-api-provider
leejooan:feat/DEEPOCR-api-provider
Action required
[Minor] Add dataset NPMM-bench pr_run_test #1109: Pull request #1463 synchronize by FangXinyu-0913
47m 50s OliverLeeXZ:NPMM
OliverLeeXZ:NPMM
47m 50s
[Minor] Add dataset NPMM-bench pr_run_test #1107: Pull request #1463 synchronize by FangXinyu-0913
2m 50s OliverLeeXZ:NPMM
OliverLeeXZ:NPMM
2m 50s
[Minor] Add dataset NPMM-bench pr_run_test #1106: Pull request #1463 synchronize by FangXinyu-0913
9m 55s OliverLeeXZ:NPMM
OliverLeeXZ:NPMM
9m 55s
pr_run_test pr_run_test #1105: Scheduled
2h 43m 45s main
main
2h 43m 45s
[Benchmark] XLRSBench: rewrite evaluate() with track_progress_rich and GPT-assisted scoring pr_run_test #1104: Pull request #1472 opened by TianhaoLiang2000
3h 15m 48s TianhaoLiang2000:xlrsbench-gpt-evaluate
TianhaoLiang2000:xlrsbench-gpt-evaluate
3h 15m 48s
[Minor] sarena: explicit LPIPS model path via LMUDataRoot, use cached tokenizer path pr_run_test #1103: Pull request #1471 opened by TianhaoLiang2000
2h 57m 9s TianhaoLiang2000:sarena-utils-fixes
TianhaoLiang2000:sarena-utils-fixes
2h 57m 9s
[Fix] physics: deduplicate preds to handle repeat output, add signal timeout handler pr_run_test #1102: Pull request #1470 opened by TianhaoLiang2000
3h 2m 41s TianhaoLiang2000:physics-eval-improvements
TianhaoLiang2000:physics-eval-improvements
3h 2m 41s
[Fix] olympiadbench: add isinstance(line, int) guard in build_prompt to handle integer row index pr_run_test #1101: Pull request #1469 opened by TianhaoLiang2000
2h 16m 21s TianhaoLiang2000:olympiadbench-index-fix
TianhaoLiang2000:olympiadbench-index-fix
2h 16m 21s
[Minor] mmifeval: use __name__ for logger, downgrade score_dict log to debug pr_run_test #1100: Pull request #1468 opened by TianhaoLiang2000
2h 34m 38s TianhaoLiang2000:mmifeval-logger-fixes
TianhaoLiang2000:mmifeval-logger-fixes
2h 34m 38s
[Minor] macbench: enable interleave by default, move images before text in non-interleave mode pr_run_test #1099: Pull request #1467 opened by TianhaoLiang2000
1h 58m 16s TianhaoLiang2000:macbench-interleave
TianhaoLiang2000:macbench-interleave
1h 58m 16s
[Fix] chartqapro: cast prediction to str before strip to fix non-string crash pr_run_test #1098: Pull request #1466 opened by TianhaoLiang2000
2h 31m 19s TianhaoLiang2000:chartqapro-str-fix
TianhaoLiang2000:chartqapro-str-fix
2h 31m 19s
[Minor] ChartMimic: Add exception guard, 600s timeout, chart_type 120s, log to debug pr_run_test #1097: Pull request #1465 opened by TianhaoLiang2000
1h 35m 58s TianhaoLiang2000:chartmimic-improvements
TianhaoLiang2000:chartmimic-improvements
1h 35m 58s
[Minor] Add dataset NPMM-bench pr_run_test #1096: Pull request #1463 synchronize by OliverLeeXZ
24m 34s OliverLeeXZ:NPMM
OliverLeeXZ:NPMM
24m 34s
add venusbench pr_run_test #1095: Pull request #1449 synchronize by SunzeY
24m 30s SunzeY:bench/Venus
SunzeY:bench/Venus
24m 30s
[Benchmark] Add DA-2K, ERQA, and RefSpatialBench support pr_run_test #1094: Pull request #1461 synchronize by Qi-Zhangyang
25m 47s Qi-Zhangyang:add-da2k
Qi-Zhangyang:add-da2k
25m 47s
[Minor] Add dataset NPMM-bench pr_run_test #1093: Pull request #1463 opened by OliverLeeXZ
25m 1s OliverLeeXZ:NPMM
OliverLeeXZ:NPMM
25m 1s
pr_run_test pr_run_test #1092: Scheduled
1h 4m 43s main
main
1h 4m 43s
add venusbench pr_run_test #1091: Pull request #1449 synchronize by kennymckormick
1h 15m 45s SunzeY:bench/Venus
SunzeY:bench/Venus
1h 15m 45s
support VBGD pr_run_test #1090: Pull request #1448 synchronize by kennymckormick
54m 22s SunzeY:bench/VBGD
SunzeY:bench/VBGD
54m 22s
[EASI] merge EASI added benchmarks and models into VLMEvalKit pr_run_test #1089: Pull request #1433 synchronize by PeterWangyi
26m 16s PeterWangyi:pr-easi-big
PeterWangyi:pr-easi-big
26m 16s