CodaBench — truly the pinnacle of modern benchmarking👏

[hzxie]

Ah, CodaBench — truly the pinnacle of modern benchmarking, if your benchmark for success is broken core functionality.

• Can't export scores in CSV? (The downloaded CSV from "Submissions" organizer panel lacks some columns #1820) Well, who needs actual results in a benchmarking platform, right?
• Submissions can't be downloaded? (Cannot Download Selected Submissions #1822) Makes total sense — what better way to foster transparency and collaboration than by locking the data away?
• Evaluations get stuck? (Submissions Hanging Forever in "Scoring" and "Preparing" State #1794) Nothing says "state-of-the-art" like a platform that freezes mid-process. Very retro.
• Setting competition times is buggy? (Time Zone Issue in Edit Phase Dialog: Start Time and End Time Cannot be Saved Correctly #1796) Because what's a competition without a little chaos in the scheduling department?
• Can’t even count how many entries a user submitted? (Number of Entries incorrect #1804, Removed num_entries becasue the count was slowing down the platform #1673) Really? Even the old-school CodaLab managed that — CodaBench, how did you regress this hard?
• Permission checks? Never heard of them. Anyone can download anyone’s submissions freely (Anyone can download others’ submissions without any permission checks #1824). Why stop at transparency when you can go full-on data leak?
• Mobile UI layout is broken (UI on Mobile Devices: Text Overlap Issue #1795)? Sure, but is that even a problem when the desktop version doesn’t always work as expected either?

In short, CodaBench isn’t just a benchmark platform — it’s a benchmark in how not to run one. Bravo 👏
Avoid CodaBench. It doesn’t just waste your time — it drains your luck.

[Didayolo]

@hzxie

You sound like someone talking down on his girlfriend but staying because he knows he can't find better elsewhere.
Like, why are you still around if the platform is so bad?

Also, do you realize how useless is this issue, as it just reports already reported problems?
Let me suggest a good read for you: https://github.com/codalab/codabench?tab=coc-ov-file